Cerebras (@cerebras)Cerebras Inference에서 Multi-LoRA가 비공개 프리뷰로 제공된다. 하나의 베이스 모델 위에 여러 LoRA 어댑터를 올려 요청마다 전환할 수 있으며, 재로딩이나 별도 배포 없이 지연시간 증가도 없다고 한다. 여러 도메인·고객별 어댑터를 운영하는 추론 인프라에 실용적인 기능이다.https://x.com/cerebras/status/2059752901392859530#cerebras #multilora #lora #inference #llm
Related
LLM router PISA-E cuts inference cost 36% while beating rivalsPISA-E, a prompt-adaptive ensemble router, cuts inference ...
LLM router PISA-E cuts inference cost 36% while beating rivalsPISA-E, a prompt-adaptive ensemble router, cuts inference cost 36% at selected operating points while outperforming ri...
Nvidia's board opened an independent investigation into CEO Jensen Huang, who admitted an affair with a businesswoman U....
Nvidia's board opened an independent investigation into CEO Jensen Huang, who admitted an affair with a businesswoman U.S. intelligence says is a Chinese spy. China denies it, and ...
Jensen Huang has lots of spy friends.One of them lives in the White House.#AI #Nvidia #USPol
Jensen Huang has lots of spy friends.One of them lives in the White House.#AI #Nvidia #USPol