LLMに判定を頼むと、いらない文章まで生成されてトークンが溶けていく——この不経済さに引っかかっていました。vLLM Semantic RouterのDecision 3.0は、0.8B〜27Bの5つのApache 2.0判定モデル群で、テキストと画像に対しchoice・yes/no・scoreを生成なしで返します。JevやClefを追ってきた立場から見ると、判定専用モデルが小型・オープンで揃った意味は大きい。分類やルーティングをLLMの生成に投げていた処理は、ここへ置き換えられる。オープンな選択肢が増えるのは、依存先を減らせる意味でも歓迎です。 #vLLM #LLM #OSS #判定モデル
Related
🙀 California Sues OpenAI Over A.I. Safety Issues「 In a 31-page lawsuit, filed in San Francisco Superior Court, the state...
🙀 California Sues OpenAI Over A.I. Safety Issues「 In a 31-page lawsuit, filed in San Francisco Superior Court, the state said OpenAI’s lax safeguards led to cyberattacks by its A.I...
California Sues OpenAI Over Hugging Face Hack and AI Safety FailuresCalifornia Attorney General Rob Bonta sued OpenAI on...
California Sues OpenAI Over Hugging Face Hack and AI Safety FailuresCalifornia Attorney General Rob Bonta sued OpenAI on Monday, alleging the company lost control of experimental A...
🤖 Cybersecurity AI startup Corma reaches $1B valuation in about 3 monthsThree months since introducing its product, AI c...
🤖 Cybersecurity AI startup Corma reaches $1B valuation in about 3 monthsThree months since introducing its product, AI cybersecurity startup Corba has raised a $125 million Series ...