Liquid AI ships LFM2.5-24B-A2B, a 24B MoE with just 2B active params, open-weight on Hugging Face. 184 tokens/s on an M5...

Liquid AI ships LFM2.5-24B-A2B, a 24B MoE with just 2B active params, open-weight on Hugging Face. 184 tokens/s on an M5 Max, 131K context. "Built for fast on-device agents" is doing heavy lifting. The benchmarks back it, but they focus on harness work, so your mileage may vary.Liquid AI: https://www.liquid.ai/blog/lfm2-5-24b-a2b#OpenWeights #LLM #LiquidAI #LocalAI #Moe

Read Original

Related