Kite's 1.5B model: 83 tokens/s on a CPU alone (M1 Max, Q4 GGUF, llama.cpp). Merging the adapter took MLX from 74 to 161 tokens/s, and the 0.99 GB Q4 file kept its quality: 75.0% passing. A fanless MacBook Air M2: 33 on CPU. → https://jocheojeda.com#KiteNET #dotNET #LLM #GGUF #llamacpp
Claude Fable 5.2 passe à 8 $ le million de tokens en entrée et 40 $ en sortie, avec une génération jusqu'à 30 % plus rapide que la 5.1.Sur FrontierCode 2.0, il atteint 49,1 % contr...
the one condonable use of #ai is reverse engineering closed software from these shitty #corpos like the whole thing with Adobe, or the stuff with consoles, especially whatever the ...
MIT PLOW: generative AI designs new herbicides to replace glyphosate — $53M from ARPA-HMIT will lead PLOW, an up to $53M ARPA-H project using generative AI to design safer weed kil...