Tested Mistral Small 3.1 24B on my RTX 5060 Ti -- 14.4GB VRAM, 20 tokens/sec, and barely 1.6GB of breathing room left on the card.Slow? Yes. Worth it? Surprisingly, yes.The output quality has no business being this good on a model pressed against the VRAM ceiling. Badly wish I had a better card. This thing's good!Full benchmark breakdown on the blog -- link in comments.#AI #LocalLLM #Ollama #HomeLabAI #Mistral #OpenSourceAIhttps://goarcherdynamics.com/2026/03/30/aihome-mistral-3-1-small-24b-review/?utm_source=mastodon&utm_medium=jetpack_social
Related
Why Frictionless #AI Might Be Harmful: https://spectrum.ieee.org/frictionless-ai-psychology
Why Frictionless #AI Might Be Harmful: https://spectrum.ieee.org/frictionless-ai-psychology
Let's talk about security risks from AI, and what to do about them! https://twp.ai/4hr3GSGet my free secure coding promp...
Let's talk about security risks from AI, and what to do about them! https://twp.ai/4hr3GSGet my free secure coding prompt library here: SecureMyVibe.ca #ai #aisecurity #appsec
#DonaldTrump becomes a boy around murderers who flatter him w tall tales of his accomplishments in the arena of being Tr...
#DonaldTrump becomes a boy around murderers who flatter him w tall tales of his accomplishments in the arena of being Trump. It’s what toddler #Trump longed for as he gazed across ...