The first in a build-log series documenting a local LLM project. This entry covers the hardware, the software stack, and the benchmarks used to select a primary model.
LLMs on Consumer Hardware — Part 1: The Stack and First Benchmarks
Related
How I Got My AI Coding Agent to Read Git Blame Before It Refactors Anything
TL;DR I gave my autonomous coding agent a rule: before touching any function you didn't...
Measuring the real concurrency ceiling of an LLM agent runner
I wanted to raise the concurrency limits on my local AI agent runner. The UI now supports multiple...
How Developers Think About Software Testing in the AI Era
Writing code is only half the job. The other half is proving that it behaves the way you think it...