The first in a build-log series documenting a local LLM project. This entry covers the hardware, the software stack, and the benchmarks used to select a primary model.
LLMs on Consumer Hardware — Part 1: The Stack and First Benchmarks
The first in a build-log series documenting a local LLM project. This entry covers the hardware, the software stack, and the benchmarks used to select a primary model.
Series context: Earlier posts covered my ADW pipeline, the Validate phase, agent state management...
Building an AI-powered triage engine for Google SecOps looks flawless on a whiteboard, but surviving...
Testing clinical AI models presents a paradox: rigorous validation needs realistic data, but using...