A while back I benchmarked llama.cpp on a 96GB GPU setup and found its concurrency behavior...
vLLM on 4 GPUs / 64GB: A Multi-Model Benchmark — For a Home Multi-Host Setup, I'd Go with vLLM
Related
I taught my local model taste. Here's the prompt that banned the purple gradient.
Every AI-built landing page looks the same: indigo gradient, Inter, three cards with icons in circles. Onyx 3 is my attempt to fix that in a model that runs on your own machine, pl...
One Markdown File Can Ruin Your Coding Agent. I Checked What Mine Actually Reads.
A while back I hid one sentence inside a log file and handed the file to my coding agent. It ran the...
I Read Codex's Source to Find When It Auto-Compacts. It's 90%, and You Can't Turn It Off
Originally published at its-tahir.com. Codex users keep asking when auto compaction fires and why...