During an overload experiment on vLLM, the engine's own prompt token counter missed a third to half...
Your LLM Capacity Plan Is Lying to You: Inside vLLM Overload Traces
Related
A Small Laptop Is a Full Build Kit: Bootstrapping with a Chromebook, Claude, and GitHub
A small laptop is a full build kit. Here's how far mine went. TL;DR: A reader suggested I publish...
Reverse Engineering Nvidia
NVIDIA's GPU Is Closed Hardware With a Compiler Inside It. Here's What Reverse Engineering...
When Is an AI Rewrite Finished?
AI makes it easier to attempt a replacement. The harder question is what the new software still owes...