Leaderboards score a model plus a harness on someone else's tasks. Tag landed commits with Agent: trailers and count reverts, fixes and red CI per agent.
The Only Coding-Agent Benchmark That Matters Is Your Own Revert Rate
Related
Behavioral vaccination: a 400-row mixed prime protects a behavior
A 300 SST-2 + 100 AG News LoRA prime, merged with the AG adapter: sentiment 50->74%, AG News 45.8->71.2%, both p
My AI Tests Passed While Half the Mutants Went Undetected
If someone asked me how I verified code written by AI, I used to have a simple answer: I ran the...
Five Months Without Writing a Line of Code: The Basic Loop of Agentic Coding
How I built a JavaScript visualizer by instructing Claude Code in plain language, including what I got wrong, how I checked the work, and where this approach falls short.