TL;DR: Hand-written eval cases test the failures you already imagined, which are never the ones that...
We stopped writing eval cases by hand. Now every prod incident becomes one.
Related
Build a Minimal WebMCP Agent with Playwright and Gemini
WebMCP lets a web page expose tools that AI agents can discover and execute inside the browser. That...
Nobody wants to review the robot's 600-line pull request
An agent opened a pull request on our service last week. Six hundred lines. It rewrote how we handle...
AI Made Me Faster, But It Also Made Me Worse at Writing Code
I never thought I'd say this as someone who has embraced AI from the beginning, but after relying on...