TL;DR: Hand-written eval cases test the failures you already imagined, which are never the ones that...
We stopped writing eval cases by hand. Now every prod incident becomes one.
Related
You Don't Need a New Model Call for Every Commit: A Content-Hash Gate for GitLab CI
Every commit triggers the same review. The diff has not changed. The prompt has not changed. But the...
I saw the broken email in the preview, blamed my phone, and approved the send anyway.
Three days after I sent an email to the subscriber list of one of my brands, a reader replied with a...
Run AI-Written Migrations on a Throwaway Database Before They Touch Yours
The cheapest time to learn that an AI-written migration drops the wrong column is before you point it...