Tool-use agents fail silently when a prompt change rewires which tool gets called. 90 lines of Python, 3 judges in a ladder, runnable on a small golden set for a few dollars.
An Eval Harness for Tool-Use Agents: 90 Lines, 3 Judges, $3 Per Run
Related
The Reasoning Ledger: Remembering Decisions, Not Just Data
Part 4 of the Building the AI Memory Stack series After finishing the previous article, I looked at...
[Gemini API in Action] Adding a "Detailed Research Report" Button to a LINE Bot: Using Google Search Grounding to Turn Summaries
Background My LINE Bot has always had a summary feature: you drop a URL in, it crawls...
We caught a SQL injection with an offline AI security scanner — here's the exact query it found
The bug Here's a login endpoint from a small Express demo...