A 60-line static probe found 3 contamination points in an agent eval harness, exit 1, without running the agent. Passing the eval is not solving the task.
Passing the Eval Isn't Solving the Task: 3 Leaks, 60 Lines
Related
I gave a brand-new AI the memory of all my old chats, here's the free tool I built to do it.
My AI conversations were scattered across three apps that couldn't remember each other. So I built a...
DProvenanceKit — regression testing and observability for the reasoning of AI agents (Python, zero deps)
DProvenanceKit — regression testing and observability for the reasoning of AI agents (Python, zero...
OpenSearch Serverless NextGen, uv audit, and Why Schema Constraints Break Small Models
This week's tooling moves cluster around a common theme: eliminating the overhead tax on developer...