Originally published at tengli.dev When I added an LLM-powered eval to mcpgrade, the first real run...
My eval said a perfect MCP server was broken. It was the eval that was lying.
Related
My eval said a perfect MCP server was broken. It was the eval that was lying.
Originally published at tengli.dev When I added an LLM-powered eval to mcpgrade, the first real run...
I Built a Security Tool That Proves Its Own Exploits — Then Got a Better Threat Model in the Comments
Automated offense has one embarrassing failure mode: it lies to you about winning. Point a tool at a...
Your RAG Index Might Be Lying to You: Data Freshness Is the Missing Signal for AI Systems
A follow-up to How Old Is My Data? The failure mode that gets worse when a machine is...