I built an evaluation suite for an MCP server — the kind that hands a product's data to an AI agent...
Evaluating an MCP Server
Related
Three ways a health AI can fail you, and the tests I wrote for each
A caching bug that broke about 1 in 4 page loads, answers that sound surer than they are, and an emergency check that must fire for some sentences and
SLayer: a semantic layer that stops agents guessing SQL
SLayer Text to SQL fails quietly. The model guesses a join, invents a revenue definition,...
We Keep Hearing About AI Productivity. The QA Group Chat Told a Different Story.
An anonymous poll, a debate about multimodal testing, and some uncomfortable questions about who...