Most tests for AI agents check the happy path. The agent gets a task, the tools work, and the test...
What happens when two of an AI agent’s tools fail at once
Related
Three ways a health AI can fail you, and the tests I wrote for each
A caching bug that broke about 1 in 4 page loads, answers that sound surer than they are, and an emergency check that must fire for some sentences and
SLayer: a semantic layer that stops agents guessing SQL
SLayer Text to SQL fails quietly. The model guesses a join, invents a revenue definition,...
We Keep Hearing About AI Productivity. The QA Group Chat Told a Different Story.
An anonymous poll, a debate about multimodal testing, and some uncomfortable questions about who...