The reply was "No. The passage does not support Yes." Target: Yes. Two of Inspect AI's three deterministic scorers marked it correct. Ten BoolQ rows, one material.
Two eval scorers passed a wrong answer because it mentioned the right one
Related
Not every AI feature needs an agent
Why my WhatsApp assistant uses a workflow, with the same task built both ways and compared through real model traces.
"Give an Agent a Tool That Almost Fits and Watch What It Does"
A trending post this week described giving Claude Code ten translation tools and watching it ignore...
n8n Nod Uses an Isolated Browser and Vault to Protect Agent Logins
n8n has released Nod, a standalone personal agent designed to run on a user's computer rather than...