OpenAI is urging researchers, evaluators, and AI buyers to treat benchmark results as measurements of...
OpenAI Says AI Benchmark Scores Depend on Harnesses, Budgets, and Memory Design
Related
I checked every MCP server in the official registry. About 1 in 10 is broken.
There is a number going around that roughly half of all remote MCP servers are dead. I had repeated...
OpenAI’s Evaluation Playbook Puts Harness Design at the Center of Model Testing
OpenAI is urging a broader view of frontier-model evaluation: benchmark results reflect not only the...
The memory layer that never calls an LLM: what that buys, and what it costs
Part 4 of **The Answerability Problem, and the one that isn't about abstention. Parts 1–3 argued that...