Averages, Elo, IRT: how composite LLM indices differ

Three ways to turn many benchmarks into one number, what each one actually measures, and why they stop agreeing at the very top.

Read Original

Related

Dev.to tutorial 1h ago

Orchestrating Agents: Nobody Decides Who Goes Next

In a Strands swarm, routing is a model's tool call and termination is silence. Real runs against strands-agents 1.63.0 show what 'completed' actually means: nobody asked for help.