An eval set is an instrument with a purpose, a scoring rule, a calibration record and an expiry date. Where the samples come from, what counts as correct, and what makes the set expire.
How an eval set is built, and why it rots
Related
AI browsers in 2026: Arc, SigmaOS, Perplexity Comet — are any worth switching?
Arc sits frozen under Atlassian. SigmaOS now charges for features Arc gave away. Comet dropped its...
FIELD INTEL REPORT-025
Coverage window: 30 October – 6 November 2026 · Previous report: FIR-024 (30 October 2026) · ▲...
A Word List Tied the Model
I tried to find out which of my comments mattered. The answer was not the one I built for. A few...