TL;DR: Our LLM-as-judge agreement (Cohen's kappa against human labels) swung between 0.41 and 0.63...
More eval traces will not stabilize your kappa. Stratify the ones you have
Related
Self-healing CI vs AI code fixes: which failures belong where
Self-healing CI vs AI code fixes is a question about failure class, not capability: which failures a runner absorbs, and which belong to the agent.
DoseVoice: I built an AI that reads pill bottles out loud (and knows when to say 'turn the bottle')
This is a submission for the MLH x DEV Writing Challenge Built in 36 hours at HackUMass XIV. Try it:...
Ghost Rovers: I Called 12 Machines NASA Left Behind. One Picked Up.
A 1969 Mission Control console for kids. Built in one day for NASA Space Apps 2026. TL;DR: For NASA...