A small eval harness for an LLM feature in TypeScript: golden cases, exact checks, an LLM judge with a pass/fail rubric, a CI gate and a tracked score.
Evals before prompts: a small eval harness for an LLM feature
Related
My samurai's attack felt like swinging at fog. Here's how I fixed it in Godot 4 (I also let AI try)
My samurai's dash slash looked great in the sprite sheet preview. Then I dropped it into Godot, hit...
Expo's Exact Wants Agents to Write Your App. I Have Doubts
Exact by Expo compiles one Contract file into native iOS, macOS, web, and Linux views. Here is how it compares to React Native and Electron, and what breaks.
Next-Concept Modeling: I Ran Stanford's New Text Generator Against a Classic LLM. Here Is What Happened.
How NCM writes text coarse to fine in 11 steps instead of 128, what the paper claims, what I measured on a laptop, and whether it will replace LLMs.