Lookspan's eval feature runs the first 100 items of a dataset. The panel said 'runs up to 100 items synchronously' — the...

Lookspan's eval feature runs the first 100 items of a dataset. The panel said 'runs up to 100 items synchronously' — the same sentence whether your dataset had five items or five hundred.Point a 150-item dataset at it and the button offered to run all 150. The result came back: 100/100 ok.That reads as a clean sweep. Fifty test cases were never evaluated and nothing on the screen said so.Same shape as an export truncation I fixed two weeks ago — and in…#evals #observability #ai #testing

Read Original

Related

Mastodon discussion 22m ago

https://technews.tw/2026/08/15/watermarks-remover/【開源工具挑戰 AI 溯源,可移除 Anthropic、OpenAI 等模型浮水印】『一項名為 watermarks-remover 的開源...

https://technews.tw/2026/08/15/watermarks-remover/【開源工具挑戰 AI 溯源,可移除 Anthropic、OpenAI 等模型浮水印】『一項名為 watermarks-remover 的開源工具在 GitHub 平台釋出,能從 AI 生成的內容移除不同類型的 AI 溯源辨識標記,包含 Unicode 字元、統...