Lookspan's eval feature runs the first 100 items of a dataset. The panel said 'runs up to 100 items synchronously' — the...

Lookspan's eval feature runs the first 100 items of a dataset. The panel said 'runs up to 100 items synchronously' — the same sentence whether your dataset had five items or five hundred.Point a 150-item dataset at it and the button offered to run all 150. The result came back: 100/100 ok.That reads as a clean sweep. Fifty test cases were never evaluated and nothing on the screen said so.Same shape as an export truncation I fixed two weeks ago — and in…#evals #observability #ai #testing

Read Original

Related