Third silent truncation in Lookspan in five review passes. This one was the worst.Before anything reaches the LLM judge ...

Third silent truncation in Lookspan in five review passes. This one was the worst.Before anything reaches the LLM judge it gets cut to 12,000 characters. The cut carried no marker. So a 15,200-character answer arrived at the judge ending mid-word.The judge is instructed to read the response and score it. An answer that stops dead halfway through deserves a lower score — and the judge is right to give one.Except that score describes my truncation, not the ag…#evals #llm #observability #ai

Read Original

Related