A code review vendor ran its own eval comparing a $1.20-per-million-output-token model (Luna) against a frontier one (As...

A code review vendor ran its own eval comparing a $1.20-per-million-output-token model (Luna) against a frontier one (Astra) across 50 public benchmark pull requests from Cal.com, Sentry, Discourse, Keycloak and Grafana. The numbers are worth reading cold, because they show exactly where the cheap model falls apart.Luna found 69 verified bugs for a total run cost of $0.20. Astra found 92 for $5.66. Per verified bug that is $0.0030 against $0.061, a 20x gap. On everyday data and logic bugs the cheap model kept up: 39 verified against Astra's 47. On concurrency, 10 against 13. Those are the stats that justify routing every PR to the cheap model and calling it a day.Then look at the security split. Luna caught 9 of the 24 security bugs. Astra caught 19. And on Keycloak, the IAM server, Luna found 6 verified bugs to Astra's 14, with only half its findings holding up against 93% for Astra. That is not a gently declining curve. It is a cliff on exactly the code you cannot afford to review wr...