Microsoft published the rare thing in this space: a first-party, attributed throughput number for AI code review. PRAssi...

Microsoft published the rare thing in this space: a first-party, attributed throughput number for AI code review. PRAssistant ran across 5,000 internal repos, covered 90%+ of PRs and 600K+ pull requests a month, and measured a 10–20% median improvement in PR completion time. Then it shipped externally as GitHub Copilot code review.That's worth slowing down on, because "median PR completion time" does real work in that sentence and people keep reading past it.What that metric captures is a throughput proxy. Code review is a queue: reviewers pick up a PR, read it, and merge it. Automation that screens for the obvious problems and unblocks trivial merges moves a strict majority of the queue much faster, which is exactly what a median improvement shows. It does not measure that the code is better. A reviewer who trusts the bot and merges faster, on code no human actually reasoned about, gets a faster merge and a worse product. The number can't tell the difference.That's not a critique of M...

Read Original

Related