mlsanityData to 7 Oct 2026

Automating Low-Risk Code Review at Meta: RADAR, Risk Calibration, and Review Efficiency

arXiv 2605.30208 ↗First posted 28 May 2026cs.SE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

AI-assisted coding tools have altered software production. At Meta, significant lines of code per human-landed diff grew by 105.9% year over year and per-developer diff volume rose 51%, with agentic AI responsible for over 80% of that growth. Meanwhile, the share of diffs receiving timely review has declined, exposing a widening gap between code supply and reviewer bandwidth. We ask three questions that progress from feasibility through calibration to impact: (1) can risk-stratified automation operate at scale across diverse organizations, (2) how does tuning the risk threshold affect the trade-off between automation yield and safety, and (3) to what extent does automated review reduce end-to-end latency for AI-generated changes? We deployed RADAR (Risk Aware Diff Auto Review), a multi-stage funnel that classifies each diff by authorship and source type, applies eligibility gates, static heuristics, a machine-learned Diff Risk Score, LLM-based Automated Code Review, and deterministic validation before landing qualifying changes. We evaluate RADAR through telemetry covering 535K+ RADAR-reviewed diffs, observational before-after comparisons for policy changes, and difference-in-differences analysis of efficiency outcomes. RADAR has reviewed 535K+ diffs and landed 331K+. Relaxing the Diff Risk Score threshold from the 25th to the 50th percentile increased the approve rate to 60.31%. The revert rate for RADAR-reviewed diffs is 1/3 that of non-RADAR diffs, and the Production Incident rate is 1/50 that of non-RADAR diffs. RADAR reduces median time to close by over 330% and median diff review wall time by 35%. Risk-aware layered automation can materially reduce review bottlenecks created by AI-driven code growth without compromising production safety.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 29 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

5 of 29 references.

References · 5

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  2. 2023The Impact of AI on Developer Productivity: Evidence from GitHub Copilotcited by 264
  3. 2024Large Language Model-Based Agents for Software Engineering: A Surveycited by 173
  4. 2024Agents in Software Engineering: Survey, Landscape, and Visioncited by 60
  5. 2023Improving Code Reviewer Recommendation: Accuracy, Latency, Workload, and Bystanderscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Code Review to Code Critique: Intent, Drift, and Spotlight for AI-Generated Diffs at Scale
  2. 2026Rethinking Code Review in the Age of AI: A Vision for Agentic Code Review
  3. 2026From Human-Centric to Agentic Code Review: The Impact of Different Generations of Generative AI Technology on Review Quality
  4. 2026The End of Code Review: Coding Agents Supersede Human Inspection
  5. 2026Human-AI Synergy in Agentic Code Review
  6. 2026CR-Bench: Evaluating the Real-World Utility of AI Code Review Agents
  7. 2026From Industry Claims to Empirical Reality: An Empirical Study of Code Review Agents in Pull Requests
  8. 2026When AI Teammates Meet Code Review: Collaboration Signals Shaping the Integration of Agent-Authored Pull Requests