3100 Opinions on Code Review in an AI World: Building Causal Theory from Practitioner Discourse
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Coding agents now author entire pull requests, and practitioners sharply disagree about what this does to code review: whether it becomes the bottleneck, whether human review is still necessary, and whether it quietly erodes the understanding that it once built. Repository-mining studies measure surface trends but seldom explain the mechanisms beneath them, and the trends themselves prove unstable. A motivating observational analysis of public GITHUB activity finds that agent-authored pull requests are reviewed less often, merged several times faster, and discussed less than human-authored ones, yet the direction of these trends flips under different but equally defensible analysis choices, so the traces establish what is changing without explaining why. To recover the mechanisms, we synthesize practitioner discourse at scale into an explanatory theory: we collect 38,709 grey-literature documents (engineering blogs and Reddit threads), filter to those substantively about code review, and code a stratified random sample of 3,100 with an LLM-assisted pipeline, from which we build a causal model of 26 constructs and 67 relationships (64 directed, 3 contested). Its organizing claim is that review is the control point through which a coding agent's effect on software is decided, and that AI does not fix the sign of that effect: the team sets it, through the expertise its humans bring and how it structures the review process. The theory makes the competing positions explicit and turns "AI is changing code review" into falsifiable propositions with named constructs and moderators. As a secondary contribution, we offer the underlying LLM-assisted, grey-literature theory-building method as a scalable template for software-engineering research, with a public implementation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 95 references that are in the map. First posted on arXiv 8 Jul 2026.
Builds on
23 of 95 references.
Closest ancestors · 14
Same direction, newest first
- 2026Habituation at the Gate: Rising Approval and Declining Scrutiny in Human Review of AI Agent Code21 Jun
- 2026Why Are Agentic Pull Requests Merged or Rejected? An Empirical Study21 May
- 2026On the Footprints of Reviewer Bots Feedback on Agentic Pull Requests in OSS GitHub Repositories27 Apr
- 2026From Industry Claims to Empirical Reality: An Empirical Study of Code Review Agents in Pull Requests3 Apr
- 2026Investigating Autonomous Agent Contributions in the Wild: Activity Patterns and Code Change over Time1 Apr
- 2026When AI Teammates Meet Code Review: Collaboration Signals Shaping the Integration of Agent-Authored Pull Requests23 Feb
- 2026Why Agentic-PRs Get Rejected: A Comparative Study of Coding Agents4 Feb
- 2026A Task-Level Evaluation of AI Agents in Open-Source Projects2 Feb
- 2026More Code, Less Reuse: Investigating Code Quality and Reviewer Sentiment towards AI-generated Pull Requests29 Jan
- 2026Beyond Bug Fixes: An Empirical Investigation of Post-Merge Code Quality Issues in Agent-Generated Pull Requests27 Jan
- 2026Understanding Dominant Themes in Reviewing Agentic AI-authored Code27 Jan
- 2026Code Change Characteristics and Description Alignment: A Comparative Study of Agentic versus Human Pull Requests24 Jan
2 more
Other references · 9
- 2025Guidelines for Empirical Studies in Software Engineering involving Large Language Modelscited by 21
- 2026Debt Behind the AI Boom: A Large-Scale Empirical Study of AI-Generated Code in the Wildcited by 10
- 2026On Autopilot? An Empirical Study of Human-AI Teaming and Review Practices in Open Sourcecited by 5
- 2024Impact of LLM-based Review Comment Generation in Practice: A Mixed Open-/Closed-source User Studycited by 3
- 2026A Large-Scale Comprehensive Measurement of AI-Generated Code in Real-World Repositoriescited by 2
- 2026These Aren't the Reviews You're Looking For How Humans Review AI-Generated Pull Requestscited by 2
- 2021How does Software Change?cited by 1
- 2026The Quiet Contributions: Insights into AI-Generated Silent Pull Requestscited by 1
- 2026A Grounded Theory of Debugging in Professional Software Engineering Practicecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AI-to-AI Code Reviews of GitHub Pull Requests
- 2026Rethinking Code Review in the Age of AI: A Vision for Agentic Code Review
- 2026How AI Coding Agents Communicate: A Study of Pull Request Description Characteristics and Human Review Responses
- 2026From Human-Centric to Agentic Code Review: The Impact of Different Generations of Generative AI Technology on Review Quality
- 2026Is Agentic Code Review Helpful? Mining Developers' Feedback to CodeRabbit Reviews in the Wild
- 2026Humans Integrate, Agents Fix: How Agent-Authored Pull Requests Are Referenced in Practice
- 2026Predicting Acceptance and Review Effort in Human and Agent Pull Requests
- 2026Human-AI Synergy in Agentic Code Review