From Human-Centric to Agentic Code Review: The Impact of Different Generations of Generative AI Technology on Review Quality
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Code review helps maintain software quality before code integration, but it also imposes a substantial workload on human reviewers. As generative artificial intelligence becomes part of software development, code review is shifting from a primarily human review process toward AI-supported review processes in which large language model (LLM) reviewers and AI agent reviewers participate alongside human reviewers. However, we still lack empirical evidence on how this transition affects review efficiency and review quality. In this paper, we study 1.02 million reviewed pull requests from 207 GitHub projects that transition across three code review eras: human-centric review, LLM-assisted review, and agentic code review. We identify three AI reviewer adoption practices: Gradual AI Adoption, Rapid LLM Adoption, and Rapid AI Agent Adoption. We further model pull request review discussions as reviewer interaction sequences to characterize how human, LLM, and AI agent reviewers collaborate during the review process. Our results show that agent-involved collaboration patterns, especially reviews initiated by AI agents or involving multiple AI agents, are associated with faster review decisions under Gradual AI Adoption and Rapid AI Agent Adoption. However, these efficiency gains do not translate into better review quality. We also find that review activity and pull request type remain important across eras, while human-AI collaboration patterns become the strongest explanatory factor for review efficiency once LLM and AI agent reviewers participate. These findings provide empirical guidance for designing AI-supported code review processes that improve efficiency without weakening review quality.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 11 of its 59 references that are in the map. First posted on arXiv 14 Jul 2026.
Builds on
11 of 59 references.
Closest ancestors · 3
Same direction, newest first
- 2026Human-AI Synergy in Agentic Code Review16 Mar
- 2025On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHub18 Sep
- 2025Agentic Software Engineering: Foundational Pillars and a Research Roadmap7 Sep
Other references · 8
- 2017Soft-DTW: a Differentiable Loss Function for Time-Seriescited by 265
- 2024AI-powered Code Review with LLMs: Early Resultscited by 22
- 2025Rethinking Code Review Workflows with LLM Assistance: An Empirical Studycited by 10
- 2025Does AI Code Review Lead to Code Changes? A Case Study of GitHub Actionscited by 7
- 2025Developer-LLM Conversations: An Empirical Study of Interactions and Generated Code Qualitycited by 6
- 2018Identifying Unmaintained Projects in GitHubcited by 5
- 2024Detecting Refactoring Commits in Machine Learning Python Projects: A Machine Learning-Based Approachcited by 4
- 2026An Empirical Analysis of Community and Coding Patterns in OSS4SG vs. Conventional OSScited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026When AI Teammates Meet Code Review: Collaboration Signals Shaping the Integration of Agent-Authored Pull Requests
- 2026Rethinking Code Review in the Age of AI: A Vision for Agentic Code Review
- 2026How AI Coding Agents Communicate: A Study of Pull Request Description Characteristics and Human Review Responses
- 2026Habituation at the Gate: Rising Approval and Declining Scrutiny in Human Review of AI Agent Code
- 2026These Aren't the Reviews You're Looking For How Humans Review AI-Generated Pull Requests
- 2026More Code, Less Reuse: Investigating Code Quality and Reviewer Sentiment towards AI-generated Pull Requests
- 2026Understanding Dominant Themes in Reviewing Agentic AI-authored Code
- 2026Early-Stage Prediction of Review Effort in AI-Generated Pull Requests