These Aren't the Reviews You're Looking For How Humans Review AI-Generated Pull Requests
Not on the map. Why?
Abstract (arXiv)
We analyze code review interactions for AI-generated pull requests (PRs) on GitHub using the AIDev dataset and compare them to human-authored PRs within the same repositories. We find that most AI-generated PRs receive no review and, when reviewed, are largely dominated by AI agents rather than humans. Human-authored PRs are more likely to receive human-only review and to attract direct human feedback. In contrast, reviews of AI-generated PRs more often take the form of automation-mediated interaction, with human involvement frequently expressed through agent steering rather than standalone evaluation. These results indicate systematic differences in how review activity is structured in agentic workflows and raise challenges for interpreting review metrics as indicators of human oversight in large-scale mining studies.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). First posted on arXiv 4 May 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026How AI Coding Agents Communicate: A Study of Pull Request Description Characteristics and Human Review Responses
- 20263100 Opinions on Code Review in an AI World: Building Causal Theory from Practitioner Discourse
- 2026From Human-Centric to Agentic Code Review: The Impact of Different Generations of Generative AI Technology on Review Quality
- 2026On the Footprints of Reviewer Bots Feedback on Agentic Pull Requests in OSS GitHub Repositories
- 2026Human-AI Synergy in Agentic Code Review
- 2026AI-to-AI Code Reviews of GitHub Pull Requests
- 2026Early-Stage Prediction of Review Effort in AI-Generated Pull Requests
- 2026From Industry Claims to Empirical Reality: An Empirical Study of Code Review Agents in Pull Requests