Let's Make Every Pull Request Meaningful: An Empirical Analysis of Developer and Agentic Pull Requests
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
The automatic generation of pull requests (PRs) using AI agents has become increasingly common. Although AI-generated PRs are fast and easy to create, their merge rates have been reported to be lower than those created by humans. In this study, we conduct a large-scale empirical analysis of 40,214 PRs collected from the AIDev dataset. We extract 64 features across six families and fit statistical regression models to compare PR merge outcomes for human and agentic PRs, as well as across three AI agents. Our results show that submitter attributes dominate merge outcomes for both groups, while review-related features exhibit contrasting effects between human and agentic PRs. The findings of this study provide insights into improving PR quality through human-AI collaboration.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 4 of its 24 references that are in the map. First posted on arXiv 26 Jan 2026.
Builds on
4 of 24 references.
References · 4
- 2025Human-Written vs. AI-Generated Code: A Large-Scale Study of Defects, Vulnerabilities, and Complexitycited by 16
- 2024Rethinking Software Engineering in the Foundation Model Era: From Task-Driven AI Copilots to Goal-Driven AI Pair Programmerscited by 11
- 2025DeputyDev -- AI Powered Developer Assistant: Breaking the Code Review Logjam through Contextual AI to Boost Developer Productivitycited by 3
- 2024Ecosystem-wide influences on pull request decisions: insights from NPMcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Early Adoption of Agentic Coding Tools by GitHub Projects15 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026How AI Coding Agents Communicate: A Study of Pull Request Description Characteristics and Human Review Responses
- 2026How AI Coding Agents Modify Code: A Large-Scale Study of GitHub Pull Requests
- 2026Humans Integrate, Agents Fix: How Agent-Authored Pull Requests Are Referenced in Practice
- 2026Why Are Agentic Pull Requests Merged or Rejected? An Empirical Study
- 2026Where Do AI Coding Agents Fail? An Empirical Study of Failed Agentic Pull Requests in GitHub
- 2026How Do AI Coding Agents Contribute to Software Development? an Empirical Study of Agentic Pull Requests
- 2026On Autopilot? An Empirical Study of Human-AI Teaming and Review Practices in Open Source
- 2026Code Change Characteristics and Description Alignment: A Comparative Study of Agentic versus Human Pull Requests