Why Agentic-PRs Get Rejected: A Comparative Study of Coding Agents
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Agentic coding -- software development workflows in which autonomous coding agents plan, implement, and submit code changes with minimal human involvement -- is rapidly gaining traction. Prior work has shown that Pull Requests (PRs) produced using coding agents (Agentic-PRs) are accepted less often than PRs that are not labeled as agentic (Human-PRs). The rejection reasons for a single agent (Claude Code) have been explored, but a comparison of how rejection reasons differ between Agentic-PRs generated by different agents has not yet been performed. This comparison is important since different coding agents are often used for different purposes, which can lead to agent-specific failure patterns. In this paper, we inspect 654 rejected PRs from the AIDev dataset covering five coding agents, as well as a human baseline. Our results show that seven rejection modes occur only in Agentic-PRs, including distrust of AI-generated code. We also observe agent-specific patterns (e.g., automated withdrawal of inactive PRs by Devin), reflecting differences in how agents are configured and used in practice. Notably, a large proportion of rejected PRs (67.9%) lack explicit reviewer feedback, making their rejection reasons difficult to determine. To mitigate this issue, we propose a set of heuristics that reduce the proportion of such cases, offering a practical preprocessing step for future studies of PR rejection in agentic coding.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 6 of its 17 references that are in the map. First posted on arXiv 4 Feb 2026.
Builds on
6 of 17 references.
Closest ancestors · 4
Same direction, newest first
- 2025Agentic Refactoring: An Empirical Study of AI Coding Agents6 Nov
- 2025On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHub18 Sep
- 2025Agentic Software Engineering: Foundational Pillars and a Research Roadmap7 Sep
- 2025Vibe Coding vs. Agentic Coding: Fundamentals and Practical Implications of Agentic AI26 May
Other references · 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026SlopCodeBench: Benchmarking How Coding Agents Degrade Over Long-Horizon Iterative Taskscited by 30
- 20263100 Opinions on Code Review in an AI World: Building Causal Theory from Practitioner Discoursecited by 0
- 2026Do These Violent Delights Have Violent Ends? Measuring the Post-Merge Fate of Agentic Codecited by 0
- 2026TRIM: Reducing AI-Generated CodeSlop via Agent Trajectory Minimizationcited by 0
- 2026TRIM: Reducing AI-Generated CodeSlop via Agent Trajectory Minimization20 Jul 2026
- 2026Do These Violent Delights Have Violent Ends? Measuring the Post-Merge Fate of Agentic Code10 Jul 2026
- 20263100 Opinions on Code Review in an AI World: Building Causal Theory from Practitioner Discourse8 Jul 2026
- 2026SlopCodeBench: Benchmarking How Coding Agents Degrade Over Long-Horizon Iterative Tasks25 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Understanding the Rejection of Fixes Generated by Agentic Pull Requests -- Insights from the AIDev Dataset
- 2026Why Are Agentic Pull Requests Merged or Rejected? An Empirical Study
- 2026Where Do AI Coding Agents Fail? An Empirical Study of Failed Agentic Pull Requests in GitHub
- 2026Safer Builders, Risky Maintainers: A Comparative Study of Breaking Changes in Human vs Agentic PRs
- 2026How Do AI Coding Agents Contribute to Software Development? an Empirical Study of Agentic Pull Requests
- 2026Security in the Age of AI Teammates: An Empirical Study of Agentic Pull Requests on GitHub
- 2026Humans Integrate, Agents Fix: How Agent-Authored Pull Requests Are Referenced in Practice
- 2026How AI Coding Agents Modify Code: A Large-Scale Study of GitHub Pull Requests