mlsanityData to 14 Oct 2026

Why Agentic-PRs Get Rejected: A Comparative Study of Coding Agents

arXiv 2602.04226 ↗First posted 4 Feb 2026cs.SEcited by 4

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Agentic coding -- software development workflows in which autonomous coding agents plan, implement, and submit code changes with minimal human involvement -- is rapidly gaining traction. Prior work has shown that Pull Requests (PRs) produced using coding agents (Agentic-PRs) are accepted less often than PRs that are not labeled as agentic (Human-PRs). The rejection reasons for a single agent (Claude Code) have been explored, but a comparison of how rejection reasons differ between Agentic-PRs generated by different agents has not yet been performed. This comparison is important since different coding agents are often used for different purposes, which can lead to agent-specific failure patterns. In this paper, we inspect 654 rejected PRs from the AIDev dataset covering five coding agents, as well as a human baseline. Our results show that seven rejection modes occur only in Agentic-PRs, including distrust of AI-generated code. We also observe agent-specific patterns (e.g., automated withdrawal of inactive PRs by Devin), reflecting differences in how agents are configured and used in practice. Notably, a large proportion of rejected PRs (67.9%) lack explicit reviewer feedback, making their rejection reasons difficult to determine. To mitigate this issue, we propose a set of heuristics that reduce the proportion of such cases, offering a practical preprocessing step for future studies of PR rejection in agentic coding.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 6 of its 17 references that are in the map. First posted on arXiv 4 Feb 2026.

Builds on

6 of 17 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Agentic Refactoring: An Empirical Study of AI Coding Agents6 Nov
  2. 2025On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHub18 Sep
  3. 2025Agentic Software Engineering: Foundational Pillars and a Research Roadmap7 Sep
  4. 2025Vibe Coding vs. Agentic Coding: Fundamentals and Practical Implications of Agentic AI26 May

Other references · 2

  1. 2024Towards AI-Native Software Engineering (SE 3.0): A Vision and a Challenge Roadmapcited by 30
  2. 2024An Empirical Study on Developers Shared Conversations with ChatGPT in GitHub Pull Requests and Issuescited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Understanding the Rejection of Fixes Generated by Agentic Pull Requests -- Insights from the AIDev Dataset
  2. 2026Why Are Agentic Pull Requests Merged or Rejected? An Empirical Study
  3. 2026Where Do AI Coding Agents Fail? An Empirical Study of Failed Agentic Pull Requests in GitHub
  4. 2026Safer Builders, Risky Maintainers: A Comparative Study of Breaking Changes in Human vs Agentic PRs
  5. 2026How Do AI Coding Agents Contribute to Software Development? an Empirical Study of Agentic Pull Requests
  6. 2026Security in the Age of AI Teammates: An Empirical Study of Agentic Pull Requests on GitHub
  7. 2026Humans Integrate, Agents Fix: How Agent-Authored Pull Requests Are Referenced in Practice
  8. 2026How AI Coding Agents Modify Code: A Large-Scale Study of GitHub Pull Requests