mlsanityData to 7 Oct 2026

Who Finishes the Job? A Study of Follow-Up Fixes and Commit Authorship on AI Coding Agent Pull Requests

arXiv 2609.26847 ↗First posted 22 Sep 2026cs.SEcited by 0

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

AI coding agents now author a large share of pull requests (PRs) merged into popular open-source projects. A merged agent PR is usually considered finished work; yet, prior studies have reported issues in agent code after the merge (e.g., code smells and static-analysis issues). However, little is known about how often a merged agent PR is fixed afterward, and who actually authors the fixing. In this paper, we follow 6,774 merged agent PRs across five AI coding agents (OpenAI Codex, GitHub Copilot, Devin, Cursor, and Claude Code) from the AIDev-pop dataset (open-source repositories with at least 500 stars) into their follow-up fixes, against a baseline of 5,044 contemporaneous human PRs from the same repositories. We link each merge to its candidate fixes, verify every candidate with human annotators and an LLM judge that matches human-level agreement (binary Cohen's Kappa=0.78 against a human-human K=0.77, Direct-fix precision 90%), and attribute the fixing work at the PR and the commit level. Our findings show that (1) merged agent PRs attract verified fixes at 1.62 times the odds of merged human PRs in the same repositories over the same period of time; (2) 69.6% of verified fixes in agent merges come from the same agent; and (3) 76.4% of the verified fix PRs are agent-authored throughout all commits. These results show that agents currently largely finish their own job, but their merges still require fixing more often than human merges.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 18 of its 43 references that are in the map. First posted on arXiv 22 Sep 2026.

Builds on

18 of 43 references.

Closest ancestors · 11

Same direction, newest first

  1. 2026Why Are Agentic Pull Requests Merged or Rejected? An Empirical Study21 May
  2. 2026To What Extent Does Agent-generated Code Require Maintenance? An Empirical Study7 May
  3. 2026Humans Integrate, Agents Fix: How Agent-Authored Pull Requests Are Referenced in Practice5 Apr
  4. 2026How AI Coding Agents Communicate: A Study of Pull Request Description Characteristics and Human Review Responses19 Feb
  5. 2026AIDev: Studying AI Coding Agents on GitHub9 Feb
  6. 2026Why Are AI Agent Involved Pull Requests (Fix-Related) Remain Unmerged? An Empirical Study29 Jan
  7. 2026Understanding Dominant Themes in Reviewing Agentic AI-authored Code27 Jan
  8. 2026Agentic Much? Adoption of Coding Agents on GitHub26 Jan
  9. 2026How AI Coding Agents Modify Code: A Large-Scale Study of GitHub Pull Requests24 Jan
  10. 2026Analyzing Message-Code Inconsistency in AI Coding Agent-Authored Pull Requests8 Jan
  11. 2024Human-In-the-Loop Software Development Agents19 Nov

Other references · 7

  1. 2026Debt Behind the AI Boom: A Large-Scale Empirical Study of AI-Generated Code in the Wildcited by 9
  2. 2026Will It Survive? Deciphering the Fate of AI-Generated Code in Open Sourcecited by 3
  3. 2026Accountable Agents in Software Engineering: An Analysis of Terms of Service and a Research Roadmapcited by 3
  4. 2021Mea culpa: How developers fix their own simple bugs differently from other developerscited by 2
  5. 2021Do practitioners intentionally self-fix Technical Debt and why?cited by 2
  6. 2021Does it matter who pays back Technical Debt? An empirical study of self-fixed TDcited by 1
  7. 2026These Aren't the Reviews You're Looking For How Humans Review AI-Generated Pull Requestscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Where Do AI Coding Agents Fail? An Empirical Study of Failed Agentic Pull Requests in GitHub
  2. 2026Beyond Bug Fixes: An Empirical Investigation of Post-Merge Code Quality Issues in Agent-Generated Pull Requests
  3. 2026Not All Agents Are Equal: Code Quality and Post-Merge Maintenance Across Five Autonomous Coding Agents in the Wild
  4. 2026Understanding the Rejection of Fixes Generated by Agentic Pull Requests -- Insights from the AIDev Dataset
  5. 2025On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHub
  6. 2026Collaborator or Assistant? How AI Coding Agents Partition Work Across Pull Request Lifecycles
  7. 2026Safer Builders, Risky Maintainers: A Comparative Study of Breaking Changes in Human vs Agentic PRs
  8. 2026Let's Make Every Pull Request Meaningful: An Empirical Analysis of Developer and Agentic Pull Requests