Investigating Autonomous Agent Contributions in the Wild: Activity Patterns and Code Change over Time
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
The rise of large language models for code has reshaped software development. Autonomous coding agents, able to create branches, open pull requests, and perform code reviews, now actively contribute to real-world projects. Their growing role offers a unique and timely opportunity to investigate AI-driven contributions and their effects on code quality, team dynamics, and software maintainability. In this work, we construct a novel dataset of approximately 110,000 open-source pull requests, including associated commits, comments, reviews, issues, and file changes, collectively representing millions of lines of source code. We compare five popular coding agents, including OpenAI Codex, Claude Code, GitHub Copilot, Google Jules, and Devin, examining how their usage differs in various development aspects such as merge frequency, edited file types, and developer interaction signals, including comments and reviews. Furthermore, we emphasize that code authoring and review are only a small part of the larger software engineering process, as the resulting code must also be maintained and updated over time. Hence, we offer several longitudinal estimates of survival and churn rates for agent-generated versus human-authored code. Ultimately, our findings indicate an increasing agent activity in open-source projects, although their contributions are associated with more churn over time compared to human-authored code.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 28 of its 49 references that are in the map. First posted on arXiv 1 Apr 2026.
Builds on
28 of 49 references.
Closest ancestors · 8
Same direction, newest first
- 2025On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHub18 Sep
- 2025A Survey on Code Generation with LLM-based Agents31 Jul
- 2025CODESIM: Multi-Agent Code Generation and Problem Solving through Simulation-Driven Planning and Debugging8 Feb
- 2024Large Language Model-Based Agents for Software Engineering: A Survey4 Sep
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
- 2024SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents18 Jun
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
- 2024RepairAgent: An Autonomous, LLM-Based Agent for Program Repair25 Mar
Other references · 20
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2021Measuring Coding Challenge Competence With APPScited by 902
- 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 218
- 2023Rethinking Benchmark and Contamination for Language Models with Rephrased Samplescited by 195
- 2025Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivitycited by 101
- 2022Productivity Assessment of Neural Code Completioncited by 98
- 2023Evaluating the Code Quality of AI-Assisted Code Generation Tools: An Empirical Study on GitHub Copilot, Amazon CodeWhisperer, and ChatGPTcited by 71
- 2024RepoAgent: An LLM-Powered Open-Source Framework for Repository-level Code Documentation Generationcited by 70
- 2024Quantifying Contamination in Evaluating Code Generation Capabilities of Language Modelscited by 65
- 2024Language Models for Code Completion: A Practical Evaluationcited by 39
- 2024Towards AI-Native Software Engineering (SE 3.0): A Vision and a Challenge Roadmapcited by 30
8 more
- 2023CCT5: A Code-Change-Oriented Pre-Trained Modelcited by 18
- 2023AIBugHunter: A Practical Tool for Predicting, Classifying and Repairing Software Vulnerabilitiescited by 17
- 2024Unveiling ChatGPT's Usage in Open Source Projects: A Mining-based Studycited by 16
- 2025MaintainCoder: Maintainable Code Generation Under Dynamic Requirementscited by 14
- 2025Experience with GitHub Copilot for Developer Productivity at Zoominfocited by 8
- 2025Does AI Code Review Lead to Code Changes? A Case Study of GitHub Actionscited by 7
- 2024The Evolution of Information Seeking in Software Development: Understanding the Role and Impact of AI Assistantscited by 3
- 2025Will Your Next Pair Programming Partner Be Human? An Empirical Evaluation of Generative AI as a Collaborative Teammate in a Semester-Long Classroom Settingcited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026From Conversation to Contribution: Characterizing Coding Agent in Open-Source Softwarecited by 0
- 20263100 Opinions on Code Review in an AI World: Building Causal Theory from Practitioner Discoursecited by 0
- 2026How Do AI Coding Agents Contribute to Software Development? an Empirical Study of Agentic Pull Requestscited by 0
- 2026From Agent Behaviour to Agent-Friendly Documentation: An Empirical Study of How Coding Agents Discover, Read, and Write Technical Documentationcited by 0
- 2026Co-Modifying Application Code and Deployment Infrastructure: A Causal Study of AI Agent Pull Requestscited by 0
- 2026Co-Modifying Application Code and Deployment Infrastructure: A Causal Study of AI Agent Pull Requests9 Oct 2026
- 2026From Agent Behaviour to Agent-Friendly Documentation: An Empirical Study of How Coding Agents Discover, Read, and Write Technical Documentation20 Aug 2026
- 2026How Do AI Coding Agents Contribute to Software Development? an Empirical Study of Agentic Pull Requests23 Jul 2026
- 20263100 Opinions on Code Review in an AI World: Building Causal Theory from Practitioner Discourse8 Jul 2026
- 2026From Conversation to Contribution: Characterizing Coding Agent in Open-Source Software6 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026AI IDEs or Autonomous Agents? Measuring the Impact of Coding Agents on Software Development
- 2026How AI Coding Agents Modify Code: A Large-Scale Study of GitHub Pull Requests
- 2026On Autopilot? An Empirical Study of Human-AI Teaming and Review Practices in Open Source
- 2026A Task-Level Evaluation of AI Agents in Open-Source Projects
- 2026Safer Builders, Risky Maintainers: A Comparative Study of Breaking Changes in Human vs Agentic PRs
- 2026Are We All Using Agents the Same Way? An Empirical Study of Core and Peripheral Developers Use of Coding Agents
- 2026When AI Teammates Meet Code Review: Collaboration Signals Shaping the Integration of Agent-Authored Pull Requests
- 2026Not All Agents Are Equal: Code Quality and Post-Merge Maintenance Across Five Autonomous Coding Agents in the Wild