mlsanityData to 14 Oct 2026

Investigating Autonomous Agent Contributions in the Wild: Activity Patterns and Code Change over Time

arXiv 2604.00917 ↗First posted 1 Apr 2026cs.SE cs.AI cs.LGcited by 5

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

The rise of large language models for code has reshaped software development. Autonomous coding agents, able to create branches, open pull requests, and perform code reviews, now actively contribute to real-world projects. Their growing role offers a unique and timely opportunity to investigate AI-driven contributions and their effects on code quality, team dynamics, and software maintainability. In this work, we construct a novel dataset of approximately 110,000 open-source pull requests, including associated commits, comments, reviews, issues, and file changes, collectively representing millions of lines of source code. We compare five popular coding agents, including OpenAI Codex, Claude Code, GitHub Copilot, Google Jules, and Devin, examining how their usage differs in various development aspects such as merge frequency, edited file types, and developer interaction signals, including comments and reviews. Furthermore, we emphasize that code authoring and review are only a small part of the larger software engineering process, as the resulting code must also be maintained and updated over time. Hence, we offer several longitudinal estimates of survival and churn rates for agent-generated versus human-authored code. Ultimately, our findings indicate an increasing agent activity in open-source projects, although their contributions are associated with more churn over time compared to human-authored code.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 28 of its 49 references that are in the map. First posted on arXiv 1 Apr 2026.

Builds on

28 of 49 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHub18 Sep
  2. 2025A Survey on Code Generation with LLM-based Agents31 Jul
  3. 2025CODESIM: Multi-Agent Code Generation and Problem Solving through Simulation-Driven Planning and Debugging8 Feb
  4. 2024Large Language Model-Based Agents for Software Engineering: A Survey4 Sep
  5. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
  6. 2024SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents18 Jun
  7. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
  8. 2024RepairAgent: An Autonomous, LLM-Based Agent for Program Repair25 Mar

Other references · 20

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  2. 2021Program Synthesis with Large Language Modelscited by 3,637
  3. 2021Measuring Coding Challenge Competence With APPScited by 902
  4. 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 218
  5. 2023Rethinking Benchmark and Contamination for Language Models with Rephrased Samplescited by 195
  6. 2025Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivitycited by 101
  7. 2022Productivity Assessment of Neural Code Completioncited by 98
  8. 2023Evaluating the Code Quality of AI-Assisted Code Generation Tools: An Empirical Study on GitHub Copilot, Amazon CodeWhisperer, and ChatGPTcited by 71
  9. 2024RepoAgent: An LLM-Powered Open-Source Framework for Repository-level Code Documentation Generationcited by 70
  10. 2024Quantifying Contamination in Evaluating Code Generation Capabilities of Language Modelscited by 65
  11. 2024Language Models for Code Completion: A Practical Evaluationcited by 39
  12. 2024Towards AI-Native Software Engineering (SE 3.0): A Vision and a Challenge Roadmapcited by 30
8 more
  1. 2023CCT5: A Code-Change-Oriented Pre-Trained Modelcited by 18
  2. 2023AIBugHunter: A Practical Tool for Predicting, Classifying and Repairing Software Vulnerabilitiescited by 17
  3. 2024Unveiling ChatGPT's Usage in Open Source Projects: A Mining-based Studycited by 16
  4. 2025MaintainCoder: Maintainable Code Generation Under Dynamic Requirementscited by 14
  5. 2025Experience with GitHub Copilot for Developer Productivity at Zoominfocited by 8
  6. 2025Does AI Code Review Lead to Code Changes? A Case Study of GitHub Actionscited by 7
  7. 2024The Evolution of Information Seeking in Software Development: Understanding the Role and Impact of AI Assistantscited by 3
  8. 2025Will Your Next Pair Programming Partner Be Human? An Empirical Evaluation of Generative AI as a Collaborative Teammate in a Semester-Long Classroom Settingcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AI IDEs or Autonomous Agents? Measuring the Impact of Coding Agents on Software Development
  2. 2026How AI Coding Agents Modify Code: A Large-Scale Study of GitHub Pull Requests
  3. 2026On Autopilot? An Empirical Study of Human-AI Teaming and Review Practices in Open Source
  4. 2026A Task-Level Evaluation of AI Agents in Open-Source Projects
  5. 2026Safer Builders, Risky Maintainers: A Comparative Study of Breaking Changes in Human vs Agentic PRs
  6. 2026Are We All Using Agents the Same Way? An Empirical Study of Core and Peripheral Developers Use of Coding Agents
  7. 2026When AI Teammates Meet Code Review: Collaboration Signals Shaping the Integration of Agent-Authored Pull Requests
  8. 2026Not All Agents Are Equal: Code Quality and Post-Merge Maintenance Across Five Autonomous Coding Agents in the Wild