The Rise of AI Teammates in Software Engineering (SE) 3.0: How Autonomous Coding Agents Are Reshaping Software Engineering
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
The future of software engineering--SE 3.0--is unfolding with the rise of AI teammates: autonomous, goal-driven systems collaborating with human developers. Among these, autonomous coding agents are especially transformative, now actively initiating, reviewing, and evolving code at scale. This paper introduces AIDev, the first large-scale dataset capturing how such agents operate in the wild. Spanning over 456,000 pull requests by five leading agents--OpenAI Codex, Devin, GitHub Copilot, Cursor, and Claude Code--across 61,000 repositories and 47,000 developers, AIDev provides an unprecedented empirical foundation for studying autonomous teammates in software development. Unlike prior work that has largely theorized the rise of AI-native software engineering, AIDev offers structured, open data to support research in benchmarking, agent readiness, optimization, collaboration modeling, and AI governance. The dataset includes rich metadata on PRs, authorship, review timelines, code changes, and integration outcomes--enabling exploration beyond synthetic benchmarks like SWE-bench. For instance, although agents often outperform humans in speed, their PRs are accepted less frequently, revealing a trust and utility gap. Furthermore, while agents accelerate code submission--one developer submitted as many PRs in three days as they had in three years--these are structurally simpler (via code complexity metrics). We envision AIDev as a living resource: extensible, analyzable, and ready for the SE and AI communities. Grounding SE 3.0 in real-world evidence, AIDev enables a new generation of research into AI-native workflows and supports building the next wave of symbiotic human-AI collaboration. The dataset is publicly available at https://github.com/SAILResearch/AI_Teammates_in_SE3. > AI Agent, Agentic AI, Coding Agent, Agentic Coding, Software Engineering Agent
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 17 of its 36 references that are in the map. First posted on arXiv 20 Jul 2025.
Builds on
17 of 36 references.
Closest ancestors · 3
Same direction, newest first
- 2025Unified Software Engineering Agent as AI Software Engineer17 Jun
- 2025Agentic AI Software Engineers: Programming with Trust19 Feb
- 2025Agentic Bug Reproduction for Effective Automated Program Repair at Google3 Feb
Other references · 14
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2016OpenAI Gymcited by 1,684
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,151
- 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 196
- 2025The SWE-Bench Illusion: When State-of-the-Art LLMs Remember Instead of Reasoncited by 47
- 2025LessLeak-Bench: A First Investigation of Data Leakage in LLMs Across 83 Software Engineering Benchmarkscited by 34
- 2024Towards AI-Native Software Engineering (SE 3.0): A Vision and a Challenge Roadmapcited by 30
- 2025SPICE: An Automated SWE-Bench Labeling Pipeline for Issue Clarity, Test Coverage, and Effort Estimationcited by 11
- 2025FeedbackEval: A Benchmark for Evaluating Large Language Models in Feedback-Driven Code Repair Taskscited by 8
- 2024Can Language Models Replace Programmers for Coding? REPOCOD Says 'Not Yet'cited by 7
- 2025Understanding User Mental Models in AI-Driven Code Completion Tools: Insights from an Elicitation Studycited by 5
- 2025Chain of Draft for Software Engineering: Challenges in Applying Concise Reasoning to Code Taskscited by 2
2 more
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025VisCoder2: Building Multi-Language Visualization Coding Agentscited by 3
- 2025HAFixAgent: History-Aware Program Repair Agentcited by 2
- 2026Do programming languages still matter to your AI coding agent teammate? Evidence at scale from chess enginescited by 1
- 2026Harness Engineering: Anatomy, Architecture, and Evolution of Coding Agents -- A Source-Code Study of Eleven Systemscited by 1
- 2026Harness Engineering: Anatomy, Architecture, and Evolution of Coding Agents -- A Source-Code Study of Eleven Systems15 Jul 2026
- 2026Do programming languages still matter to your AI coding agent teammate? Evidence at scale from chess engines11 Jun 2026
- 2025HAFixAgent: History-Aware Program Repair Agent2 Nov 2025
- 2025VisCoder2: Building Multi-Language Visualization Coding Agents24 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Human-AI Collaboration and the Transformation of Software Engineering Work
- 2026From Determinism to Delegation: AI-Native Software Engineering and the Evolution of the Agentic Engineer
- 2026Are We All Using Agents the Same Way? An Empirical Study of Core and Peripheral Developers Use of Coding Agents
- 2026Investigating Autonomous Agent Contributions in the Wild: Activity Patterns and Code Change over Time
- 2026The Rise of AI-Native Software Engineering: Implications for Practice, Education, and the Future Workforce
- 2026Rethinking Software Engineering for Agentic AI Systems
- 2026Agentic AI in the Software Development Lifecycle: Architecture, Empirical Evidence, and the Reshaping of Software Engineering
- 2026Engineering Signals of Human-AI Collaboration in the Agentic Coding Era: A Longitudinal Analysis of 33,228 Pull Requests from vLLM and SGLang with Implications for Biomedical AI Agents and Bioinformatics Pipeline Developmen