Autonomous Agents in Software Development: A Vision Paper
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Large Language Models (LLM) and Generative Pre-trained Transformers (GPT), are reshaping the field of Software Engineering (SE). They enable innovative methods for executing many software engineering tasks, including automated code generation, debugging, maintenance, etc. However, only a limited number of existing works have thoroughly explored the potential of GPT agents in SE. This vision paper inquires about the role of GPT-based agents in SE. Our vision is to leverage the capabilities of multiple GPT agents to contribute to SE tasks and to propose an initial road map for future work. We argue that multiple GPT agents can perform creative and demanding tasks far beyond coding and debugging. GPT agents can also do project planning, requirements engineering, and software design. These can be done through high-level descriptions given by the human developer. We have shown in our initial experimental analysis for simple software (e.g., Snake Game, Tic-Tac-Toe, Notepad) that multiple GPT agents can produce high-quality code and document it carefully. We argue that it shows a promise of unforeseen efficiency and will dramatically reduce lead-times. To this end, we intend to expand our efforts to understand how we can scale these autonomous capabilities further.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 17 of its 33 references that are in the map. First posted on arXiv 30 Nov 2023.
Builds on
17 of 33 references.
Closest ancestors · 1
Same direction, newest first
Other references · 16
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
- 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 224
- 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 218
- 2019Hello, It's GPT-2 -- How Can I Help You? Towards the Use of Pretrained Language Models for Task-Oriented Dialogue Systemscited by 110
- 2023Regulating ChatGPT and other Large Generative AI Modelscited by 104
- 2023Is ChatGPT the Ultimate Programming Assistant -- How far is it?cited by 76
- 2022Automatic Code Documentation Generation Using GPT-3cited by 37
- 2023Towards Human-Bot Collaborative Software Architecting with ChatGPTcited by 31
- 2021Exploring Transformers in Natural Language Generation: GPT, BERT, and XLNetcited by 27
4 more
- 2023A Comparative Study of Code Generation using ChatGPT 3.5 across 10 Programming Languagescited by 12
- 2022Incorporating Domain Knowledge through Task Augmentation for Front-End JavaScript Code Generationcited by 11
- 2023Comparing Software Developers with ChatGPT: An Empirical Investigationcited by 11
- 2021Understanding Emails and Drafting Responses -- An Approach Using GPT-3cited by 10
Built on by
Citing papers per year: 2024: 5; 2025: 3; 2026: 4.
12 papers.
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Futurecited by 86
- 2024CodePori: Large-Scale System for Autonomous Software Development Using Multi-Agent Technologycited by 22
- 2024Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysiscited by 20
- 2025An Empirical Study of Agent Developer Practices in AI Agent Frameworkscited by 14
- 2024System for systematic literature review using multiple AI agents: Concept and an empirical evaluationcited by 13
- 2024Large Language Model Evaluation Via Multi AI Agents: Preliminary resultscited by 10
- 2026AgentReputation: A Decentralized Agentic AI Reputation Frameworkcited by 4
- 2026LLM-Based Multi-Agent Systems for Code Generation: A Multi-Vocal Literature Reviewcited by 3
- 2025Autonomous Legacy Web Application Upgrades Using a Multi-Agent Systemcited by 1
- 2025A Research Roadmap for Augmenting Software Engineering Processes and Software Products with Generative AIcited by 1
- 2026Developing LLM-based Multi-Agent Systems in Software Engineering: A Mixed-Method Experience Reportcited by 1
- 2026Artificial Intelligence as a Catalyst for Innovation in Software Engineeringcited by 0
- 2026Developing LLM-based Multi-Agent Systems in Software Engineering: A Mixed-Method Experience Report12 Aug 2026
- 2026AgentReputation: A Decentralized Agentic AI Reputation Framework30 Apr 2026
- 2026Artificial Intelligence as a Catalyst for Innovation in Software Engineering11 Mar 2026
- 2026LLM-Based Multi-Agent Systems for Code Generation: A Multi-Vocal Literature Review25 Feb 2026
- 2025An Empirical Study of Agent Developer Practices in AI Agent Frameworks1 Dec 2025
- 2025A Research Roadmap for Augmenting Software Engineering Processes and Software Products with Generative AI30 Oct 2025
- 2025Autonomous Legacy Web Application Upgrades Using a Multi-Agent System31 Jan 2025
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future5 Aug 2024
- 2024Large Language Model Evaluation Via Multi AI Agents: Preliminary results1 Apr 2024
- 2024System for systematic literature review using multiple AI agents: Concept and an empirical evaluation13 Mar 2024
- 2024CodePori: Large-Scale System for Autonomous Software Development Using Multi-Agent Technology2 Feb 2024
- 2024Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysis2 Feb 2024
Similar, not cited
Close in wording, no citation either way
- 2025AgentMesh: A Cooperative Multi-Agent Generative AI Framework for Software Development Automation
- 2024Agents in Software Engineering: Survey, Landscape, and Vision
- 2026Agyn: A Multi-Agent System for Team-Based Autonomous Software Engineering
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Ahead
- 2024Experimenting with Multi-Agent Software Development: Towards a Unified Platform
- 2026How Do Practitioners Build SE Agents? Insights from a Mixed-Methods Study
- 2024Agentless: Demystifying LLM-based Software Engineering Agents
- 2025Programming with Pixels: Can Computer-Use Agents do Software Engineering?