mlsanityData to 14 Oct 2026

Autonomous Agents in Software Development: A Vision Paper

arXiv 2311.18440 ↗First posted 30 Nov 2023cs.SEcited by 12

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Large Language Models (LLM) and Generative Pre-trained Transformers (GPT), are reshaping the field of Software Engineering (SE). They enable innovative methods for executing many software engineering tasks, including automated code generation, debugging, maintenance, etc. However, only a limited number of existing works have thoroughly explored the potential of GPT agents in SE. This vision paper inquires about the role of GPT-based agents in SE. Our vision is to leverage the capabilities of multiple GPT agents to contribute to SE tasks and to propose an initial road map for future work. We argue that multiple GPT agents can perform creative and demanding tasks far beyond coding and debugging. GPT agents can also do project planning, requirements engineering, and software design. These can be done through high-level descriptions given by the human developer. We have shown in our initial experimental analysis for simple software (e.g., Snake Game, Tic-Tac-Toe, Notepad) that multiple GPT agents can produce high-quality code and document it carefully. We argue that it shows a promise of unforeseen efficiency and will dramatically reduce lead-times. To this end, we intend to expand our efforts to understand how we can scale these autonomous capabilities further.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 17 of its 33 references that are in the map. First posted on arXiv 30 Nov 2023.

Builds on

17 of 33 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Self-collaboration Code Generation via ChatGPT15 Apr

Other references · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
  5. 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 224
  6. 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 218
  7. 2019Hello, It's GPT-2 -- How Can I Help You? Towards the Use of Pretrained Language Models for Task-Oriented Dialogue Systemscited by 110
  8. 2023Regulating ChatGPT and other Large Generative AI Modelscited by 104
  9. 2023Is ChatGPT the Ultimate Programming Assistant -- How far is it?cited by 76
  10. 2022Automatic Code Documentation Generation Using GPT-3cited by 37
  11. 2023Towards Human-Bot Collaborative Software Architecting with ChatGPTcited by 31
  12. 2021Exploring Transformers in Natural Language Generation: GPT, BERT, and XLNetcited by 27
4 more
  1. 2023A Comparative Study of Code Generation using ChatGPT 3.5 across 10 Programming Languagescited by 12
  2. 2022Incorporating Domain Knowledge through Task Augmentation for Front-End JavaScript Code Generationcited by 11
  3. 2023Comparing Software Developers with ChatGPT: An Empirical Investigationcited by 11
  4. 2021Understanding Emails and Drafting Responses -- An Approach Using GPT-3cited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 5; 2025: 3; 2026: 4.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025AgentMesh: A Cooperative Multi-Agent Generative AI Framework for Software Development Automation
  2. 2024Agents in Software Engineering: Survey, Landscape, and Vision
  3. 2026Agyn: A Multi-Agent System for Team-Based Autonomous Software Engineering
  4. 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Ahead
  5. 2024Experimenting with Multi-Agent Software Development: Towards a Unified Platform
  6. 2026How Do Practitioners Build SE Agents? Insights from a Mixed-Methods Study
  7. 2024Agentless: Demystifying LLM-based Software Engineering Agents
  8. 2025Programming with Pixels: Can Computer-Use Agents do Software Engineering?