AI Writes Code, Humans Pay the Debt. An Empirical Study on the Sustainability and Evolution of Agent-Generated Code
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Context. The increasing adoption of Generative AI coding agents in software engineering is transforming how developers implement and maintain code. While these systems provide short-term productivity benefits, their long-term impact on software quality and technical debt remains unclear. Aim. We aim to investigate how agent-generated code affects software quality, focusing on issue localization accuracy, the introduction of technical debt, and its evolution over time. Method. We will conduct a large-scale mining software repositories study using the SQuaD dataset, employing a candidate set of 628k issue tickets. We will generate agent-based implementations for these issues, and compare them with the actual commits done by developers using static analysis metrics and tools. We will analyze differences at the commit level and across releases, and we will consider multiple LLM-based Agents selected through a systematic benchmarking strategy. Expected Results. We expect to provide empirical evidence on the trade-offs introduced by agent-based development, including differences in localization accuracy, variations in technical debt introduction, and potential divergence in long-term evolution. We expect the results to highlight variability across LLMs, to enrich our understanding of software evolution with Agents, and to inform more responsible adoption of Agents in software development.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 9 of its 27 references that are in the map. First posted on arXiv 6 Jun 2026.
Builds on
9 of 27 references.
Closest ancestors · 2
Same direction, newest first
- 2026AI-Generated Smells: An Analysis of Code and Architecture in LLM and Agent-Driven Development4 May
- 2026Can AI Agents Generate Microservices? How Far are We?9 Mar
Other references · 7
- 2025Human-Written vs. AI-Generated Code: A Large-Scale Study of Defects, Vulnerabilities, and Complexitycited by 16
- 2024Beyond Functional Correctness: Investigating Coding Style Inconsistencies in Large Language Modelscited by 15
- 2025Code Readability in the Age of Large Language Models: An Industrial Case Study from Atlassiancited by 4
- 2025What Were You Thinking? An LLM-Driven Large-Scale Study of Refactoring Motivations in Open-Source Projectscited by 4
- 2024Evaluating Time-Dependent Methods and Seasonal Effects in Code Technical Debt Predictioncited by 3
- 2021On the Lack of Consensus Among Technical Debt Detection Toolscited by 2
- 2025SQuaD: The Software Quality Datasetcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AI IDEs or Autonomous Agents? Measuring the Impact of Coding Agents on Software Development
- 2026How Do AI Coding Agents Contribute to Software Development? an Empirical Study of Agentic Pull Requests
- 2026Investigating Autonomous Agent Contributions in the Wild: Activity Patterns and Code Change over Time
- 2026Are We All Using Agents the Same Way? An Empirical Study of Core and Peripheral Developers Use of Coding Agents
- 2026A Few Pages of Markdown: Committed AI Configuration and Lower Quality Cost after Coding-Agent Adoption
- 2026Don't Blame the Large Language Model: How Agent Harness Evolution Shapes Coding Agent Quality
- 2026AI builds, We Analyze: An Empirical Study of AI-Generated Build Code Quality
- 2024Evaluating Software Development Agents: Patch Patterns, Code Quality, and Issue Complexity in Real-World GitHub Scenarios