Is Agent Code Less Maintainable Than Human Code?
Not on the map. Why?
Abstract (arXiv)
Maintainability is a core dimension of software engineering, shaping how code is written, reviewed, and developed over time. While coding agents have demonstrated strong performance on single-issue tasks, it remains unclear how maintainable their code is when future agents build on top of it, potentially leading to compounding downstream effects. We investigate how agent code compares to human code in these maintenance settings, presenting CodeThread, a framework to construct controlled experiments from repository-level coding benchmarks. Applying CodeThread to four frontier coding agents and four benchmarks, we find that agents are less effective at resolving tasks when building on agent code compared to human code, with task resolve rate drops of up to 13.1%. Regression analysis reveals that many traditional software engineering maintainability metrics do not explain this difference. Instead, the clearest signals are subtler behavioral differences in agent code, such as changes to input validation and error handling, along with differences in downstream code size and task difficulty. These findings highlight the need to evaluate these systems not only by immediate task resolution but also by code maintainability, and point to potential sources of downstream errors introduced by agent code.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 17 of its 36 references that are in the map. First posted on arXiv 19 Jun 2026.
Builds on
17 of 36 references.
References · 17
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 467
- 2025RefactorBench: Evaluating Stateful Reasoning in Language Agents Through Codecited by 30
- 2026SlopCodeBench: Benchmarking How Coding Agents Degrade Over Long-Horizon Iterative Taskscited by 30
- 2026SWE-CI: Evaluating Agent Capabilities in Maintaining Codebases via Continuous Integrationcited by 23
- 2025CodeFlowBench: A Multi-turn, Iterative Benchmark for Complex Code Generationcited by 17
- 2025An Empirical Study on Failures in Automated Issue Solvingcited by 16
- 2025MaintainCoder: Maintainable Code Generation Under Dynamic Requirementscited by 14
- 2025SWE-Bench-CL: Continual Learning for Coding Agentscited by 14
- 2026Debt Behind the AI Boom: A Large-Scale Empirical Study of AI-Generated Code in the Wildcited by 10
5 more
- 2025Investigating The Smells of LLM Generated Codecited by 9
- 2026More Code, Less Reuse: Investigating Code Quality and Reviewer Sentiment towards AI-generated Pull Requestscited by 7
- 2026SWE-Adept: An LLM-Based Agentic Framework for Deep Codebase Analysis and Structured Issue Resolutioncited by 4
- 2026Beyond Bug Fixes: An Empirical Investigation of Post-Merge Code Quality Issues in Agent-Generated Pull Requestscited by 3
- 2026Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolutioncited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Can Agents Design Libraries for Agents?cited by 0
- 2026Definition Grounding in Theory-Level Auto-formalizationcited by 0
- 2026Definition Grounding in Theory-Level Auto-formalization13 Oct 2026
- 2026Can Agents Design Libraries for Agents?29 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Does Code Cleanliness Affect Coding Agents? A Controlled Minimal-Pair Study
- 2026To What Extent Does Agent-generated Code Require Maintenance? An Empirical Study
- 2026Safer Builders, Risky Maintainers: A Comparative Study of Breaking Changes in Human vs Agentic PRs
- 2026Do AI Agents Really Improve Code Readability?
- 2026Coding Agents Don't Know When to Act
- 2025Agent READMEs: An Empirical Study of Context Files for Agentic Coding
- 2026How Do AI Coding Agents Contribute to Software Development? an Empirical Study of Agentic Pull Requests
- 2026AgentSWE: Can Coding Agents Build the Agent You Actually Want?