Self-Evolving Coding Agents
On the map: LLM agents and tool use → Software engineering coding agents
also in 1 more
Abstract (arXiv)
Large language models are increasingly embedded in software engineering workflows as coding agents that can inspect repositories, invoke tools, execute tests, debug failures, and generate patches. Yet most existing coding agents remain largely static after deployment, even though software development is a dynamic, feedback-rich process in which repositories evolve, dependencies change, tests fail, and repair attempts leave reusable experience. This tension has motivated a growing body of work on self-evolving coding agents, where the agent improves its future behavior by persistently updating its framework, memory, skills and tools, components, workflow and topology, or environment and context from prior coding interactions. In this survey, we provide a structured synthesis of this emerging area. We first define the concept of self-evolving coding agents and distinguish it from conventional coding agents and general self-evolving agents. We then develop a taxonomy centered on the targets of evolution, complemented by two orthogonal perspectives: when evolution occurs and which code-specific signals drive it. We further examine the benchmarks used to measure the effect of evolution and related coding products. Across the literature, we find that executable feedback, repository-level context, and coding trajectories make software engineering a natural domain for agent self-evolution, but also introduce challenges in feedback reliability, benchmark overfitting, reversibility, system complexity, safety, cost, and generalization. By organizing existing work around these dimensions, this survey aims to clarify the conceptual boundaries of self-evolving coding agents and provide a foundation for designing more adaptive, reliable, and software-aware agentic systems.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 93 of its 138 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
93 of 138 references.
Closest ancestors · 39
Same direction, newest first
- 2026Harness-R1: Learning to Edit Executable Runtime Harnesses from Agent Failure Trajectories3 Aug
- 2026HarnessCompass: Guiding Automatic Harness Evolution toward Generalizable and Effective Agent Harnesses3 Aug
- 2026HarnessBank: Semantic Gene-Bank Search with Gated Verification for Agent-Harness Self-Evolution15 Jul
- 2026Rethinking the Evaluation of Harness Evolution for Agents14 Jul
- 2026Self-Improving AI Coding Agents Through Accumulated Behavioral Rules: A Closed-Loop Framework13 Jul
- 2026SWE-MeM: Learning Adaptive Memory Management for Long-Horizon Coding Agents26 Jun
- 2026Self-Harness: Harnesses That Improve Themselves8 Jun
- 2026Socratic-SWE: Self-Evolving Coding Agents via Trace-Derived Agent Skills5 Jun
- 2026From Failed Trajectories to Reliable LLM Agents: Diagnosing and Repairing Harness Flaws4 Jun
- 2026Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents28 May
- 2026Adapting the Interface, Not the Model: Runtime Harness Adaptation for Deterministic LLM Agents21 May
- 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnesses28 Apr
27 more
- 2026EffiSkill: Agent Skill Based Automated Code Efficiency Optimization29 Mar
- 2026SEMAG: Self-Evolutionary Multi-Agent Code Generation16 Mar
- 2026SGAgent: Suggestion-Guided LLM-Based Multi-Agent Framework for Repository-Level Software Repair27 Feb
- 2026Your Code Agent Can Grow Alongside You with Structured Memory25 Feb
- 2026Structurally Aligned Subtask-Level Memory for Software Engineering Agents25 Feb
- 2026EvoConfig: Self-Evolving Multi-Agent Systems for Efficient Autonomous Environment Configuration23 Jan
- 2025SWE-RM: Execution-free Feedback For Software Engineering Agents26 Dec
- 2025Toward Training Superintelligent Software Agents through Self-Play SWE-RL21 Dec
- 2025Confucius Code Agent: Scalable Agent Scaffolding for Real-World Codebases11 Dec
- 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?17 Nov
- 2025Process-Level Trajectory Evaluation for Environment Configuration in Software Engineering Agents29 Oct
- 2025Huxley-G"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machine24 Oct
- 2025EvoAgentX: An Automated Framework for Evolving Agentic Workflows4 Jul
- 2025SEW: Self-Evolving Agentic Workflows for Automated Code Generation24 May
- 2025A Self-Improving Coding Agent21 Apr
- 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agents9 Apr
- 2024Training Software Engineering Agents and Verifiers with SWE-Gym30 Dec
- 2024You Name It, I Run It: An LLM Agent to Execute Tests of Arbitrary Projects13 Dec
- 2024SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinement26 Oct
- 2024Self-Evolving Multi-Agent Collaboration Networks for Software Development22 Oct
- 2024Agents in Software Engineering: Survey, Landscape, and Vision13 Sep
- 2024Large Language Model-Based Agents for Software Engineering: A Survey4 Sep
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
- 2024RepairAgent: An Autonomous, LLM-Based Agent for Program Repair25 Mar
- 2024Executable Code Actions Elicit Better LLM Agents1 Feb
- 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challenges14 Jan
Other references · 54
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2021Measuring Coding Challenge Competence With APPScited by 879
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
38 more
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
- 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 667
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
- 2024AutoCodeRover: Autonomous Program Improvementcited by 272
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
- 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systemscited by 177
- 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 128
- 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithmscited by 109
- 2024Agent-Pro: Learning to Evolve via Policy-Level Reflection and Optimizationcited by 93
- 2025MemEvolve: Meta-Evolution of Agent Memory Systemscited by 81
- 2025SEC-bench: Automated Benchmarking of LLM Agents on Real-World Software Security Taskscited by 69
- 2023A Survey on Large Language Models for Software Engineeringcited by 58
- 2025Self-Challenging Language Model Agentscited by 56
- 2025Agent-RLVR: Training Software Engineering Agents via Guidance and Environment Rewardscited by 41
- 2025Repo2Run: Automated Building Executable Environment for Code Repository at Scalecited by 39
- 2025LongCodeBench: Evaluating Coding LLMs at 1M Context Windowscited by 37
- 2026HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundrycited by 37
- 2025EnvBench: A Benchmark for Automated Environment Setupcited by 36
- 2024Mercury: A Code Efficiency Benchmark for Code Large Language Modelscited by 34
- 2025Learning to Solve and Verify: A Self-Play Framework for Code and Test Generationcited by 34
- 2025EXPEREPAIR: Dual-Memory Enhanced LLM-based Repository-Level Program Repaircited by 34
- 2026Group-Evolving Agents: Open-Ended Self-Improvement via Experience Sharingcited by 32
- 2025Improving Code Localization with Repository Memorycited by 19
- 2025PATCHEVAL: A New Benchmark for Evaluating LLMs on Patching Real-World Vulnerabilitiescited by 19
- 2026Self-Play Only Evolves When Self-Synthetic Pipeline Ensures Learnable Information Gaincited by 16
- 2026A Self-Evolving Framework for Efficient Terminal Agents via Observational Context Compressioncited by 12
- 2026Controlled Self-Evolution for Algorithmic Code Optimizationcited by 11
- 2026Continual Learning Bench: Evaluating Frontier AI Systems in Real-World Stateful Environmentscited by 11
- 2024LLMs as Continuous Learners: Improving the Reproduction of Defective Code in Software Issuescited by 10
- 2025Self-Abstraction from Grounded Experience for Plan-Guided Policy Refinementcited by 9
- 2026AgentConductor: Topology Evolution for Multi-Agent Competition-Level Code Generationcited by 9
- 2026CODESKILL: Learning Self-Evolving Skills for Coding Agentscited by 6
- 2026Self-Evolving Agents with Anytime-Valid Certificatescited by 6
- 2026DarwinX: Evolving Agent Harnesses Through Natural Selectioncited by 5
- 2026Tool-Genesis: A Task-Driven Tool Creation Benchmark for Self-Evolving Language Agentcited by 4
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026One Recipe, Many Harnesses: What Self-Evolution Encodes Across Languages and Models ↗
- 2026Don't Blame the Large Language Model: How Agent Harness Evolution Shapes Coding Agent Quality
- 2026What Do AI Agents Actually Change? An Empirical Taxonomy of Mutation Patterns in Performance-Improving Pull Requests
- 2026MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systems
- 2025EvoGit: Decentralized Code Evolution via Git-Based Multi-Agent Collaboration
- 2025NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agents
- 2026Inside the Scaffold: A Source-Code Taxonomy of Coding Agent Architectures
- 2026On the Maintenance and Co-evolution of Agent Plugins: An Empirical Study of Claude Code Plugin Marketplaces