mlsanityData to 7 Oct 2026

Self-Evolving Coding Agents

arXiv 2608.03392 ↗First posted 4 Aug 2026cs.SEcited by 2

On the map: LLM agents and tool use → Software engineering coding agents

also in 1 more
Abstract (arXiv)

Large language models are increasingly embedded in software engineering workflows as coding agents that can inspect repositories, invoke tools, execute tests, debug failures, and generate patches. Yet most existing coding agents remain largely static after deployment, even though software development is a dynamic, feedback-rich process in which repositories evolve, dependencies change, tests fail, and repair attempts leave reusable experience. This tension has motivated a growing body of work on self-evolving coding agents, where the agent improves its future behavior by persistently updating its framework, memory, skills and tools, components, workflow and topology, or environment and context from prior coding interactions. In this survey, we provide a structured synthesis of this emerging area. We first define the concept of self-evolving coding agents and distinguish it from conventional coding agents and general self-evolving agents. We then develop a taxonomy centered on the targets of evolution, complemented by two orthogonal perspectives: when evolution occurs and which code-specific signals drive it. We further examine the benchmarks used to measure the effect of evolution and related coding products. Across the literature, we find that executable feedback, repository-level context, and coding trajectories make software engineering a natural domain for agent self-evolution, but also introduce challenges in feedback reliability, benchmark overfitting, reversibility, system complexity, safety, cost, and generalization. By organizing existing work around these dimensions, this survey aims to clarify the conceptual boundaries of self-evolving coding agents and provide a foundation for designing more adaptive, reliable, and software-aware agentic systems.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 93 of its 138 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

93 of 138 references.

Closest ancestors · 39

Same direction, newest first

  1. 2026Harness-R1: Learning to Edit Executable Runtime Harnesses from Agent Failure Trajectories3 Aug
  2. 2026HarnessCompass: Guiding Automatic Harness Evolution toward Generalizable and Effective Agent Harnesses3 Aug
  3. 2026HarnessBank: Semantic Gene-Bank Search with Gated Verification for Agent-Harness Self-Evolution15 Jul
  4. 2026Rethinking the Evaluation of Harness Evolution for Agents14 Jul
  5. 2026Self-Improving AI Coding Agents Through Accumulated Behavioral Rules: A Closed-Loop Framework13 Jul
  6. 2026SWE-MeM: Learning Adaptive Memory Management for Long-Horizon Coding Agents26 Jun
  7. 2026Self-Harness: Harnesses That Improve Themselves8 Jun
  8. 2026Socratic-SWE: Self-Evolving Coding Agents via Trace-Derived Agent Skills5 Jun
  9. 2026From Failed Trajectories to Reliable LLM Agents: Diagnosing and Repairing Harness Flaws4 Jun
  10. 2026Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents28 May
  11. 2026Adapting the Interface, Not the Model: Runtime Harness Adaptation for Deterministic LLM Agents21 May
  12. 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnesses28 Apr
27 more
  1. 2026EffiSkill: Agent Skill Based Automated Code Efficiency Optimization29 Mar
  2. 2026SEMAG: Self-Evolutionary Multi-Agent Code Generation16 Mar
  3. 2026SGAgent: Suggestion-Guided LLM-Based Multi-Agent Framework for Repository-Level Software Repair27 Feb
  4. 2026Your Code Agent Can Grow Alongside You with Structured Memory25 Feb
  5. 2026Structurally Aligned Subtask-Level Memory for Software Engineering Agents25 Feb
  6. 2026EvoConfig: Self-Evolving Multi-Agent Systems for Efficient Autonomous Environment Configuration23 Jan
  7. 2025SWE-RM: Execution-free Feedback For Software Engineering Agents26 Dec
  8. 2025Toward Training Superintelligent Software Agents through Self-Play SWE-RL21 Dec
  9. 2025Confucius Code Agent: Scalable Agent Scaffolding for Real-World Codebases11 Dec
  10. 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?17 Nov
  11. 2025Process-Level Trajectory Evaluation for Environment Configuration in Software Engineering Agents29 Oct
  12. 2025Huxley-G"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machine24 Oct
  13. 2025EvoAgentX: An Automated Framework for Evolving Agentic Workflows4 Jul
  14. 2025SEW: Self-Evolving Agentic Workflows for Automated Code Generation24 May
  15. 2025A Self-Improving Coding Agent21 Apr
  16. 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agents9 Apr
  17. 2024Training Software Engineering Agents and Verifiers with SWE-Gym30 Dec
  18. 2024You Name It, I Run It: An LLM Agent to Execute Tests of Arbitrary Projects13 Dec
  19. 2024SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinement26 Oct
  20. 2024Self-Evolving Multi-Agent Collaboration Networks for Software Development22 Oct
  21. 2024Agents in Software Engineering: Survey, Landscape, and Vision13 Sep
  22. 2024Large Language Model-Based Agents for Software Engineering: A Survey4 Sep
  23. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
  24. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
  25. 2024RepairAgent: An Autonomous, LLM-Based Agent for Program Repair25 Mar
  26. 2024Executable Code Actions Elicit Better LLM Agents1 Feb
  27. 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challenges14 Jan

Other references · 54

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  3. 2021Program Synthesis with Large Language Modelscited by 3,509
  4. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  5. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  6. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  7. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  8. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
  9. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  10. 2021Measuring Coding Challenge Competence With APPScited by 879
  11. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  12. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
38 more
  1. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
  2. 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 667
  3. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  4. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
  5. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
  6. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
  7. 2024AutoCodeRover: Autonomous Program Improvementcited by 272
  8. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
  9. 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systemscited by 177
  10. 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 128
  11. 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithmscited by 109
  12. 2024Agent-Pro: Learning to Evolve via Policy-Level Reflection and Optimizationcited by 93
  13. 2025MemEvolve: Meta-Evolution of Agent Memory Systemscited by 81
  14. 2025SEC-bench: Automated Benchmarking of LLM Agents on Real-World Software Security Taskscited by 69
  15. 2023A Survey on Large Language Models for Software Engineeringcited by 58
  16. 2025Self-Challenging Language Model Agentscited by 56
  17. 2025Agent-RLVR: Training Software Engineering Agents via Guidance and Environment Rewardscited by 41
  18. 2025Repo2Run: Automated Building Executable Environment for Code Repository at Scalecited by 39
  19. 2025LongCodeBench: Evaluating Coding LLMs at 1M Context Windowscited by 37
  20. 2026HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundrycited by 37
  21. 2025EnvBench: A Benchmark for Automated Environment Setupcited by 36
  22. 2024Mercury: A Code Efficiency Benchmark for Code Large Language Modelscited by 34
  23. 2025Learning to Solve and Verify: A Self-Play Framework for Code and Test Generationcited by 34
  24. 2025EXPEREPAIR: Dual-Memory Enhanced LLM-based Repository-Level Program Repaircited by 34
  25. 2026Group-Evolving Agents: Open-Ended Self-Improvement via Experience Sharingcited by 32
  26. 2025Improving Code Localization with Repository Memorycited by 19
  27. 2025PATCHEVAL: A New Benchmark for Evaluating LLMs on Patching Real-World Vulnerabilitiescited by 19
  28. 2026Self-Play Only Evolves When Self-Synthetic Pipeline Ensures Learnable Information Gaincited by 16
  29. 2026A Self-Evolving Framework for Efficient Terminal Agents via Observational Context Compressioncited by 12
  30. 2026Controlled Self-Evolution for Algorithmic Code Optimizationcited by 11
  31. 2026Continual Learning Bench: Evaluating Frontier AI Systems in Real-World Stateful Environmentscited by 11
  32. 2024LLMs as Continuous Learners: Improving the Reproduction of Defective Code in Software Issuescited by 10
  33. 2025Self-Abstraction from Grounded Experience for Plan-Guided Policy Refinementcited by 9
  34. 2026AgentConductor: Topology Evolution for Multi-Agent Competition-Level Code Generationcited by 9
  35. 2026CODESKILL: Learning Self-Evolving Skills for Coding Agentscited by 6
  36. 2026Self-Evolving Agents with Anytime-Valid Certificatescited by 6
  37. 2026DarwinX: Evolving Agent Harnesses Through Natural Selectioncited by 5
  38. 2026Tool-Genesis: A Task-Driven Tool Creation Benchmark for Self-Evolving Language Agentcited by 4

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026One Recipe, Many Harnesses: What Self-Evolution Encodes Across Languages and Models ↗
  2. 2026Don't Blame the Large Language Model: How Agent Harness Evolution Shapes Coding Agent Quality
  3. 2026What Do AI Agents Actually Change? An Empirical Taxonomy of Mutation Patterns in Performance-Improving Pull Requests
  4. 2026MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systems
  5. 2025EvoGit: Decentralized Code Evolution via Git-Based Multi-Agent Collaboration
  6. 2025NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agents
  7. 2026Inside the Scaffold: A Source-Code Taxonomy of Coding Agent Architectures
  8. 2026On the Maintenance and Co-evolution of Agent Plugins: An Empirical Study of Claude Code Plugin Marketplaces