Do Self-Evolving Agents Forget? Capability Degradation and Preservation in Lifelong LLM Agent Adaptation
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
also in 1 more
Abstract (arXiv)
Recent advances in LLM agents enable systems that autonomously refine workflows, accumulate reusable skills, self-train their underlying models, and maintain persistent memory. However, we show that such self-evolution is often non-monotonic: adapting to new task distributions can progressively degrade previously acquired capabilities across all major evolution channels. We identify this phenomenon as capability erosion under self-evolution and show that it consistently emerges across workflow, skill, model, and memory evolution. To mitigate this issue, we propose Capability-Preserving Evolution (CPE), a general stabilization principle that constrains destructive capability drift during continual adaptation. Across all four evolution dimensions, CPE consistently improves retained capability stability while preserving adaptation performance. For example, in workflow evolution, CPE improves retained simple-task performance from 41.8% to 52.8% under GPT-5.1 optimization while simultaneously achieving stronger complex-task adaptation. Our findings suggest that stable long-horizon self-evolving agents require not only acquiring new capabilities, but also explicitly preserving previously learned ones during continual adaptation.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 22 of its 27 references that are in the map. First posted on arXiv 10 May 2026.
Builds on
22 of 27 references.
Closest ancestors · 3
Same direction, newest first
- 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems10 Aug
- 2024DynaSaur: Large Language Agents Beyond Predefined Actions4 Nov
- 2023ExpeL: LLM Agents Are Experiential Learners20 Aug
Other references · 19
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 639
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 543
- 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 136
- 2024Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizingcited by 125
- 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agentscited by 62
- 2024Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuningcited by 60
- 2025EvoFlow: Evolving Diverse Agentic Workflows On The Flycited by 55
- 2025EvoAgentX: An Automated Framework for Evolving Agentic Workflowscited by 44
7 more
- 2026Tool-R0: Self-Evolving LLM Agents for Tool-Learning from Zero Datacited by 34
- 2024B-STaR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasonerscited by 26
- 2025SEW: Self-Evolving Agentic Workflows for Automated Code Generationcited by 20
- 2025SWE-Bench-CL: Continual Learning for Coding Agentscited by 14
- 2026Mechanistic Analysis of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 14
- 2025SuRe: Surprise-Driven Prioritised Replay for Continual LLM Learningcited by 4
- 2026Revisiting Weight Regularization for Low-Rank Continual Learningcited by 3
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026PATH-Bench: Path-Dependent Evaluation of Lifelong Agentscited by 3
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agentscited by 3
- 2026Phantom Gains: Auditing Self-Improvement Against a Measured Nullcited by 2
- 2026ADIAS: Automated Design of Interactive Agentic Systemscited by 1
- 2026D2ACCI: A Dual-Loop Diagnostic Protocol for Evidence-Preserving Agent Memorycited by 0
- 2026Sentry: Learning to Recover from LLM Agent Failures at Test Timecited by 0
- 2026Sentry: Learning to Recover from LLM Agent Failures at Test Time2 Oct 2026
- 2026Phantom Gains: Auditing Self-Improvement Against a Measured Null20 Aug 2026
- 2026D2ACCI: A Dual-Loop Diagnostic Protocol for Evidence-Preserving Agent Memory18 Aug 2026
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agents13 Aug 2026
- 2026ADIAS: Automated Design of Interactive Agentic Systems3 Aug 2026
- 2026PATH-Bench: Path-Dependent Evaluation of Lifelong Agents2 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026When Self-Evolution Backfires: Pre-Commit Gating against Skill Contamination in LLM Agents
- 2026EvoAgentBench: Benchmarking Agent Self-Evolution via Ability Transfer
- 2026Learning What to Remember and What to Internalize in LLM Self-Evolution via Adaptive Memory-Parameter Coordination
- 2026Mem2Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation
- 2026Rethinking Self-Evolving Agent Skills: Feedback Dynamics over Multiple Rounds
- 2026ContinualSkillBench: Can LLM Agents Truly Evolve Their Capabilities?
- 2026Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents
- 2026EvoBelief: Falsifiable World Models for Self-Improving LLM Agents