When Self-Evolution Backfires: Pre-Commit Gating against Skill Contamination in LLM Agents
On the map: LLM agents and tool use → Agent skill learning and evolution
Abstract (arXiv)
Self-evolving agents accumulate capability by distilling reusable skills from their execution trajectories, but we find this process is not monotonic: past a critical pool size, newly added skills degrade performance instead of improving it. We formalize this capability-contamination phase transition and trace it to a structural cause: once a defective skill enters the decision context, it becomes reference material for distilling later skills, forming cross-round contamination chains. We further show the contamination is structurally irreversible: removing a source skill after the fact cannot erase the flawed reasoning its descendants have already inherited, so post-hoc rollback recovers only a small fraction of the lost performance. This makes skill admission a pre-commit necessity rather than a post-hoc fix, and motivates Verifier-as-Gatekeeper (VaG): a progressive trust hierarchy whose three heterogeneous critics - structural validity, behavioral harmlessness, and semantic consistency - filter each skill individually, coupled with a marginal-gain subset selection that removes combinatorial contamination at the top tier before skills reach the runtime context. On Terminal-Bench 2, unconditional accumulation rises to a peak and then degrades, giving back most of its gains as the pool keeps growing, and post-hoc removal of the culprit skills recovers only a small part of the drop - the empirical signature of irreversibility. In contrast, VaG improves every round, reaching 72% pass@1 with a pool roughly 5x smaller, and its frozen skill pool transfers positively to four other backbones and a second benchmark without re-evolution. Ablations confirm the three critics are complementary and mutually non-substitutable, each intercepting a largely disjoint class of harmful skills.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 19 of its 28 references that are in the map. First posted on arXiv 6 Aug 2026.
Builds on
19 of 28 references.
Closest ancestors · 3
Same direction, newest first
- 2026SkillOps: Managing LLM Agent Skill Libraries as Self-Maintaining Software Ecosystems13 May
- 2026MetaClaw: Just Talk -- An Agent That Meta-Learns and Evolves in the Wild17 Mar
- 2025Reinforcement Learning for Self-Improving Agent with Skill Library18 Dec
Other references · 16
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2022Large Language Models Can Self-Improvecited by 656
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
- 2023Reinforced Self-Training (ReST) for Language Modelingcited by 486
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
- 2023InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedbackcited by 229
- 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecyclecited by 129
4 more
- 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 119
- 2014Lazier Than Lazy Greedycited by 97
- 2026RouteGuard: Internal-Signal Detection of Skill Poisoning in LLM Agentscited by 6
- 2026SearchArt: Training Long-Horizon Search Agent with Scalable Synthetic and Verified Taskcited by 2
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026S3Gym: Can LLMs Turn Self-Testing and Self-Judging into Self-Improvement?cited by 3
- 2026Compositional Safety Failures in Harness Evolution: Identification and Runtime Monitoringcited by 0
- 2026What Does a Skill Actually Do? Estimands and Evaluation Validity for Tool and Skill Use in LLM Agents: A Critical Reviewcited by 0
- 2026EvoSteer: Online Self-Evolving Graph Orchestration via Reference-Anchored Credit Assignmentcited by 0
- 2026What Can Component-Replacement Evidence Establish? A Critical Scoping Review of Local Decisions in LLM Agentscited by 0
- 2026What Can Component-Replacement Evidence Establish? A Critical Scoping Review of Local Decisions in LLM Agents30 Sep 2026
- 2026EvoSteer: Online Self-Evolving Graph Orchestration via Reference-Anchored Credit Assignment29 Sep 2026
- 2026What Does a Skill Actually Do? Estimands and Evaluation Validity for Tool and Skill Use in LLM Agents: A Critical Review27 Sep 2026
- 2026Compositional Safety Failures in Harness Evolution: Identification and Runtime Monitoring27 Sep 2026
- 2026S3Gym: Can LLMs Turn Self-Testing and Self-Judging into Self-Improvement?31 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agents
- 2026When Experience Becomes Instruction: Trajectory Poisoning in Self-Evolving Agent Skill Systems
- 2026Rethinking Self-Evolving Agent Skills: Feedback Dynamics over Multiple Rounds
- 2026Do Self-Evolving Agents Forget? Capability Degradation and Preservation in Lifelong LLM Agent Adaptation
- 2026Coalition-Aware Skill Reliability for Self-Evolving Agents
- 2026A Wrong Turn Does Not Ruin the Journey: Deviation-Guided Skill Self-Evolution for LLM Agents
- 2026MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolution
- 2026Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skills