mlsanityData to 7 Oct 2026

A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence

arXiv 2507.21046 ↗First posted 28 Jul 2025cs.AIcited by 155

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

also in 1 more
Abstract (arXiv)

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse tasks but remain fundamentally static, unable to adapt their internal parameters to novel tasks, evolving knowledge domains, or dynamic interaction contexts. As LLMs are increasingly deployed in open-ended, interactive environments, this static nature has become a critical bottleneck, necessitating agents that can adaptively reason, act, and evolve in real time. This paradigm shift -- from scaling static models to developing self-evolving agents -- has sparked growing interest in architectures and methods enabling continual learning and adaptation from data, interactions, and experiences. This survey provides the first systematic and comprehensive review of self-evolving agents, organizing the field around three foundational dimensions: what, when, and how to evolve. We examine evolutionary mechanisms across agent components (e.g., models, memory, tools, architecture), categorize adaptation methods by stages (e.g., intra-test-time, inter-test-time), and analyze the algorithmic and architectural designs that guide evolutionary adaptation (e.g., scalar rewards, textual feedback, single-agent and multi-agent systems). Additionally, we analyze evaluation metrics and benchmarks tailored for self-evolving agents, highlight applications in domains such as coding, education, and healthcare, and identify critical challenges and research directions in safety, scalability, and co-evolutionary dynamics. By providing a structured framework for understanding and designing self-evolving agents, this survey establishes a roadmap for advancing more adaptive, robust, and versatile agentic systems in both research and real-world deployments, and ultimately sheds light on the realization of Artificial Super Intelligence (ASI) where agents evolve autonomously and perform beyond human-level intelligence across tasks.

Key facts. Cited by 155 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 231 of its 370 references that are in the map. First posted on arXiv 28 Jul 2025.

Builds on

231 of 370 references.

Closest ancestors · 29

Same direction, newest first

  1. 2025Model Editing as a Double-Edged Sword: Steering Agent Ethical Behavior Toward Beneficence or Harm25 Jun
  2. 2025The Cost of Dynamic Reasoning: Demystifying AI Agents and Test-Time Scaling from an AI Infrastructure Perspective4 Jun
  3. 2025Self-Challenging Language Model Agents2 Jun
  4. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents29 May
  5. 2025Multi-Agent Collaboration via Evolving Orchestration26 May
  6. 2025X-MAS: Towards Building Multi-Agent Systems with Heterogeneous LLMs22 May
  7. 2025X-WebAgentBench: A Multilingual Interactive Web Benchmark for Evaluating Global Agentic System21 May
  8. 2025MAS-ZERO: Designing Multi-Agent Systems with Zero Supervision21 May
  9. 2025Meta-Thinking in LLMs via Multi-Agent Reinforcement Learning: A Survey20 Apr
  10. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systems31 Mar
  11. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges27 Mar
  12. 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents3 Mar
17 more
  1. 2025Collab-Overcooked: Benchmarking and Evaluating Large Language Models as Collaborative Agents27 Feb
  2. 2025SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoning7 Feb
  3. 2025Multi-agent Architecture Search via Agentic Supernet6 Feb
  4. 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologies4 Feb
  5. 2025Learn-by-interact: A Data-Centric Framework for Self-Adaptive Agents in Realistic Environments18 Jan
  6. 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks18 Dec
  7. 2024Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System10 Oct
  8. 2024G"odel Agent: A Self-Referential Agent Framework for Recursive Self-Improvement6 Oct
  9. 2024Automated Design of Agentic Systems15 Aug
  10. 2024Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents13 Aug
  11. 2024AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generation1 Aug
  12. 2024Symbolic Learning Enables Self-Evolving Agents26 Jun
  13. 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms20 Jun
  14. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
  15. 2024Benchmark Self-Evolving: A Multi-Agent Framework for Dynamic LLM Evaluation18 Feb
  16. 2023Experiential Co-Learning of Software-Developing Agents28 Dec
  17. 2023AgentBench: Evaluating LLMs as Agents7 Aug

Other references · 202

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  5. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  6. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  7. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  8. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  9. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  10. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  11. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  12. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
38 more
  1. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  2. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
  3. 2023Large Language Models as Optimizerscited by 830
  4. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  5. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
  6. 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 723
  7. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
  8. 2022A Survey on In-context Learningcited by 717
  9. 2022Large Language Models Can Self-Improvecited by 656
  10. 2024Self-Rewarding Language Modelscited by 654
  11. 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 628
  12. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
  13. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
  14. 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 574
  15. 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Modelscited by 552
  16. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
  17. 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 488
  18. 2023RRHF: Rank Responses to Align Language Models with Human Feedback without tearscited by 454
  19. 2021MetaICL: Learning to Learn In Contextcited by 450
  20. 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 442
  21. 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 429
  22. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 424
  23. 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agentscited by 406
  24. 2024Training Language Models to Self-Correct via Reinforcement Learningcited by 405
  25. 2024AFlow: Automating Agentic Workflow Generationcited by 395
  26. 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 383
  27. 2025RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learningcited by 357
  28. 2024Agent Workflow Memorycited by 342
  29. 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agentscited by 341
  30. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 323
  31. 2025rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinkingcited by 308
  32. 2022A Survey of Machine Unlearningcited by 298
  33. 2024Quiet-STaR: Language Models Can Teach Themselves to Think Before Speakingcited by 292
  34. 2024Agent-SafetyBench: Evaluating the Safety of LLM Agentscited by 280
  35. 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 272
  36. 2024TextGrad: Automatic "Differentiation" via Textcited by 250
  37. 2024WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learningcited by 243
  38. 2024LiveBench: A Challenging, Contamination-Limited LLM Benchmarkcited by 242

50 most cited of 202 All 202 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 44; 2026: 111.

155 papers.

Sort:

By area:

  1. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 253
  2. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 195
  3. 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
  4. 2026SoK: Agentic Skills -- Beyond Tool Use in LLM Agentscited by 120
  5. 2025MemGen: Weaving Generative Latent Memory for Self-Evolving Agentscited by 99
  6. 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 74
  7. 2025Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolutioncited by 65
  8. 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agentscited by 52
  9. 2025FLEX: Continuous Agent Evolution via Forward Learning from Experiencecited by 51
  10. 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agentscited by 47
  11. 2026SkillOS: Learning Skill Curation for Self-Evolving Agentscited by 45
  12. 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agentscited by 40
38 more
  1. 2025VCRL: Variance-based Curriculum Reinforcement Learning for Large Language Modelscited by 35
  2. 2026Dynamic Dual-Granularity Skill Bank for Agentic RLcited by 33
  3. 2025Self-Improving LLM Agents at Test-Timecited by 30
  4. 2025SPELL: Self-Play Reinforcement Learning for Evolving Long-Context Language Modelscited by 27
  5. 2025VISTA: A Test-Time Self-Improving Video Generation Agentcited by 26
  6. 2025LLM-based Agentic Reasoning Frameworks: A Survey from Methods to Scenarioscited by 25
  7. 2025ArcMemo: Abstract Reasoning Composition with Lifelong LLM Memorycited by 22
  8. 2025Learning on the Job: An Experience-Driven Self-Evolving Agent for Long-Horizon Taskscited by 22
  9. 2025Mini-Omni-Reasoner: Token-Level Thinking-in-Speaking in Large Speech Modelscited by 20
  10. 2025DeepWideSearch: Benchmarking Depth and Width in Agentic Information Seekingcited by 20
  11. 2025Adaptation of Agentic AI: A Survey of Post-Training, Memory, and Skillscited by 19
  12. 2025Toward Effective Tool-Integrated Reasoning via Self-Evolved Preference Learningcited by 17
  13. 2026Agent-as-a-Judgecited by 15
  14. 2026SkillDAG: Self-Evolving Typed Skill Graphs for LLM Skill Selection at Scalecited by 15
  15. 2025Physics Supernova: AI Agent Matches Elite Gold Medalists at IPhO 2025cited by 14
  16. 2025SSRL: Self-Search Reinforcement Learningcited by 13
  17. 2025Environment Scaling for Interactive Agentic Experience Collection: A Surveycited by 13
  18. 2026Rethinking the Value of Agent-Generated Tests for LLM-Based Software Engineering Agentscited by 13
  19. 2026SimWorld Studio: Automatic Environment Generation with Evolving Coding Agent for Embodied Agent Learningcited by 13
  20. 2026Harness-R1: Learning to Edit Executable Runtime Harnesses from Agent Failure Trajectoriescited by 13
  21. 2025AI Meets Brain: Memory Systems from Cognitive Neuroscience to Autonomous Agentscited by 12
  22. 2026MemoBrain: Executive Memory as an Agentic Brain for Reasoningcited by 12
  23. 2026Autogenesis: A Self-Evolving Agent Protocolcited by 12
  24. 2026Skill-R1: Agent Skill Evolution via Reinforcement Learningcited by 12
  25. 2025Agentic Learner with Grow-and-Refine Multimodal Semantic Memorycited by 11
  26. 2025AutoTool: Dynamic Tool Selection and Integration for Agentic Reasoningcited by 11
  27. 2025Alita-G: Self-Evolving Generative Agent for Agent Generationcited by 10
  28. 2026Beyond Entangled Planning: Task-Decoupled Planning for Long-Horizon Agentscited by 9
  29. 2026M^star: Every Task Deserves Its Own Memory Harnesscited by 9
  30. 2026Memory is Reconstructed, Not Retrieved: Graph Memory for LLM Agentscited by 9
  31. 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Tracescited by 9
  32. 2025LatentEvolve: Self-Evolving Test-Time Scaling in Latent Spacecited by 8
  33. 2025Towards Agentic Self-Learning LLMs in Search Environmentcited by 8
  34. 2025Reinforcement Learning for Tool-Integrated Interleaved Thinking towards Cross-Domain Generalizationcited by 7
  35. 2025A Comprehensive Empirical Evaluation of Agent Frameworks on Code-centric Software Engineering Taskscited by 7
  36. 2025Zoom in, Click out: Unlocking and Evaluating the Potential of Zooming for GUI Groundingcited by 7
  37. 2026Active Zero: Self-Evolving Vision-Language Models through Active Environment Explorationcited by 7
  38. 2026Your Agents Are Aging Too: Agent Lifespan Engineering for Deployed Systemscited by 7

50 most cited of 155 All 155 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems
  2. 2025MemEvolve: Meta-Evolution of Agent Memory Systems
  3. 2026Towards AGI A Pragmatic Approach Towards Self Evolving Agent
  4. 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design
  5. 2026Position: Agentic Evolution is the Path to Evolving LLMs
  6. 2026PACE: Two-Timescale Self-Evolution for Small Language Model Agents
  7. 2026Self-Consolidation for Self-Evolving Agents
  8. 2024AgentGym: Evolving Large Language Model-based Agents across Diverse Environments