Mem2Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
also in 1 more
Abstract (arXiv)
While large language model--powered agents can self-evolve by accumulating experience or by dynamically creating new assets (i.e., tools or expert agents), existing frameworks typically treat these two evolutionary processes in isolation. This separation overlooks their intrinsic interdependence: the former is inherently bounded by a manually predefined static toolset, while the latter generates new assets from scratch without experiential guidance, leading to limited capability growth and unstable evolution. To address this limitation, we introduce a novel paradigm of co-evolutionary Capability Expansion and Experience Distillation. Guided by this paradigm, we propose the textbfMem2Evolve, which integrates two core components: Experience Memory and Asset Memory. Specifically, Mem2Evolve leverages accumulated experience to guide the dynamic creation of assets, thereby expanding the agent's capability space while simultaneously acquiring new experience to achieve co-evolution. Extensive experiments across 6 task categories and 8 benchmarks demonstrate that Mem2Evolve achieves improvement of 18.53% over standard LLMs, 11.80% over agents evolving solely through experience, and 6.46% over those evolving solely through asset creation, establishing it as a substantially more effective and stable self-evolving agent framework. Code is available at: https://buaa-irip-llm.github.io/Mem2Evolve.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 29 of its 52 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
29 of 52 references.
Closest ancestors · 10
Same direction, newest first
- 2025DeepAgent: A General Reasoning Agent with Scalable Toolsets24 Oct
- 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems10 Aug
- 2025SwarmAgentic: Towards Fully Automated Agentic System Generation via Swarm Intelligence18 Jun
- 2025Self-Evolving Multi-Agent Systems via Textual Backpropagation10 Jun
- 2025Alita: Generalist Agent Enabling Scalable Agentic Reasoning with Minimal Predefinition and Maximal Self-Evolution26 May
- 2024AgentSquare: Automatic LLM Agent Search in Modular Design Space8 Oct
- 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms20 Jun
- 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agents2 Feb
- 2023AutoAgents: A Framework for Automatic Agent Generation29 Sep
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar
Other references · 19
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 494
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 392
- 2023Large Language Models as Tool Makerscited by 303
- 2020Towards Conversational Recommendation over Multi-Type Dialogscited by 107
- 2025Acting Less is Reasoning More! Teaching Model to Act Efficientlycited by 80
7 more
- 2024FullStack Bench: Evaluating LLMs as Full Stack Coderscited by 58
- 2025Lost in Benchmarks? Rethinking Large Language Model Benchmarking with Item Response Theorycited by 45
- 2026UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervisioncited by 26
- 2026ReCreate: Reasoning and Creating Domain Agents Driven by Experiencecited by 24
- 2026ExpSeek: Self-Triggered Experience Seeking for Web Agentscited by 23
- 2026EmoMAS: Emotion-Aware Multi-Agent System for High-Stakes Edge-Deployable Negotiation with Bayesian Orchestrationcited by 5
- 2025MASTER: Enhancing Large Language Model via Multi-Agent Simulated Teachingcited by 2
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026Procedural Memory Distillation: Online Reflection for Self-Improving Language Modelscited by 6
- 2026PILOT in the Loop: Live Self-Improvement for Long-Horizon Agentscited by 4
- 2026EDGE: Experience-Distillation for Guided Exploration in Agentic Reinforcement Learningcited by 2
- 2026From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agentscited by 1
- 2026EpiCon: Collective Agent Learning through Co-Evolving Multimodal Memorycited by 1
- 2026Do Self-Evolving Skills Generalize to Held-Out Tasks?cited by 1
- 2026D2ACCI: A Dual-Loop Diagnostic Protocol for Evidence-Preserving Agent Memorycited by 0
- 2026Behavior2Trip: Towards Personalized Travel Planning via User Behavior Trajectorycited by 0
- 2026JarvisGUI: Towards Cross-Device GUI Agents with Dynamic Task Compositioncited by 0
- 2026LifeMem: Enabling Lifelong Experience Reuse for LLM Agentscited by 0
- 2026From Existing Methods to New Research Ideas: Two Perspectives on Recursive Self-Improvementcited by 0
- 2026Coupled Harness--Model Evolution for Scientific Equation Discoverycited by 0
- 2026Coupled Harness--Model Evolution for Scientific Equation Discovery13 Oct 2026
- 2026From Existing Methods to New Research Ideas: Two Perspectives on Recursive Self-Improvement10 Oct 2026
- 2026Do Self-Evolving Skills Generalize to Held-Out Tasks?30 Sep 2026
- 2026EpiCon: Collective Agent Learning through Co-Evolving Multimodal Memory29 Sep 2026
- 2026LifeMem: Enabling Lifelong Experience Reuse for LLM Agents11 Sep 2026
- 2026JarvisGUI: Towards Cross-Device GUI Agents with Dynamic Task Composition9 Sep 2026
- 2026From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agents4 Sep 2026
- 2026Behavior2Trip: Towards Personalized Travel Planning via User Behavior Trajectory27 Aug 2026
- 2026PILOT in the Loop: Live Self-Improvement for Long-Horizon Agents27 Aug 2026
- 2026EDGE: Experience-Distillation for Guided Exploration in Agentic Reinforcement Learning22 Aug 2026
- 2026D2ACCI: A Dual-Loop Diagnostic Protocol for Evidence-Preserving Agent Memory18 Aug 2026
- 2026Procedural Memory Distillation: Online Reflection for Self-Improving Language Models1 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Evolving-RL: End-to-End Optimization of Experience-Driven Self-Evolving Capability within Agents
- 2025MemEvolve: Meta-Evolution of Agent Memory Systems
- 2026Learning What to Remember and What to Internalize in LLM Self-Evolution via Adaptive Memory-Parameter Coordination
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design
- 2026Do Self-Evolving Agents Forget? Capability Degradation and Preservation in Lifelong LLM Agent Adaptation
- 2026OPD-Evolver: Cultivating Holistic Agent Evolver via On-Policy Distillation
- 2026Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agents