MemEvolve: Meta-Evolution of Agent Memory Systems
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
Self-evolving memory systems are unprecedentedly reshaping the evolutionary paradigm of large language model (LLM)-based agents. Prior work has predominantly relied on manually engineered memory architectures to store trajectories, distill experience, and synthesize reusable tools, enabling agents to evolve on the fly within environment interactions. However, this paradigm is fundamentally constrained by the staticity of the memory system itself: while memory facilitates agent-level evolving, the underlying memory architecture cannot be meta-adapted to diverse task contexts. To address this gap, we propose MemEvolve, a meta-evolutionary framework that jointly evolves agents' experiential knowledge and their memory architecture, allowing agent systems not only to accumulate experience but also to progressively refine how they learn from it. To ground MemEvolve in prior research and foster openness in future self-evolving systems, we introduce EvolveLab, a unified self-evolving memory codebase that distills twelve representative memory systems into a modular design space (encode, store, retrieve, manage), providing both a standardized implementation substrate and a fair experimental arena. Extensive evaluations on four challenging agentic benchmarks demonstrate that MemEvolve achieves (I) substantial performance gains, improving frameworks such as SmolAgent and Flash-Searcher by up to 17.06%; and (II) strong cross-task and cross-LLM generalization, designing memory architectures that transfer effectively across diverse benchmarks and backbone models.
Key facts. Cited by 95 papers in the map (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 50 of its 59 references that are in the map. First posted on arXiv 21 Dec 2025.
Builds on
50 of 59 references.
Closest ancestors · 7
Same direction, newest first
- 2025Memory in the Age of AI Agents15 Dec
- 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memory29 Sep
- 2025H2R: Hierarchical Hindsight Reflection for Multi-Task LLM Agents16 Sep
- 2025Hierarchical Memory for High-Efficiency Long-Term Reasoning in LLM Agents23 Jul
- 2025MemEngine: A Unified and Modular Library for Developing Advanced Memory of LLM-based Agents4 May
- 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memory20 Jan
- 2024A Survey on the Memory Mechanism of Large Language Model based Agents21 Apr
Other references · 43
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
- 2025Humanity's Last Examcited by 491
- 2024AFlow: Automating Agentic Workflow Generationcited by 432
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
- 2024Agent Workflow Memorycited by 383
31 more
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
- 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Modelscited by 207
- 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 192
- 2023Synapse: Trajectory-as-Exemplar Prompting with Memory for Computer Controlcited by 187
- 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systemscited by 183
- 2025Multi-agent Architecture Search via Agentic Supernetcited by 179
- 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
- 2025Dynamic Cheatsheet: Test-Time Learning with Adaptive Memorycited by 163
- 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecyclecited by 137
- 2025Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Taskscited by 131
- 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automationcited by 131
- 2025xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluationscited by 120
- 2025Alita: Generalist Agent Enabling Scalable Agentic Reasoning with Minimal Predefinition and Maximal Self-Evolutioncited by 116
- 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?cited by 116
- 2023Exchange-of-Thought: Enhancing Large Language Model Capabilities through Cross-Model Communicationcited by 82
- 2025PyVision: Agentic Vision with Dynamic Toolingcited by 79
- 2025Deep Research: A Survey of Autonomous Research Agentscited by 66
- 2025Robin: A multi-agent system for automating scientific discoverycited by 62
- 2025ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimizationcited by 56
- 2025EvoFlow: Evolving Diverse Agentic Workflows On The Flycited by 55
- 2025Training-Free Group Relative Policy Optimizationcited by 55
- 2025Huxley-G"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machinecited by 53
- 2025TaskCraft: Automated Generation of Agentic Taskscited by 51
- 2025Cognitive Kernel-Pro: A Framework for Deep Research Agents and Agent Foundation Models Trainingcited by 42
- 2025ChemAgent: Self-updating Library in Large Language Models Improves Chemical Reasoningcited by 41
- 2025AgentOrchestra: Orchestrating Multi-Agent Intelligence with the Tool-Environment-Agent(TEA) Protocolcited by 39
- 2025AgentDistill: Training-Free Agent Distillation with Generalizable MCP Boxescited by 30
- 2025Flash-Searcher: Fast and Effective Web Agents via DAG-Based Parallel Executioncited by 27
- 2025Learning on the Job: An Experience-Driven Self-Evolving Agent for Long-Horizon Taskscited by 22
- 2025Aime: Towards Fully-Autonomous Multi-Agent Frameworkcited by 9
- 2023Recognition, recall, and retention of few-shot memories in large language modelscited by 5
Built on by
Citing papers per year: 2026: 95.
95 papers.
Sort:
By area:
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 278
- 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agentscited by 142
- 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolvercited by 81
- 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 74
- 2026MetaClaw: Just Talk -- An Agent That Meta-Learns and Evolves in the Wildcited by 37
- 2026Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agentscited by 34
- 2026Graph-based Agent Memory: Taxonomy, Techniques, and Applicationscited by 25
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanismscited by 21
- 2026HarnessForge: Joint Harness and Policy Evolution for Adaptive Agent Systemscited by 21
- 2026Mem-T: Densifying Rewards for Long-Horizon Memory Agentscited by 18
- 2026Learning to Continually Learn via Meta-learning Agentic Memory Designscited by 18
38 more
- 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applicationscited by 18
- 2026Memory Matters More: Event-Centric Memory as a Logic Map for Agent Searching and Reasoningcited by 17
- 2026EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspectivecited by 17
- 2026JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolutioncited by 16
- 2026LatentMem: Customizing Latent Memory for Multi-Agent Systemscited by 15
- 2026SkillGraph: Skill-Augmented Reinforcement Learning for Agents via Evolving Skill Graphscited by 15
- 2026EvolveMem:Self-Evolving Memory Architecture via AutoResearch for LLM Agentscited by 15
- 2026M^star: Every Task Deserves Its Own Memory Harnesscited by 11
- 2026Harnessing Agentic Evolutioncited by 11
- 2026From Procedural Skills to Strategy Genes: Towards Experience-Driven Test-Time Evolutioncited by 9
- 2026The Meta-Agent Challenge: Are Current Agents Capable of Autonomous Agent Development?cited by 9
- 2026Live-Evo: Online Evolution of Agentic Memory from Continuous Feedbackcited by 8
- 2026ARC: Active and Reflection-driven Context Management for Long-Horizon Information Seeking Agentscited by 7
- 2026Darwinian Memory: A Training-Free Self-Regulating Memory System for GUI Agent Evolutioncited by 7
- 2026Memory Intelligence Agentcited by 7
- 2026Remember the Decision, Not the Description: A Rate-Distortion Framework for Agent Memorycited by 7
- 2026Co-Evolving Skill Generation and Policy Optimizationcited by 7
- 2026HyperSkill: Self-Evolving LLM Agents via Hypergraph-Structured Skill Memorycited by 7
- 2026Gated Differentiable Working Memory for Long-Context Language Modelingcited by 6
- 2026DemoEvolve: Overcoming Sparse Feedback in Agentic Harness Evolution with Demonstrationscited by 6
- 2026MemQ: Integrating Q-Learning into Self-Evolving Memory Agents over Provenance DAGscited by 5
- 2026SkillMAS: Skill Co-Evolution with LLM-based Multi-Agent Systemcited by 5
- 2026AutoMem: Automated Learning of Memory as a Cognitive Skillcited by 5
- 2026LazyMem: Retrieve Broadly, Construct Selectively for Efficient Long-Term Agent Memorycited by 5
- 2026Ask Only When Needed: Proactive Retrieval from Memory and Skills for Experience-Driven Lifelong Agentscited by 4
- 2026Experience Makes Skillful: Enabling Generalizable Medical Agent Reasoning via Self-Evolving Skill Memorycited by 4
- 2026Role-Agent: Bootstrapping LLM Agents via Dual-Role Evolutioncited by 4
- 2026SkillForge: Evolving Verifiable Skills for Reinforcement Learning Agentscited by 4
- 2026Memory Transfer Learning: How Memories are Transferred Across Domains in Coding Agentscited by 3
- 2026Training LLM Agents for Spontaneous, Reward-Free Self-Evolution via World Knowledge Explorationcited by 3
- 2026FlashEvolve: Accelerating Agent Self-Evolution with Asynchronous Stage Orchestrationcited by 3
- 2026Mem-W: Latent Memory-Native GUI Agentscited by 3
- 2026PREPING: Zero-Task Agent Memory Construction via Self-Practicecited by 3
- 2026Mem-π: Adaptive Memory through Learning When and What to Generatecited by 3
- 2026Agent Memory Distillation: Empowering Small LLM Agents with Hierarchical Teacher Memorycited by 3
- 2026EcoGym: Evaluating LLMs for Long-Horizon Plan-and-Execute in Interactive Economiescited by 2
- 2026Self-Evolving LLM Memory Extraction Across Heterogeneous Taskscited by 2
- 2026Ace-Skill: Bootstrapping Multimodal Agents with Prioritized and Clustered Evolutioncited by 2
50 most cited of 95 All 95 (JSON)
- 2026MMLA-RSI: Recursive Self-Improvement through RTT and RTMA14 Oct 2026
- 2026When Non-Adversarial Noise Hurts Learning: Benchmarking Skill Self-Evolution in Agents14 Oct 2026
- 2026New Model, Old Habits: Behavior Transfer under Model Swapping in Multi-Session LLM Agents14 Oct 2026
- 2026STRATA: Self-Maintaining Structured Experience Graphs for Self-Evolving Language Agents14 Oct 2026
- 2026Self-Evolving Agent Harness13 Oct 2026
- 2026Drafting Agents, Not Just Tokens: Speculative Recursive Self-Improvement for Agentic Systems12 Oct 2026
- 2026Beyond Outcome Feedback: Trajectory-Quality-Guided Experience-based Learning10 Oct 2026
- 2026Recurrent Harness for Agentic Continual Learning8 Oct 2026
- 2026SEDIMA: Cross-Run Hierarchical Insight Memory for Evolutionary Search Agents1 Oct 2026
- 2026MemCodex: Self-Programming Hierarchical Memory for Language Agents30 Sep 2026
- 2026Self-Evolving Algorithm-Design Agents: Escaping In-Context Evolutionary Stagnation via Population-Curated Policy Optimization30 Sep 2026
- 2026ReMem: Rethinking Perception and Memory in Long-Context Recommendation Agents29 Sep 2026
38 more
- 2026Harness Evolution as Learning: Approximation, Generalization, and Optimization Limits of Self-Improving Personal Agents29 Sep 2026
- 2026Remember Before You're Asked: MemDream for Self-Probing Memory Evolution28 Sep 2026
- 2026Vestrum: Improving Agent Harnesses by Adapting Their Verification, Structure and Memory27 Sep 2026
- 2026MetaBench-Harness: Unlocking End-to-End Optimization of Benchmark Harnesses27 Sep 2026
- 2026Self-Evolving Multi-Agent Symbolic Discovery for Financial Fundamental Analysis26 Sep 2026
- 2026APEx: Distillation of Agent Procedural Experience for Adaptive Deep Research Question Answering2 Sep 2026
- 2026What Makes Agent Memory Useful for Reliable Unanswerable Question Handling?28 Aug 2026
- 2026JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolution26 Aug 2026
- 2026SkillForge: Evolving Verifiable Skills for Reinforcement Learning Agents25 Aug 2026
- 2026ForeDreamer: A Self-Evolving Dual-Agent Memory Architecture for Future Event Prediction21 Aug 2026
- 2026HyperSkill: Self-Evolving LLM Agents via Hypergraph-Structured Skill Memory17 Aug 2026
- 2026Harness the Memory: A Holistic Evaluation of Memory Substrates in Memory Agents15 Aug 2026
- 2026MindMemOS: A Portable and Self-Evolving Memory Operating Layer for AI Agents12 Aug 2026
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design10 Aug 2026
- 2026Agent Memory Distillation: Empowering Small LLM Agents with Hierarchical Teacher Memory7 Aug 2026
- 2026Self-Evolving Coding Agents4 Aug 2026
- 2026RoMeRL: Balancing Feedback Coverage and the Memory-Reward Trap in Self-Evolving Agent Memory via Reduced-Order Utility States3 Aug 2026
- 2026From Execution to Capability: Scientific Experience Consolidation via Procedural Knowledge Synthesis27 Jul 2026
- 2026Knowledge-Centric Self-Improvement21 Jul 2026
- 2026LazyMem: Retrieve Broadly, Construct Selectively for Efficient Long-Term Agent Memory17 Jul 2026
- 2026Heuristic Learning for Active Flow Control Using Coding Agents13 Jul 2026
- 2026ABot-AgentOS: A General Robotic Agent OS with Lifelong Multi-modal Memory11 Jul 2026
- 2026PraMem: Practice-derived Experiential Memory for Long-horizon Behavior Prediction3 Jul 2026
- 2026AutoMem: Automated Learning of Memory as a Cognitive Skill1 Jul 2026
- 2026OPD-Evolver: Cultivating Holistic Agent Evolver via On-Policy Distillation16 Jun 2026
- 2026AgentSpec: Understanding Embodied Agent Scaffolds Through Controlled Composition12 Jun 2026
- 2026RSMeM: Knowledge-Enhanced Memory Evolution for Remote Sensing Agents with Systematic Evaluation11 Jun 2026
- 2026Trace Only What You Need: Structure-Aware On-Demand Hypergraph Memory for Long-Document Question Answering9 Jun 2026
- 2026Role-Agent: Bootstrapping LLM Agents via Dual-Role Evolution9 Jun 2026
- 2026Experience Makes Skillful: Enabling Generalizable Medical Agent Reasoning via Self-Evolving Skill Memory8 Jun 2026
- 2026Personalization Meets Safety:Mechanisms,Risks,and Mitigations in Personalized LLMs8 Jun 2026
- 2026Co-Evolving Skill Generation and Policy Optimization7 Jun 2026
- 2026ConMem: Structured Memory-Guided Adaptation in Training-Free Multi-Agent Systems7 Jun 2026
- 2026EpiEvolve: Self-Evolving Agents for Streaming Pandemic Forecasting under Regime Shifts3 Jun 2026
- 2026The Meta-Agent Challenge: Are Current Agents Capable of Autonomous Agent Development?3 Jun 2026
- 2026HarnessForge: Joint Harness and Policy Evolution for Adaptive Agent Systems1 Jun 2026
- 2026Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents28 May 2026
- 2026Rethinking Memory as Continuously Evolving Connectivity27 May 2026
50 newest of 95 All 95 (JSON)
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 278
- 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agentscited by 142
- 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolvercited by 81
- 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 74
- 2026MetaClaw: Just Talk -- An Agent That Meta-Learns and Evolves in the Wildcited by 37
- 2026Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agentscited by 34
- 2026Graph-based Agent Memory: Taxonomy, Techniques, and Applicationscited by 25
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanismscited by 21
- 2026HarnessForge: Joint Harness and Policy Evolution for Adaptive Agent Systemscited by 21
- 2026Learning to Continually Learn via Meta-learning Agentic Memory Designscited by 18
- 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applicationscited by 18
- 2026JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolutioncited by 16
12 most cited of 57 All 57 (JSON)
- 2026When Non-Adversarial Noise Hurts Learning: Benchmarking Skill Self-Evolution in Agents14 Oct 2026
- 2026New Model, Old Habits: Behavior Transfer under Model Swapping in Multi-Session LLM Agents14 Oct 2026
- 2026STRATA: Self-Maintaining Structured Experience Graphs for Self-Evolving Language Agents14 Oct 2026
- 2026Drafting Agents, Not Just Tokens: Speculative Recursive Self-Improvement for Agentic Systems12 Oct 2026
- 2026Recurrent Harness for Agentic Continual Learning8 Oct 2026
- 2026SEDIMA: Cross-Run Hierarchical Insight Memory for Evolutionary Search Agents1 Oct 2026
- 2026Self-Evolving Algorithm-Design Agents: Escaping In-Context Evolutionary Stagnation via Population-Curated Policy Optimization30 Sep 2026
- 2026ReMem: Rethinking Perception and Memory in Long-Context Recommendation Agents29 Sep 2026
- 2026Harness Evolution as Learning: Approximation, Generalization, and Optimization Limits of Self-Improving Personal Agents29 Sep 2026
- 2026Remember Before You're Asked: MemDream for Self-Probing Memory Evolution28 Sep 2026
- 2026Vestrum: Improving Agent Harnesses by Adapting Their Verification, Structure and Memory27 Sep 2026
- 2026Self-Evolving Multi-Agent Symbolic Discovery for Financial Fundamental Analysis26 Sep 2026
12 newest of 57 All 57 (JSON)
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
- 2026Mem-T: Densifying Rewards for Long-Horizon Memory Agentscited by 18
- 2026From Procedural Skills to Strategy Genes: Towards Experience-Driven Test-Time Evolutioncited by 9
- 2026The Meta-Agent Challenge: Are Current Agents Capable of Autonomous Agent Development?cited by 9
- 2026Remember the Decision, Not the Description: A Rate-Distortion Framework for Agent Memorycited by 7
- 2026Co-Evolving Skill Generation and Policy Optimizationcited by 7
- 2026Gated Differentiable Working Memory for Long-Context Language Modelingcited by 6
- 2026AutoMem: Automated Learning of Memory as a Cognitive Skillcited by 5
- 2026Ask Only When Needed: Proactive Retrieval from Memory and Skills for Experience-Driven Lifelong Agentscited by 4
- 2026Experience Makes Skillful: Enabling Generalizable Medical Agent Reasoning via Self-Evolving Skill Memorycited by 4
- 2026PREPING: Zero-Task Agent Memory Construction via Self-Practicecited by 3
- 2026Mem-π: Adaptive Memory through Learning When and What to Generatecited by 3
12 most cited of 27 All 27 (JSON)
- 2026MMLA-RSI: Recursive Self-Improvement through RTT and RTMA14 Oct 2026
- 2026Self-Evolving Agent Harness13 Oct 2026
- 2026Beyond Outcome Feedback: Trajectory-Quality-Guided Experience-based Learning10 Oct 2026
- 2026MemCodex: Self-Programming Hierarchical Memory for Language Agents30 Sep 2026
- 2026MetaBench-Harness: Unlocking End-to-End Optimization of Benchmark Harnesses27 Sep 2026
- 2026ForeDreamer: A Self-Evolving Dual-Agent Memory Architecture for Future Event Prediction21 Aug 2026
- 2026MindMemOS: A Portable and Self-Evolving Memory Operating Layer for AI Agents12 Aug 2026
- 2026From Execution to Capability: Scientific Experience Consolidation via Procedural Knowledge Synthesis27 Jul 2026
- 2026PraMem: Practice-derived Experiential Memory for Long-horizon Behavior Prediction3 Jul 2026
- 2026AutoMem: Automated Learning of Memory as a Cognitive Skill1 Jul 2026
- 2026Experience Makes Skillful: Enabling Generalizable Medical Agent Reasoning via Self-Evolving Skill Memory8 Jun 2026
- 2026Co-Evolving Skill Generation and Policy Optimization7 Jun 2026
12 newest of 27 All 27 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026MemPro: Agentic Memory Systems as Evolvable Programs
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence
- 2026MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memory
- 2026Mem2Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation
- 2025Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolution
- 2026Metis: Bridging Text and Code Memory for Self-Evolving Agents
- 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents
- 2026MetaEvo: A Meta-Optimization Framework for Experience-Driven Agent Evolution