mlsanityData to 14 Oct 2026

MemEvolve: Meta-Evolution of Agent Memory Systems

arXiv 2512.18746 ↗First posted 21 Dec 2025cs.CL cs.MAcited by 95

On the map: LLM agents and tool use → Agent memory systems

Abstract (arXiv)

Self-evolving memory systems are unprecedentedly reshaping the evolutionary paradigm of large language model (LLM)-based agents. Prior work has predominantly relied on manually engineered memory architectures to store trajectories, distill experience, and synthesize reusable tools, enabling agents to evolve on the fly within environment interactions. However, this paradigm is fundamentally constrained by the staticity of the memory system itself: while memory facilitates agent-level evolving, the underlying memory architecture cannot be meta-adapted to diverse task contexts. To address this gap, we propose MemEvolve, a meta-evolutionary framework that jointly evolves agents' experiential knowledge and their memory architecture, allowing agent systems not only to accumulate experience but also to progressively refine how they learn from it. To ground MemEvolve in prior research and foster openness in future self-evolving systems, we introduce EvolveLab, a unified self-evolving memory codebase that distills twelve representative memory systems into a modular design space (encode, store, retrieve, manage), providing both a standardized implementation substrate and a fair experimental arena. Extensive evaluations on four challenging agentic benchmarks demonstrate that MemEvolve achieves (I) substantial performance gains, improving frameworks such as SmolAgent and Flash-Searcher by up to 17.06%; and (II) strong cross-task and cross-LLM generalization, designing memory architectures that transfer effectively across diverse benchmarks and backbone models.

Key facts. Cited by 95 papers in the map (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 50 of its 59 references that are in the map. First posted on arXiv 21 Dec 2025.

Builds on

50 of 59 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Memory in the Age of AI Agents15 Dec
  2. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memory29 Sep
  3. 2025H2R: Hierarchical Hindsight Reflection for Multi-Task LLM Agents16 Sep
  4. 2025Hierarchical Memory for High-Efficiency Long-Term Reasoning in LLM Agents23 Jul
  5. 2025MemEngine: A Unified and Modular Library for Developing Advanced Memory of LLM-based Agents4 May
  6. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memory20 Jan
  7. 2024A Survey on the Memory Mechanism of Large Language Model based Agents21 Apr

Other references · 43

  1. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  2. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  3. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  4. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  5. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
  6. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
  7. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
  8. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
  9. 2025Humanity's Last Examcited by 491
  10. 2024AFlow: Automating Agentic Workflow Generationcited by 432
  11. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
  12. 2024Agent Workflow Memorycited by 383
31 more
  1. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
  2. 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Modelscited by 207
  3. 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 192
  4. 2023Synapse: Trajectory-as-Exemplar Prompting with Memory for Computer Controlcited by 187
  5. 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systemscited by 183
  6. 2025Multi-agent Architecture Search via Agentic Supernetcited by 179
  7. 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
  8. 2025Dynamic Cheatsheet: Test-Time Learning with Adaptive Memorycited by 163
  9. 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecyclecited by 137
  10. 2025Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Taskscited by 131
  11. 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automationcited by 131
  12. 2025xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluationscited by 120
  13. 2025Alita: Generalist Agent Enabling Scalable Agentic Reasoning with Minimal Predefinition and Maximal Self-Evolutioncited by 116
  14. 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?cited by 116
  15. 2023Exchange-of-Thought: Enhancing Large Language Model Capabilities through Cross-Model Communicationcited by 82
  16. 2025PyVision: Agentic Vision with Dynamic Toolingcited by 79
  17. 2025Deep Research: A Survey of Autonomous Research Agentscited by 66
  18. 2025Robin: A multi-agent system for automating scientific discoverycited by 62
  19. 2025ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimizationcited by 56
  20. 2025EvoFlow: Evolving Diverse Agentic Workflows On The Flycited by 55
  21. 2025Training-Free Group Relative Policy Optimizationcited by 55
  22. 2025Huxley-G"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machinecited by 53
  23. 2025TaskCraft: Automated Generation of Agentic Taskscited by 51
  24. 2025Cognitive Kernel-Pro: A Framework for Deep Research Agents and Agent Foundation Models Trainingcited by 42
  25. 2025ChemAgent: Self-updating Library in Large Language Models Improves Chemical Reasoningcited by 41
  26. 2025AgentOrchestra: Orchestrating Multi-Agent Intelligence with the Tool-Environment-Agent(TEA) Protocolcited by 39
  27. 2025AgentDistill: Training-Free Agent Distillation with Generalizable MCP Boxescited by 30
  28. 2025Flash-Searcher: Fast and Effective Web Agents via DAG-Based Parallel Executioncited by 27
  29. 2025Learning on the Job: An Experience-Driven Self-Evolving Agent for Long-Horizon Taskscited by 22
  30. 2025Aime: Towards Fully-Autonomous Multi-Agent Frameworkcited by 9
  31. 2023Recognition, recall, and retention of few-shot memories in large language modelscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 95.

95 papers.

Sort:

By area:

  1. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
  2. 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 278
  3. 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agentscited by 142
  4. 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolvercited by 81
  5. 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 74
  6. 2026MetaClaw: Just Talk -- An Agent That Meta-Learns and Evolves in the Wildcited by 37
  7. 2026Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agentscited by 34
  8. 2026Graph-based Agent Memory: Taxonomy, Techniques, and Applicationscited by 25
  9. 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanismscited by 21
  10. 2026HarnessForge: Joint Harness and Policy Evolution for Adaptive Agent Systemscited by 21
  11. 2026Mem-T: Densifying Rewards for Long-Horizon Memory Agentscited by 18
  12. 2026Learning to Continually Learn via Meta-learning Agentic Memory Designscited by 18
38 more
  1. 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applicationscited by 18
  2. 2026Memory Matters More: Event-Centric Memory as a Logic Map for Agent Searching and Reasoningcited by 17
  3. 2026EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspectivecited by 17
  4. 2026JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolutioncited by 16
  5. 2026LatentMem: Customizing Latent Memory for Multi-Agent Systemscited by 15
  6. 2026SkillGraph: Skill-Augmented Reinforcement Learning for Agents via Evolving Skill Graphscited by 15
  7. 2026EvolveMem:Self-Evolving Memory Architecture via AutoResearch for LLM Agentscited by 15
  8. 2026M^star: Every Task Deserves Its Own Memory Harnesscited by 11
  9. 2026Harnessing Agentic Evolutioncited by 11
  10. 2026From Procedural Skills to Strategy Genes: Towards Experience-Driven Test-Time Evolutioncited by 9
  11. 2026The Meta-Agent Challenge: Are Current Agents Capable of Autonomous Agent Development?cited by 9
  12. 2026Live-Evo: Online Evolution of Agentic Memory from Continuous Feedbackcited by 8
  13. 2026ARC: Active and Reflection-driven Context Management for Long-Horizon Information Seeking Agentscited by 7
  14. 2026Darwinian Memory: A Training-Free Self-Regulating Memory System for GUI Agent Evolutioncited by 7
  15. 2026Memory Intelligence Agentcited by 7
  16. 2026Remember the Decision, Not the Description: A Rate-Distortion Framework for Agent Memorycited by 7
  17. 2026Co-Evolving Skill Generation and Policy Optimizationcited by 7
  18. 2026HyperSkill: Self-Evolving LLM Agents via Hypergraph-Structured Skill Memorycited by 7
  19. 2026Gated Differentiable Working Memory for Long-Context Language Modelingcited by 6
  20. 2026DemoEvolve: Overcoming Sparse Feedback in Agentic Harness Evolution with Demonstrationscited by 6
  21. 2026MemQ: Integrating Q-Learning into Self-Evolving Memory Agents over Provenance DAGscited by 5
  22. 2026SkillMAS: Skill Co-Evolution with LLM-based Multi-Agent Systemcited by 5
  23. 2026AutoMem: Automated Learning of Memory as a Cognitive Skillcited by 5
  24. 2026LazyMem: Retrieve Broadly, Construct Selectively for Efficient Long-Term Agent Memorycited by 5
  25. 2026Ask Only When Needed: Proactive Retrieval from Memory and Skills for Experience-Driven Lifelong Agentscited by 4
  26. 2026Experience Makes Skillful: Enabling Generalizable Medical Agent Reasoning via Self-Evolving Skill Memorycited by 4
  27. 2026Role-Agent: Bootstrapping LLM Agents via Dual-Role Evolutioncited by 4
  28. 2026SkillForge: Evolving Verifiable Skills for Reinforcement Learning Agentscited by 4
  29. 2026Memory Transfer Learning: How Memories are Transferred Across Domains in Coding Agentscited by 3
  30. 2026Training LLM Agents for Spontaneous, Reward-Free Self-Evolution via World Knowledge Explorationcited by 3
  31. 2026FlashEvolve: Accelerating Agent Self-Evolution with Asynchronous Stage Orchestrationcited by 3
  32. 2026Mem-W: Latent Memory-Native GUI Agentscited by 3
  33. 2026PREPING: Zero-Task Agent Memory Construction via Self-Practicecited by 3
  34. 2026Mem-π: Adaptive Memory through Learning When and What to Generatecited by 3
  35. 2026Agent Memory Distillation: Empowering Small LLM Agents with Hierarchical Teacher Memorycited by 3
  36. 2026EcoGym: Evaluating LLMs for Long-Horizon Plan-and-Execute in Interactive Economiescited by 2
  37. 2026Self-Evolving LLM Memory Extraction Across Heterogeneous Taskscited by 2
  38. 2026Ace-Skill: Bootstrapping Multimodal Agents with Prioritized and Clustered Evolutioncited by 2

50 most cited of 95 All 95 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026MemPro: Agentic Memory Systems as Evolvable Programs
  2. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence
  3. 2026MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memory
  4. 2026Mem2Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation
  5. 2025Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolution
  6. 2026Metis: Bridging Text and Code Memory for Self-Evolving Agents
  7. 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents
  8. 2026MetaEvo: A Meta-Optimization Framework for Experience-Driven Agent Evolution