MemPro: Agentic Memory Systems as Evolvable Programs
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
Long-horizon autonomous agents require memory systems to retain historical information, track evolving states, and reuse relevant knowledge beyond finite context windows. Existing agentic memory systems typically follow a memory construction-retrieval (MCR) pipeline, but often adapt mainly the memory bank while keeping the surrounding pipeline fixed after deployment. This fixed-pipeline design struggles to handle heterogeneous task-specific failure modes and can become misaligned with memory banks that evolve in scale and structure over time. To address these limitations, we propose MemPro, a system-level evolution framework that treats the entire MCR pipeline as an evolvable program rather than adapting only the memory bank or prompt text. MemPro maintains a version tree of runnable memory-system implementations, where an Evolving Agent iteratively selects promising versions, diagnoses recurring failures, and creates improved child versions through failure-mode-guided edit-debug refinement. Experiments on LongMemEval, LoCoMo, HotpotQA, and NarrativeQA show that MemPro consistently outperforms strong static and prompt-level evolving baselines within a few iterations, continues to improve with evolution, and achieves a favorable performance-cost trade-off. Code is available at https://github.com/wanghai673/MemPro.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 21 of its 35 references that are in the map. First posted on arXiv 30 May 2026.
Builds on
21 of 35 references.
Closest ancestors · 7
Same direction, newest first
- 2026TiMem: Temporal-Hierarchical Memory Consolidation for Long-Horizon Conversational Agents6 Jan
- 2026SimpleMem: Efficient Lifelong Memory for LLM Agents5 Jan
- 2025Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolution11 Dec
- 2025General Agentic Memory Via Deep Research23 Nov
- 2025A-MEM: Agentic Memory for LLM Agents17 Feb
- 2024A Survey on the Memory Mechanism of Large Language Model based Agents21 Apr
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb
Other references · 14
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2023Large Language Models as Optimizerscited by 830
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 628
- 2017The NarrativeQA Reading Comprehension Challengecited by 590
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025MemEvolve: Meta-Evolution of Agent Memory Systems
- 2025Memp: Exploring Agent Procedural Memory
- 2026Are We Ready For An Agent-Native Memory System?
- 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agents
- 2026EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspective
- 2026MemMA: Coordinating the Memory Cycle through Multi-Agent Reasoning and In-Situ Self-Evolution
- 2026MEMTIER: Tiered Memory Architecture and Retrieval Bottleneck Analysis for Long-Running Autonomous AI Agents
- 2026Memory as Middleware for Self-Improving AI Agents