MemMA: Coordinating the Memory Cycle through Multi-Agent Reasoning and In-Situ Self-Evolution
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Memory-augmented LLM agents maintain external memory banks to support long-horizon interaction, yet most existing systems treat construction, retrieval, and utilization as isolated subroutines. This creates two coupled challenges: strategic blindness on the forward path of the memory cycle, where construction and retrieval are driven by local heuristics rather than explicit strategic reasoning, and sparse, delayed supervision on the backward path, where downstream failures rarely translate into direct repairs of the memory bank. To address these challenges, we propose MemMA, a plug-and-play multi-agent framework that coordinates the memory cycle along both the forward and backward paths. On the forward path, a Meta-Thinker produces structured guidance that steers a Memory Manager during construction and directs a Query Reasoner during iterative retrieval. On the backward path, MemMA introduces in-situ self-evolving memory construction, which synthesizes probe QA pairs, verifies the current memory, and converts failures into repair actions before the memory is finalized. Extensive experiments on LoCoMo show that MemMA consistently outperforms existing baselines across multiple LLM backbones and improves three different storage backends in a plug-and-play manner. Our code is publicly available at https://github.com/ventr1c/memma.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 30 of its 37 references that are in the map. First posted on arXiv 19 Mar 2026.
Builds on
30 of 37 references.
Closest ancestors · 4
Same direction, newest first
- 2026How Far Are LLMs from Professional Poker Players? Revisiting Game-Theoretic Reasoning with Agentic Tool Use31 Jan
- 2026MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memory6 Jan
- 2026EverMemOS: A Self-Organizing Memory Operating System for Structured Long-Horizon Reasoning5 Jan
- 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agents18 Jun
Other references · 26
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 634
14 more
- 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 400
- 2025Memory in the Age of AI Agentscited by 303
- 2025LightMem: Lightweight and Efficient Memory-Augmented Generationcited by 180
- 2026SimpleMem: Efficient Lifelong Memory for LLM Agentscited by 149
- 2026Group-Evolving Agents: Open-Ended Self-Improvement via Experience Sharingcited by 36
- 2025O-Mem: Omni Memory System for Personalized, Long Horizon, Self-Evolving Agentscited by 32
- 2025SGMem: Sentence Graph Memory for Long-Term Conversational Agentscited by 29
- 2025Learn to Memorize: Optimizing LLM-based Agents with Adaptive Memory Frameworkcited by 25
- 2025A Comprehensive Survey on Reinforcement Learning-based Agentic Search: Foundations, Roles, Optimizations, Evaluations, and Applicationscited by 22
- 2024Decoding Time Series with LLMs: A Multi-Agent Framework for Cross-Domain Annotationcited by 21
- 2026Position: Agentic Evolution is the Path to Evolving LLMscited by 16
- 2024Images Speak Louder than Words: Understanding and Mitigating Bias in Vision-Language Model from a Causal Mediation Perspectivecited by 13
- 2026MemBuilder: Reinforcing LLMs for Long-Term Memory Construction via Attributed Dense Rewardscited by 13
- 2025Memoria: A Scalable Agentic Memory Framework for Personalized Conversational AIcited by 12
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agentscited by 34
- 2026Evolving Agents in the Dark: Retrospective Harness Optimization via Self-Preferencecited by 19
- 2026Experience Compression Spectrum: Unifying Memory, Skills, and Rules in LLM Agentscited by 17
- 2026From Question Answering to Task Completion: A Survey on Agent System and Harness Designcited by 12
- 2026Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspectivecited by 4
- 2026Memory Reward Inflation in Self-Improving LLM Agentscited by 3
- 2026Biological Motifs for Agentic Controlcited by 0
- 2026A Symbolic Neural CPU for Quantization-Simulated Writeback and Interpretable Program Executioncited by 0
- 2026ABot-AgentOS: A General Robotic Agent OS with Lifelong Multi-modal Memorycited by 0
- 2026Trojaning the Alignment: Stealthy Backdoor Attacks against Graph Foundation Modelscited by 0
- 2026CreaMem: A Scene-Aware Memory Architecture for Personalized Agentscited by 0
- 2026MemCodex: Self-Programming Hierarchical Memory for Language Agentscited by 0
- 2026MemCodex: Self-Programming Hierarchical Memory for Language Agents30 Sep 2026
- 2026CreaMem: A Scene-Aware Memory Architecture for Personalized Agents8 Sep 2026
- 2026Trojaning the Alignment: Stealthy Backdoor Attacks against Graph Foundation Models21 Aug 2026
- 2026ABot-AgentOS: A General Robotic Agent OS with Lifelong Multi-modal Memory11 Jul 2026
- 2026A Symbolic Neural CPU for Quantization-Simulated Writeback and Interpretable Program Execution10 Jul 2026
- 2026Biological Motifs for Agentic Control5 Jul 2026
- 2026Memory Reward Inflation in Self-Improving LLM Agents29 Jun 2026
- 2026From Question Answering to Task Completion: A Survey on Agent System and Harness Design14 Jun 2026
- 2026Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspective10 Jun 2026
- 2026Evolving Agents in the Dark: Retrospective Harness Optimization via Self-Preference4 Jun 2026
- 2026Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents28 May 2026
- 2026Experience Compression Spectrum: Unifying Memory, Skills, and Rules in LLM Agents17 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Agent Memory: Characterization and System Implications of Stateful Long-Horizon Workloads
- 2026Remember Before You're Asked: MemDream for Self-Probing Memory Evolution
- 2026AMA: Adaptive Memory via Multi-Agent Collaboration
- 2026MemGym: a Long-Horizon Memory Environment for LLM Agents
- 2026Memory is Reconstructed, Not Retrieved: Graph Memory for LLM Agents
- 2026EvolveMem:Self-Evolving Memory Architecture via AutoResearch for LLM Agents
- 2026MemAgent: Learning to Manage Heterogeneous Memory Providers for LLM Agents
- 2026MemForest: An Efficient Agent Memory System with Hierarchical Temporal Indexing