Are We Ready For An Agent-Native Memory System?
On the map: Retrieval-augmented generation → Agentic RAG, agents and memory
also in 1 more
Abstract (arXiv)
Memory for large language model (LLM) agents has rapidly evolved from simple retrieval-augmented mechanisms into a data management system that supports persistent information storage, retrieval, update, consolidation, and dynamic lifecycle governance throughout agent execution. Despite this evolution, existing evaluations still benchmark agent memory mainly through end-to-end task success metrics (e.g., F1, BLEU), while treating the underlying system as a monolithic black box. As a result, critical system-level concerns, including operational costs, architectural trade-offs across memory modules, and robustness under dynamic knowledge updates, remain insufficiently explored. In this paper, we present a systematic experimental study of agent memory from a data management perspective. We propose an analytical framework that decomposes agent memory into four core modules: memory representation and storage, extraction, retrieval and routing, and maintenance. Under this framework, we evaluate 12 representative memory systems and two reference baselines across five benchmark workloads spanning 11 datasets. Our extensive end-to-end evaluation shows that no single architecture dominates across all scenarios; instead, effectiveness depends heavily on how well the memory structure aligns with the workload bottleneck. Furthermore, through fine-grained ablation studies, we quantify their individual effects on representation fidelity, retrieval precision, update correctness, and long-horizon stability. Finally, we reveal cost-performance trade-offs under realistic workloads, showing localized maintenance is more cost-efficient than global reorganization. Based on these findings, we identify promising directions towards building truly agent-native memory systems. The code is publicly available at https://github.com/OpenDataBox/MemoryData.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Agentic RAG, agents and memory, one of 15 directions in Retrieval-augmented generation. Builds on 16 of its 36 references that are in the map. First posted on arXiv 23 Jun 2026.
Builds on
16 of 36 references.
References · 16
- 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,378
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
- 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
- 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 372
- 2025Memory in the Age of AI Agentscited by 285
- 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactionscited by 236
- 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 235
- 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agentscited by 226
- 2026SimpleMem: Efficient Lifelong Memory for LLM Agentscited by 140
- 2025MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agentscited by 82
- 2024From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMscited by 77
4 more
- 2026Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontierscited by 60
- 2025Supporting Our AI Overlords: Redesigning Data Systems to be Agent-Firstcited by 30
- 2026Memory in the LLM Era: Modular Architectures and Strategies in a Unified Frameworkcited by 12
- 2026Automating Database-Native Function Code Synthesis with LLMscited by 2
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 6
- 2026A-TMA: Decoupling State-Aware Memory Failures in Long-Term Agent Memorycited by 3
- 2026AttriMem: Attribution-Guided Process Feedback for Agent Memory Constructioncited by 3
- 2026LightMem-Ego: Your AI Memory for Everyday Lifecited by 2
- 2026The Retriever Should Remember: Experience-Amortized Reranking for Long-Term Agent Memorycited by 2
- 2026Why Git Is the Memory Solution for the Agentic Development Lifecyclecited by 0
- 2026Delivery, Not Storage: Cue-Anchored Working Memory as a Harness Property for Coding Agentscited by 0
- 2026Ground Truth First: A Longitudinal Evaluation Instrument for Agent Memory, and the Tenure Crossover in Memory-Architecture Rankingscited by 0
- 2026Vestrum: Improving Agent Harnesses by Adapting Their Verification, Structure and Memorycited by 0
- 2026MemCodex: Self-Programming Hierarchical Memory for Language Agentscited by 0
- 2026Stale, Misattributed, or Late: Where Personal Memory Fails Before Generationcited by 0
- 2026Stale, Misattributed, or Late: Where Personal Memory Fails Before Generation7 Oct 2026
- 2026MemCodex: Self-Programming Hierarchical Memory for Language Agents30 Sep 2026
- 2026Vestrum: Improving Agent Harnesses by Adapting Their Verification, Structure and Memory27 Sep 2026
- 2026The Retriever Should Remember: Experience-Amortized Reranking for Long-Term Agent Memory24 Aug 2026
- 2026Ground Truth First: A Longitudinal Evaluation Instrument for Agent Memory, and the Tenure Crossover in Memory-Architecture Rankings24 Jul 2026
- 2026AttriMem: Attribution-Guided Process Feedback for Agent Memory Construction23 Jul 2026
- 2026Delivery, Not Storage: Cue-Anchored Working Memory as a Harness Property for Coding Agents23 Jul 2026
- 2026Why Git Is the Memory Solution for the Agentic Development Lifecycle15 Jul 2026
- 2026LightMem-Ego: Your AI Memory for Everyday Life13 Jul 2026
- 2026A-TMA: Decoupling State-Aware Memory Failures in Long-Term Agent Memory2 Jul 2026
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap29 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspective
- 2026Agent Memory: Characterization and System Implications of Stateful Long-Horizon Workloads
- 2026Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitations
- 2025Intrinsic Memory Agents: Heterogeneous Multi-Agent LLM Systems through Structured Contextual Memory
- 2026Governing Evolving Memory in LLM Agents: Risks, Mechanisms, and the Stability and Safety Governed Memory (SSGM) Framework
- 2025A-MEM: Agentic Memory for LLM Agents
- 2025Memp: Exploring Agent Procedural Memory
- 2026MemForest: An Efficient Agent Memory System with Hierarchical Temporal Indexing