mlsanityData to 7 Oct 2026

Are We Ready For An Agent-Native Memory System?

arXiv 2606.24775 ↗First posted 23 Jun 2026cs.CL cs.DB cs.IRcited by 11

On the map: Retrieval-augmented generation → Agentic RAG, agents and memory

also in 1 more
Abstract (arXiv)

Memory for large language model (LLM) agents has rapidly evolved from simple retrieval-augmented mechanisms into a data management system that supports persistent information storage, retrieval, update, consolidation, and dynamic lifecycle governance throughout agent execution. Despite this evolution, existing evaluations still benchmark agent memory mainly through end-to-end task success metrics (e.g., F1, BLEU), while treating the underlying system as a monolithic black box. As a result, critical system-level concerns, including operational costs, architectural trade-offs across memory modules, and robustness under dynamic knowledge updates, remain insufficiently explored. In this paper, we present a systematic experimental study of agent memory from a data management perspective. We propose an analytical framework that decomposes agent memory into four core modules: memory representation and storage, extraction, retrieval and routing, and maintenance. Under this framework, we evaluate 12 representative memory systems and two reference baselines across five benchmark workloads spanning 11 datasets. Our extensive end-to-end evaluation shows that no single architecture dominates across all scenarios; instead, effectiveness depends heavily on how well the memory structure aligns with the workload bottleneck. Furthermore, through fine-grained ablation studies, we quantify their individual effects on representation fidelity, retrieval precision, update correctness, and long-horizon stability. Finally, we reveal cost-performance trade-offs under realistic workloads, showing localized maintenance is more cost-efficient than global reorganization. Based on these findings, we identify promising directions towards building truly agent-native memory systems. The code is publicly available at https://github.com/OpenDataBox/MemoryData.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Agentic RAG, agents and memory, one of 15 directions in Retrieval-augmented generation. Builds on 16 of its 36 references that are in the map. First posted on arXiv 23 Jun 2026.

Builds on

16 of 36 references.

References · 16

  1. 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,378
  2. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  3. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
  4. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
  5. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 372
  6. 2025Memory in the Age of AI Agentscited by 285
  7. 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactionscited by 236
  8. 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 235
  9. 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agentscited by 226
  10. 2026SimpleMem: Efficient Lifelong Memory for LLM Agentscited by 140
  11. 2025MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agentscited by 82
  12. 2024From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMscited by 77
4 more
  1. 2026Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontierscited by 60
  2. 2025Supporting Our AI Overlords: Redesigning Data Systems to be Agent-Firstcited by 30
  3. 2026Memory in the LLM Era: Modular Architectures and Strategies in a Unified Frameworkcited by 12
  4. 2026Automating Database-Native Function Code Synthesis with LLMscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 11.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspective
  2. 2026Agent Memory: Characterization and System Implications of Stateful Long-Horizon Workloads
  3. 2026Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitations
  4. 2025Intrinsic Memory Agents: Heterogeneous Multi-Agent LLM Systems through Structured Contextual Memory
  5. 2026Governing Evolving Memory in LLM Agents: Risks, Mechanisms, and the Stability and Safety Governed Memory (SSGM) Framework
  6. 2025A-MEM: Agentic Memory for LLM Agents
  7. 2025Memp: Exploring Agent Procedural Memory
  8. 2026MemForest: An Efficient Agent Memory System with Hierarchical Temporal Indexing