mlsanityData to 14 Oct 2026

Agent Memory: Characterization and System Implications of Stateful Long-Horizon Workloads

arXiv 2606.06448 ↗First posted 4 Jun 2026cs.AIcited by 7

On the map: LLM agents and tool use → Agent memory systems

Abstract (arXiv)

LLM agents are increasingly deployed on long-horizon tasks requiring sustained reasoning over extended interaction histories. Realizing this at scale requires agents to persistently store, retrieve, and update their own memory across sessions. A rich ecosystem of agent memory systems has emerged spanning flat retrieval, LLM-mediated extraction, consolidating fact stores, and agentic control flows. Yet, their system-level behavior remains uncharacterized. We present the first systems characterization of agent memory. First, we introduce a system-oriented taxonomy classifying agent memory systems along four axes. Second, we build a phase-aware profiling harness attributing cost to construction, retrieval, and generation. Third, we characterize ten representative systems across two benchmark suites, uncovering how design choices shift cost across the write and read paths. Finally, we derive 10 system recommendations covering construction scheduling, capability floors, amortization via query volume, freshness-latency tradeoffs, and fleet-scale management.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 26 of its 31 references that are in the map. First posted on arXiv 4 Jun 2026.

Builds on

26 of 31 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks18 Feb
  2. 2026SimpleMem: Efficient Lifelong Memory for LLM Agents5 Jan
  3. 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memory25 Nov
  4. 2025MIRIX: Multi-Agent Memory System for LLM-Based Agents10 Jul
  5. 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions7 Jul
  6. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory28 Apr
  7. 2025A-MEM: Agentic Memory for LLM Agents17 Feb
  8. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memory20 Jan
  9. 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb

Other references · 17

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  5. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  6. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  7. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  8. 2017Billion-scale similarity search with GPUscited by 2,497
  9. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  10. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  11. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  12. 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
5 more
  1. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
  2. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
  3. 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 231
  4. 2022FP8 Formats for Deep Learningcited by 196
  5. 2025Intelligence per Watt: Measuring Intelligence Efficiency of Local AIcited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Are We Ready For An Agent-Native Memory System?
  2. 2026Filesystem-Based Memory for LLM Agents: Organization, Evolution, and Sustainability
  3. 2026Exploring Cross-Scenario Generality of Agentic Memory Systems: Diagnostics and a Strong Baseline
  4. 2026MemMA: Coordinating the Memory Cycle through Multi-Agent Reasoning and In-Situ Self-Evolution
  5. 2026Beyond Semantic Organization: Memory as Execution State Management for Long-Horizon Agents
  6. 2026EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspective
  7. 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms
  8. 2026The Epistemics of Agent Memory: Measuring, and Governing, the Consolidation Decision in Long-Horizon LLM Agents