Agent Memory: Characterization and System Implications of Stateful Long-Horizon Workloads
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
LLM agents are increasingly deployed on long-horizon tasks requiring sustained reasoning over extended interaction histories. Realizing this at scale requires agents to persistently store, retrieve, and update their own memory across sessions. A rich ecosystem of agent memory systems has emerged spanning flat retrieval, LLM-mediated extraction, consolidating fact stores, and agentic control flows. Yet, their system-level behavior remains uncharacterized. We present the first systems characterization of agent memory. First, we introduce a system-oriented taxonomy classifying agent memory systems along four axes. Second, we build a phase-aware profiling harness attributing cost to construction, retrieval, and generation. Third, we characterize ten representative systems across two benchmark suites, uncovering how design choices shift cost across the write and read paths. Finally, we derive 10 system recommendations covering construction scheduling, capability floors, amortization via query volume, freshness-latency tradeoffs, and fleet-scale management.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 26 of its 31 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
26 of 31 references.
Closest ancestors · 9
Same direction, newest first
- 2026MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks18 Feb
- 2026SimpleMem: Efficient Lifelong Memory for LLM Agents5 Jan
- 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memory25 Nov
- 2025MIRIX: Multi-Agent Memory System for LLM-Based Agents10 Jul
- 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions7 Jul
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory28 Apr
- 2025A-MEM: Agentic Memory for LLM Agents17 Feb
- 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memory20 Jan
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb
Other references · 17
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
5 more
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
- 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 231
- 2022FP8 Formats for Deep Learningcited by 196
- 2025Intelligence per Watt: Measuring Intelligence Efficiency of Local AIcited by 14
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026OneDayAgent: Towards a Long-Horizon Harness for Autonomous Agentscited by 4
- 2026Measure Before You Manage: Evaluating Agent Working Memory in Coding Agentscited by 1
- 2026Retrieved but Not Delivered: Multimodal Memory Delivery for Long-Term Agentscited by 1
- 2026Memory as a Wasting Asset: Pricing Flash Endurance for Embodied Agents, and the Limits of Doing Socited by 0
- 2026Memory in the Loop: In-Process Retrieval as Extended Working Memory for Language Agentscited by 0
- 2026LAM: Efficient Lossy Agent Memory Framework With A Retrieval-Score Error Boundcited by 0
- 2026MemoWM: How World Models Change What Agents Need to Remembercited by 0
- 2026MemoWM: How World Models Change What Agents Need to Remember7 Oct 2026
- 2026Retrieved but Not Delivered: Multimodal Memory Delivery for Long-Term Agents26 Sep 2026
- 2026LAM: Efficient Lossy Agent Memory Framework With A Retrieval-Score Error Bound26 Sep 2026
- 2026Measure Before You Manage: Evaluating Agent Working Memory in Coding Agents31 Aug 2026
- 2026OneDayAgent: Towards a Long-Horizon Harness for Autonomous Agents4 Aug 2026
- 2026Memory in the Loop: In-Process Retrieval as Extended Working Memory for Language Agents6 Jul 2026
- 2026Memory as a Wasting Asset: Pricing Flash Endurance for Embodied Agents, and the Limits of Doing So16 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Are We Ready For An Agent-Native Memory System?
- 2026Filesystem-Based Memory for LLM Agents: Organization, Evolution, and Sustainability
- 2026Exploring Cross-Scenario Generality of Agentic Memory Systems: Diagnostics and a Strong Baseline
- 2026MemMA: Coordinating the Memory Cycle through Multi-Agent Reasoning and In-Situ Self-Evolution
- 2026Beyond Semantic Organization: Memory as Execution State Management for Long-Horizon Agents
- 2026EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspective
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms
- 2026The Epistemics of Agent Memory: Measuring, and Governing, the Consolidation Decision in Long-Horizon LLM Agents