Towards a Formal Definition of Agent Memory: Basis, Span, Optimality, and the Sequential Memory Problem
Not on the map. Why?
Abstract (arXiv)
Despite the wide deployment of memory in large-model agents, there is no unified formal account of what a memory is or when it is optimal. This paper takes a first step toward this account. The central idea is that memory is a basis, knowledge is its span, and answerability is a coverage problem: an agent stores events extracted from a material; a generation operator turns any event set into the knowledge it entails; and a query is answerable exactly when some single item in the span covers it. The optimal memory is then the capacity-constrained maximizer of expected coverage, and its value traces a utility--capacity frontier, the common yardstick on which memory systems can be compared. Next, we consider noise in the memory and discuss coverage versus precision under it: a memory may store false claims, so the write policy must infer the truth of what it stores. Drawing an analogy with biological memory, which is formed continuously through ongoing experience, we formalize the continual agent-memory problem in a sequential MDP that covers multiple levels, where memory is the state, writing is the action, and the utility settled at query time is the delayed reward that drives learning. To make the framework concrete, we instantiate it on Homer's Odyssey, turning the frontier, the compression zone, and the divergence of coverage from precision into concrete numbers. Finally, we position existing systems within the framework, making ``how good is a memory'' measurable and recasting the open problems of constructing and learning agent memory as concrete research questions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 33 references that are in the map. First posted on arXiv 12 Aug 2026.
Builds on
28 of 33 references.
References · 28
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,417
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
- 2024Titans: Learning to Memorize at Test Timecited by 328
- 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 281
16 more
- 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactionscited by 254
- 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 246
- 2025Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learningcited by 237
- 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 231
- 2025MemOS: A Memory OS for AI Systemcited by 138
- 2023Walking Down the Memory Maze: Beyond Context Limit through Interactive Readingcited by 133
- 2024MEMORYLLM: Towards Self-Updatable Large Language Modelscited by 93
- 2026MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Taskscited by 84
- 2026Mem-Gallery: Benchmarking Multimodal Long-Term Conversational Memory for MLLM Agentscited by 54
- 2026AMA-Bench: Evaluating Long-Horizon Memory for Agentic Applicationscited by 53
- 2024Memory3: Language Modeling with Explicit Memorycited by 40
- 2025Look Back to Reason Forward: Revisitable Memory for Long-Context LLM Agentscited by 38
- 2025Rethinking Memory in LLM based Agents: Representations, Operations, and Emerging Topicscited by 36
- 2026Mem2ActBench: A Benchmark for Evaluating Long-Term Memory Utilization in Task-Oriented Autonomous Agentscited by 32
- 2024DialSim: A Dialogue Simulator for Evaluating Long-Term Multi-Party Dialogue Understanding of Conversational Agentscited by 20
- 2025Evaluating Long-Term Memory for Long-Context Question Answeringcited by 8
Built on by
Not cited yet.