VitaBench: Memory Lifecycles Beyond Retrieval
Not on the map. Why?
Abstract (arXiv)
Long-term memory benchmarks for language agents primarily evaluate whether information from earlier interactions can be retrieved and used when relevant. Persistent memory systems face an additional problem before future use is known: deciding whether a memory should remain exact, be compressed, consolidated, or deleted. Existing benchmarks capture long-range retrieval, temporal reasoning, evidence reuse, and incremental interaction, but do not directly evaluate these earlier representation decisions. We formalize memory lifecycle evaluation and introduce VitaBench, a benchmark that makes lifecycle decisions measurable through repeated memory reviews and full-horizon counterfactual evaluation. VitaBench contains a controlled Diagnostic tier that isolates future-use patterns and a Naturalistic tier that composes them into generated customer-service-style interaction streams. We characterize lifecycle decision structure with three diagnostics: lifecycle headroom, measuring the advantage of adaptive choices over the best fixed strategy; horizon reversal, measuring when short-horizon decisions change under delayed consequences; and optimal-action diversity, measuring whether different memory states favor different lifecycle operations. Across both tiers, VitaBench exhibits substantial lifecycle structure: lifecycle headroom is 1.364 in Diagnostic and 1.405 in Naturalistic, and 60.2% and 56.5% of states, respectively, change their preferred action between short and full horizons. A learned delayed lifecycle policy further improves over the best fixed strategy on VitaBench-Naturalistic, reaching 101.5 versus 83.4 joint utility. These results show that retrieving past information and deciding how it should persist are distinct evaluation problems, and that lifecycle management requires evaluation of the delayed consequences of representation decisions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 24 references that are in the map. First posted on arXiv 10 Oct 2026.
Builds on
22 of 24 references.
References · 22
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactionscited by 254
- 2025Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learningcited by 237
- 2026MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Taskscited by 84
- 2026Agentic Memory: Learning Unified Long-Term and Short-Term Memory Management for Large Language Model Agentscited by 78
- 2025MemOS: An Operating System for Memory-Augmented Generation (MAG) in Large Language Modelscited by 73
- 2025Hierarchical Memory for High-Efficiency Long-Term Reasoning in LLM Agentscited by 62
- 2026LongMemEval-V2: Evaluating Long-Term Agent Memory Toward Experienced Colleaguescited by 23
- 2026Useful Memories Become Faulty When Continuously Updated by LLMscited by 20
- 2026Locomo-Plus: Beyond-Factual Cognitive Memory Evaluation Framework for LLM Agentscited by 19
10 more
- 2026The Pensieve Paradigm: Stateful Language Models Mastering Their Own Contextcited by 9
- 2026Dynamic Long Context Reasoning over Compressed Memory via End-to-End Reinforcement Learningcited by 8
- 2026RecMem: Recurrence-based Memory Consolidation for Efficient and Effective Long-Running LLM Agentscited by 8
- 2026From Faulty Memories to Corrected Actions: Dependency-Guided Rollback Repair for Memory-Augmented Agentscited by 8
- 2026MemRefine: LLM-Guided Compression for Long-Term Agent Memorycited by 7
- 2026MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversationscited by 7
- 2026Memory as a Controlled Process: Learned Adaptive Memory Management for LLM Agentscited by 7
- 2026TEPA: Revoking Stale Memories for Conflict-Robust Language Agentscited by 5
- 2026Retain or Consolidate? Budget-Dependent Operator Selection for Language Agent Memorycited by 3
- 2026ContextPilot: Teaching Agents for Proactive Context Management via Fine-grained RLcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactions
- 2026EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspective
- 2026From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agents
- 2026LifeFuse-Mem: Lifecycle-Aware State Fusion Against Temporary Overwriting for Long-Term Memory
- 2026MemArbiter: Decision-Time Memory Arbitration for Long-Horizon LLM Agents
- 2026AMA-Bench: Evaluating Long-Horizon Memory for Agentic Applications
- 2026Mem2ActBench: A Benchmark for Evaluating Long-Term Memory Utilization in Task-Oriented Autonomous Agents
- 2026Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitations