mlsanityData to 7 Oct 2026

MemoryLake on MemoryArena: A Matched Study of Agent Memory Backends

arXiv 2608.13883 ↗First posted 14 Aug 2026cs.AIcited by 0

On the map: LLM agents and tool use → Agent memory systems

Abstract (arXiv)

Most agent-memory benchmarks test post-hoc recall, whereas MemoryArena evaluates whether memory supports interdependent, multi-session task completion. We compare MemoryLake, a structured multi-track memory backend, with Mem0, text-embedding-3-small vector RAG, and a long-context control across all five MemoryArena domains. The systems share the same agent framework, requested gpt-5-mini model alias, task samples, and scoring code; the memory integration is the intentionally changed component. Because each backend bundles write, retrieval, consolidation, budgeting, and prompt-assembly choices, the study is a matched system-level comparison, not a representation-only ablation or a cost-matched experiment. On the shared evaluation sets, MemoryLake has the highest observed success rate (SR) in mathematics (9/40), physics (12/20), and progressive retrieval (4/20). Every system has zero SR in travel planning, and web shopping yields a single bundle-level success (long context, 1/150); MemoryLake ranks third on both the travel soft process score and shopping step match. Following MemoryArena's suite-level convention, a post-hoc equal-weight average over the five SRs is 20.5% for MemoryLake versus 13.6% for the best comparator. These are point estimates: sample sizes are modest, confidence intervals overlap, and we do not report paired significance tests. A separate MemoryLake-only run over all 221 progressive queries yields a failure-counted SR of 26.7% (59/221) and is not a baseline comparison. The results support a workload-dependent view of memory backends and an observed lead among the four evaluated systems on the shared sets; they do not establish benchmark-wide state of the art or a causal advantage of representation structure.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 15 of its 17 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

15 of 17 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks18 Feb
  2. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memory29 Sep
  3. 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions7 Jul
  4. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory28 Apr
  5. 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb

Other references · 10

  1. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  2. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  3. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
  4. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  5. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
  6. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
  7. 2024MemoRAG: Boosting Long Context Processing with Global Memory-Enhanced Retrieval Augmentationcited by 118
  8. 2025MemoryBench: A Benchmark for Memory and Continual Learning in LLM Systemscited by 56
  9. 2026Remember the Decision, Not the Description: A Rate-Distortion Framework for Agent Memorycited by 6
  10. 2026From Memory to Skills: Evidence-Grounded Co-Evolution Governance for Long-Horizon LLM Agentscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Memora: A Harmonic Memory Representation Balancing Abstraction and Specificity
  2. 2026Evaluating Memory Structure in LLM Agents
  3. 2026Agent Memory Distillation: Empowering Small LLM Agents with Hierarchical Teacher Memory
  4. 2026memorywire: A Vendor-Neutral Wire Format for Agent Memory Operations
  5. 2026Exploring Cross-Scenario Generality of Agentic Memory Systems: Diagnostics and a Strong Baseline
  6. 2026From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agents
  7. 2026Harness the Memory: A Holistic Evaluation of Memory Substrates in Memory Agents
  8. 2026Diagnosing Retrieval vs. Utilization Bottlenecks in LLM Agent Memory