mlsanityData to 14 Oct 2026

MemForest: An Efficient Agent Memory System with Hierarchical Temporal Indexing

arXiv 2605.23986 ↗First posted 16 May 2026cs.DB cs.AI cs.MAcited by 3

On the map: LLM agents and tool use → Agent memory systems

Abstract (arXiv)

Memory is a fundamental component for long-context LLM agents, supporting persistent state across interactions through a continuous serve-and-update lifecycle. Despite substantial prior work, many stateful systems retain sequential autoregressive extraction or state-dependent maintenance on the write path, delaying when new evidence becomes queryable. To address these challenges, we present MemForest, a memory framework that reformulates agent memory as a write-efficient temporal data-management problem. MemForest breaks the sequential bottleneck via parallel extraction, decoupling memory construction into concurrent, independent operations. We further introduce MemTree, a hierarchical temporal index that organizes memory as time-ordered trees and replaces global rewrites with localized dirty-path refresh. Dirty summaries can be refreshed in parallel across nodes and trees. End-to-end work remains proportional to incoming content; the logarithmic bound applies only to structural insertion and level-dependent refresh depth in balanced trees. We evaluate MemForest on two long-context benchmarks, LongMemEval-S and LoCoMo. Experiments use Qwen3-4B, Qwen3-30B, and Gemma-4-12B-IT. With Qwen3-30B, MemForest reaches 81.8 percent pass at 1 on LongMemEval-S, while its input-normalized build rate is 6.0 times that of EverMemOS. On LoCoMo categories 1 to 4, it reaches 84.09 percent, within 0.13 percentage points of EverMemOS; on a matched conversation, its build rate is 9.5 times higher. These results show that MemForest reduces memory-freshness latency while retaining strong answer quality.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 20 of its 40 references that are in the map. First posted on arXiv 16 May 2026.

Builds on

20 of 40 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026Choosing How to Remember: Adaptive Memory Structures for LLM Agents15 Feb
  2. 2026HiMem: Hierarchical Long-Term Memory for LLM Long-Horizon Agents10 Jan
  3. 2025In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agents11 Mar
  4. 2025A-MEM: Agentic Memory for LLM Agents17 Feb
  5. 2025TReMu: Towards Neuro-Symbolic Temporal Reasoning for LLM-Agents with Memory in Multi-Session Dialogues3 Feb
  6. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memory20 Jan
  7. 2024A Survey on the Memory Mechanism of Large Language Model based Agents21 Apr

Other references · 13

  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  2. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  3. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  4. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  5. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
  6. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
  7. 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compressioncited by 348
  8. 2025LightMem: Lightweight and Efficient Memory-Augmented Generationcited by 180
  9. 2025On Memory Construction and Retrieval for Personalized Conversational Agentscited by 105
  10. 2024From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMscited by 79
  11. 2026EverMemOS: A Self-Organizing Memory Operating System for Structured Long-Horizon Reasoningcited by 54
  12. 2025Cache-Craft: Managing Chunk-Caches for Efficient Retrieval-Augmented Generationcited by 36
1 more
  1. 2025Decentralizing AI Memory: SHIMI, a Semantic Hierarchical Memory Index for Scalable Agent Reasoningcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Are We Ready For An Agent-Native Memory System?
  2. 2026MemGym: a Long-Horizon Memory Environment for LLM Agents
  3. 2026All-Mem: Agentic Lifelong Memory via Dynamic Topology Evolution
  4. 2026MemLens: A Value-Aware Memory Management System with Interactive Analytics for LLM-based Agents
  5. 2026SwiftMem: Fast Agentic Memory via Query-aware Indexing
  6. 2026Akashic: A Low-Overhead LLM Inference Service with MemAttention
  7. 2026Beyond Semantic Organization: Memory as Execution State Management for Long-Horizon Agents
  8. 2026Agent Memory: Characterization and System Implications of Stateful Long-Horizon Workloads