Membox: Weaving Topic Continuity into Long-Range Memory for LLM Agents
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
Long-term human-agent dialogues are organized by topic continuity: adjacent turns often develop the same goal, plan, problem, or event, while related activities may recur across distant sessions. Yet many LLM agent memory systems first decompose histories into isolated turns or fixed-size chunks, then compensate through enrichment, consolidation, or retrieval mechanisms still tied to semantic proximity or fragment-level records. This weakens temporal and causal organization and biases memory access toward semantic proximity rather than task- or topic-level continuity. We introduce Membox, a hierarchical memory architecture that instantiates topic continuity as an explicit organization layer for agent memory. Its Topic Loom incrementally organizes dialogue streams into boxes whose internal turns follow the same local topic, while its Trace Weaver links extracted events across boxes into macro-topic traces that recover recurring activities, goals, and factual developments across distant sessions. On LoCoMo, Topic-Loom-only retrieval improves over the best Mem0/A-MEM retrieval-depth setting by 13.00 F1 points (53.95 vs. 40.95), and trace-expanded retrieval further raises F1 to 55.28; with GPT-4o, trace-expanded retrieval reaches 59.71 F1. Additional DialSim results show the same gain from adding cross-box traces in multi-party dialogue. These results show that local topic-continuity organization and macro-topic trace expansion improve long-range memory beyond semantic retrieval over fragmented records.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 20 of its 37 references that are in the map. First posted on arXiv 7 Jan 2026.
Builds on
20 of 37 references.
Closest ancestors · 3
Same direction, newest first
- 2025A-MEM: Agentic Memory for LLM Agents17 Feb
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb
- 2024A Human-Inspired Reading Agent with Gist Memory of Very Long Contexts15 Feb
Other references · 17
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 235
- 2023Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answeringcited by 119
- 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graphcited by 100
- 2023SCM: Enhancing Large Language Model with Self-Controlled Memory Frameworkcited by 98
- 2019ConveRT: Efficient and Accurate Conversational Representations from Transformerscited by 95
- 2024Plan-on-Graph: Self-Correcting Adaptive Planning of Large Language Model on Knowledge Graphscited by 77
- 2018Text Segmentation as a Supervised Learning Taskcited by 76
- 2020Text Segmentation by Cross Segment Attentioncited by 54
5 more
- 2019SECTOR: A Neural Model for Coherent Topic Segmentation and Classificationcited by 48
- 2024DialSim: A Dialogue Simulator for Evaluating Long-Term Multi-Party Dialogue Understanding of Conversational Agentscited by 19
- 2025Knowledge Graph-extended Retrieval Augmented Generation for Question Answeringcited by 14
- 2023SuperDialseg: A Large-scale Dataset for Supervised Dialogue Segmentationcited by 10
- 2025Guided Navigation in Knowledge-Dense Environments: Structured Semantic Exploration with Guidance Graphscited by 1
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitationscited by 20
- 2026Query-focused and Memory-aware Reranker for Long Context Processingcited by 6
- 2026SwiftMem: Fast Agentic Memory via Query-aware Indexingcited by 4
- 2026GRAVITY: Architecture-Agnostic Structured Anchoring for Long-Horizon Conversational Memorycited by 2
- 2026MemChain: Learning Interpretable Memory Traces for Memory-Augmented LLM Agentscited by 1
- 2026EvalMem: An Operation-Level Diagnostic Framework for Long-Term Memory Systemscited by 0
- 2026EvalMem: An Operation-Level Diagnostic Framework for Long-Term Memory Systems3 Sep 2026
- 2026MemChain: Learning Interpretable Memory Traces for Memory-Augmented LLM Agents27 Jul 2026
- 2026GRAVITY: Architecture-Agnostic Structured Anchoring for Long-Horizon Conversational Memory3 May 2026
- 2026Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitations22 Feb 2026
- 2026Query-focused and Memory-aware Reranker for Long Context Processing12 Feb 2026
- 2026SwiftMem: Fast Agentic Memory via Query-aware Indexing13 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026HiMem: Hierarchical Long-Term Memory for LLM Long-Horizon Agents
- 2026Temporal Order Matters for Agentic Memory: Segment Trees for Long-Horizon Agents
- 2026Beyond Dialogue Time: Temporal Semantic Memory for Personalized LLM Agents
- 2026GAM: Hierarchical Graph-based Agentic Memory for LLM Agents
- 2025A Simple Yet Strong Baseline for Long-Term Conversational Memory of LLM Agents
- 2025Hindsight is 20/20: Building Agent Memory that Retains, Recalls, and Reflects
- 2026AdaMem: Adaptive User-Centric Memory for Long-Horizon Dialogue Agents
- 2025Hierarchical Memory for High-Efficiency Long-Term Reasoning in LLM Agents