mlsanityData to 7 Oct 2026

From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMs

arXiv 2410.14052 ↗First posted 17 Oct 2024cs.CL cs.AI cs.LGcited by 77

Not on the map. Why?

Cited by 52 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Recent advancements in large language models have significantly improved their context windows, yet challenges in effective long-term memory management remain. We introduce MemTree, an algorithm that leverages a dynamic, tree-structured memory representation to optimize the organization, retrieval, and integration of information, akin to human cognitive schemas. MemTree organizes memory hierarchically, with each node encapsulating aggregated textual content, corresponding semantic embeddings, and varying abstraction levels across the tree's depths. Our algorithm dynamically adapts this memory structure by computing and comparing semantic embeddings of new and existing information to enrich the model's context-awareness. This approach allows MemTree to handle complex reasoning and extended interactions more effectively than traditional memory augmentation methods, which often rely on flat lookup tables. Evaluations on benchmarks for multi-turn dialogue understanding and document question answering show that MemTree significantly enhances performance in scenarios that demand structured memory management.

Key facts. Cited by 77 papers in the map (data through 7 Oct 2026). Builds on 30 of its 43 references that are in the map. First posted on arXiv 17 Oct 2024.

Builds on

30 of 43 references.

References · 30

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  3. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  4. 2020Longformer: The Long-Document Transformercited by 3,362
  5. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  6. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
  7. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  8. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
  9. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
  10. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
  11. 2022Memory-Based Model Editing at Scalecited by 443
  12. 2014Memory Networkscited by 354
18 more
  1. 2024LongRoPE: Extending LLM Context Window Beyond 2 Million Tokenscited by 302
  2. 2023Improving Text Embeddings with Large Language Modelscited by 295
  3. 2023LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Modelscited by 279
  4. 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 266
  5. 2024MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queriescited by 253
  6. 2023LongLoRA: Efficient Fine-tuning of Long-Context Large Language Modelscited by 243
  7. 2021QuALITY: Question Answering with Long Input Texts, Yes!cited by 204
  8. 2023Focused Transformer: Contrastive Training for Context Scalingcited by 133
  9. 2023Lift Yourself Up: Retrieval-augmented Text Generation with Self Memorycited by 103
  10. 2024AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agentscited by 100
  11. 2023Scaling Transformer to 1M tokens and beyond with RMTcited by 97
  12. 2021Do Long-Range Language Models Actually Use Long-Range Context?cited by 92
  13. 2023RET-LLM: Towards a General Read-Write Memory for Large Language Modelscited by 64
  14. 2023Integrating Large Language Model for Improved Causal Discoverycited by 54
  15. 2023Enhancing Knowledge Graph Construction Using Large Language Modelscited by 44
  16. 2023Exploring Large Language Models for Knowledge Graph Completioncited by 43
  17. 2024In Search of Needles in a 11M Haystack: Recurrent Memory Finds What LLMs Misscited by 36
  18. 2019Online Hierarchical Clustering Approximationscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 14; 2026: 63.

77 papers.

Sort:

By area:

  1. 2025LightMem: Lightweight and Efficient Memory-Augmented Generationcited by 163
  2. 2025Collaborative Memory: Multi-User Memory Sharing in LLM Agents with Dynamic Access Controlcited by 56
  3. 2025Mem-α: Learning Memory Construction via Reinforcement Learningcited by 49
  4. 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agentscited by 47
  5. 2026Skill-Pro: Learning Reusable Skills from Experience via Non-Parametric PPO for LLM Agentscited by 44
  6. 2026Mem2ActBench: A Benchmark for Evaluating Long-Term Memory Utilization in Task-Oriented Autonomous Agentscited by 30
  7. 2025From Single to Multi-Granularity: Toward Long-Term Memory Association and Selection of Conversational Agentscited by 27
  8. 2026TiMem: Temporal-Hierarchical Memory Consolidation for Long-Horizon Conversational Agentscited by 26
  9. 2025Learn to Memorize: Optimizing LLM-based Agents with Adaptive Memory Frameworkcited by 25
  10. 2025CAM: A Constructivist View of Agentic Memory for LLM-Based Reading Comprehensioncited by 23
  11. 2025Adaptation of Agentic AI: A Survey of Post-Training, Memory, and Skillscited by 19
  12. 2025MemEngine: A Unified and Modular Library for Developing Advanced Memory of LLM-based Agentscited by 17
38 more
  1. 2026Memory Matters More: Event-Centric Memory as a Logic Map for Agent Searching and Reasoningcited by 17
  2. 2025Explicit v.s. Implicit Memory: Exploring Multi-hop Complex Reasoning Over Personalized Informationcited by 16
  3. 2026HiMem: Hierarchical Long-Term Memory for LLM Long-Horizon Agentscited by 16
  4. 2026AtomMem : Learnable Dynamic Agentic Memory with Atomic Memory Operationcited by 13
  5. 2026PERMA: Benchmarking Personalized Memory Agents via Event-Driven Preference and Realistic Task Environmentscited by 13
  6. 2026Memory in the LLM Era: Modular Architectures and Strategies in a Unified Frameworkcited by 12
  7. 2026Memex(RL): Scaling Long-Horizon LLM Agents via Indexed Experience Memorycited by 11
  8. 2026Are We Ready For An Agent-Native Memory System?cited by 11
  9. 2025AssoMem: Scalable Memory QA with Multi-Signal Associative Retrievalcited by 10
  10. 2026ES-MemEval: Benchmarking Conversational Agents on Personalized Long-Term Emotional Supportcited by 10
  11. 2026Toward Personalized LLM-Powered Agents: Foundations, Evaluation, and Future Directionscited by 10
  12. 2026Fine-Mem: Fine-Grained Feedback Alignment for Long-Horizon Memory Managementcited by 8
  13. 2026MemORAI: Memory Organization and Retrieval via Adaptive Graph Intelligence for LLM Conversational Agentscited by 8
  14. 2025RGMem: Renormalization Group-inspired Memory Evolution for Language Agentscited by 7
  15. 2026RecMem: Recurrence-based Memory Consolidation for Efficient and Effective Long-Running LLM Agentscited by 7
  16. 2025Experience-Evolving Multi-Turn Tool-Use Agent with Hybrid Episodic-Procedural Memorycited by 6
  17. 2026Gated Differentiable Working Memory for Long-Context Language Modelingcited by 6
  18. 2026SibylSense: Adaptive Rubric Learning via Memory Tuning and Adversarial Probingcited by 6
  19. 2026ActMem: Bridging the Gap Between Memory Retrieval and Reasoning in LLM Agentscited by 6
  20. 2026Semantic XPath: Structured Agentic Memory Access for Conversational AIcited by 6
  21. 2026Chain-of-Memory: Lightweight Memory Construction with Dynamic Evolution for LLM Agentscited by 5
  22. 2026Enhancing Web Agents with a Hierarchical Memory Treecited by 5
  23. 2026Toward a Theory of Hierarchical Memory for Language Agentscited by 5
  24. 2026Metis: Memory Foundation Modelcited by 5
  25. 2026AMA: Adaptive Memory via Multi-Agent Collaborationcited by 4
  26. 2026H-Mem: A Novel Memory Mechanism for Evolving and Retrieving Agent Memory via a Hybrid Structurecited by 4
  27. 2026Remembering More, Risking More: Longitudinal Safety Risks in Memory-Equipped LLM Agentscited by 4
  28. 2026Bi-Mem: Bidirectional Construction of Hierarchical Memory for Personalized LLMs via Inductive-Reflective Agentscited by 3
  29. 2026From Atom to Community: Structured and Evolving Agent Memory for User Behavior Modelingcited by 3
  30. 2026Goal-Oriented Reasoning for RAG-based Memory in Conversational Agentic LLM Systemscited by 3
  31. 2026MemForest: An Efficient Agent Memory System with Hierarchical Temporal Indexingcited by 3
  32. 2026Personalize-then-Store: Benchmarking and Learning Personalized Memory for Long-horizon Agentscited by 3
  33. 2026MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversationscited by 3
  34. 2026Filesystem-Based Memory for LLM Agents: Organization, Evolution, and Sustainabilitycited by 3
  35. 2026CLAG: Adaptive Memory Organization via Agent-Driven Clustering for Small Language Model Agentscited by 2
  36. 2026Decocted Experience Improves Test-Time Inference in LLM Agentscited by 2
  37. 2026Learning How and What to Memorize: Cognition-Inspired Two-Stage Optimization for Evolving Memorycited by 2
  38. 2026RippleMem: From Isolated Retrieval to Associative Recollection for Long-Term Agent Memorycited by 2

50 most cited of 77 All 77 (JSON)