mlsanityData to 7 Oct 2026

HiMem: Hierarchical Long-Term Memory for LLM Long-Horizon Agents

arXiv 2601.06377 ↗First posted 10 Jan 2026cs.AIcited by 16

On the map: LLM agents and tool use → Agent memory systems

Abstract (arXiv)

Although long-term memory systems have made substantial progress in recent years, they still exhibit clear limitations in adaptability, scalability, and self-evolution under continuous interaction settings. Inspired by cognitive theories, we propose HiMem, a hierarchical long-term memory framework for long-horizon dialogues, designed to support memory construction, retrieval, and dynamic updating during sustained interactions. HiMem constructs cognitively consistent Episode Memory via a Topic-Aware Event--Surprise Dual-Channel Segmentation strategy, and builds Note Memory that captures stable knowledge through a multi-stage information extraction pipeline. These two memory types are semantically linked to form a hierarchical structure that bridges concrete interaction events and abstract knowledge, enabling efficient retrieval without sacrificing information fidelity. HiMem supports both hybrid and best-effort retrieval strategies to balance accuracy and efficiency, and incorporates conflict-aware Memory Reconsolidation to revise and supplement stored knowledge based on retrieval feedback. This design enables continual memory self-evolution over long-term use. Experimental results on long-horizon dialogue benchmarks demonstrate that HiMem consistently outperforms representative baselines in accuracy, consistency, and long-term reasoning, while maintaining favorable efficiency. Overall, HiMem provides a principled and scalable design paradigm for building adaptive and self-evolving LLM-based conversational agents. The code is available at https://github.com/jojopdq/HiMem.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 34 of its 45 references that are in the map. First posted on arXiv 10 Jan 2026.

Builds on

34 of 45 references.

Closest ancestors · 12

Same direction, newest first

  1. 2025SGMem: Sentence Graph Memory for Long-Term Conversational Agents25 Sep
  2. 2025What Deserves Memory: Adaptive Memory Distillation for LLM Agents5 Aug
  3. 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systems9 Jun
  4. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory28 Apr
  5. 2025MemInsight: Autonomous Memory Augmentation for LLM Agents27 Mar
  6. 2025In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agents11 Mar
  7. 2025A-MEM: Agentic Memory for LLM Agents17 Feb
  8. 2024Towards Lifelong Dialogue Agents via Timeline-based Memory Management16 Jun
  9. 2024Toward Conversational Agents with Context and Time Sensitive Long-term Memory29 May
  10. 2024A Survey on the Memory Mechanism of Large Language Model based Agents21 Apr
  11. 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb
  12. 2024A Human-Inspired Reading Agent with Gist Memory of Very Long Contexts15 Feb

Other references · 22

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  4. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
  5. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  6. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
  7. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
  8. 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 266
  9. 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 223
  10. 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Designcited by 163
  11. 2025From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMscited by 119
  12. 2024MemoRAG: Boosting Long Context Processing with Global Memory-Enhanced Retrieval Augmentationcited by 118
10 more
  1. 2025On Memory Construction and Retrieval for Personalized Conversational Agentscited by 101
  2. 2024From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMscited by 77
  3. 2024Human-inspired Episodic Memory for Infinite Context LLMscited by 62
  4. 2025Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language Modelscited by 58
  5. 2024Long Term Memory: The Foundation of AI Self-Evolutioncited by 29
  6. 2025Cognitive Memory in Large Language Modelscited by 28
  7. 2025AgentCF++: Memory-enhanced LLM-based Agents for Popularity-aware Cross-domain Recommendationscited by 23
  8. 2024KGARevion: An AI Agent for Knowledge-Intensive Biomedical QAcited by 20
  9. 2024Human-inspired Perspectives: A Survey on AI Long-term Memorycited by 12
  10. 2024FragRel: Exploiting Fragment-level Relations in the External Memory of Large Language Modelscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 16.

16 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026AdaMem: Adaptive User-Centric Memory for Long-Horizon Dialogue Agents
  2. 2025Hierarchical Memory for High-Efficiency Long-Term Reasoning in LLM Agents
  3. 2026HiGMem: A Hierarchical and LLM-Guided Memory System for Long-Term Conversational Agents
  4. 2026Multi-Layered Memory Architectures for LLM Agents: An Experimental Evaluation of Long-Term Context Retention
  5. 2026Membox: Weaving Topic Continuity into Long-Range Memory for LLM Agents
  6. 2026LeanMem: Simple and Efficient Long-Term Memory for LLM Agents
  7. 2026Beyond Dialogue Time: Temporal Semantic Memory for Personalized LLM Agents
  8. 2026MGRetrieval: Memory-Guided Reflective Retrieval for Long-Term Dialogue Agents