HiMem: Hierarchical Long-Term Memory for LLM Long-Horizon Agents
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
Although long-term memory systems have made substantial progress in recent years, they still exhibit clear limitations in adaptability, scalability, and self-evolution under continuous interaction settings. Inspired by cognitive theories, we propose HiMem, a hierarchical long-term memory framework for long-horizon dialogues, designed to support memory construction, retrieval, and dynamic updating during sustained interactions. HiMem constructs cognitively consistent Episode Memory via a Topic-Aware Event--Surprise Dual-Channel Segmentation strategy, and builds Note Memory that captures stable knowledge through a multi-stage information extraction pipeline. These two memory types are semantically linked to form a hierarchical structure that bridges concrete interaction events and abstract knowledge, enabling efficient retrieval without sacrificing information fidelity. HiMem supports both hybrid and best-effort retrieval strategies to balance accuracy and efficiency, and incorporates conflict-aware Memory Reconsolidation to revise and supplement stored knowledge based on retrieval feedback. This design enables continual memory self-evolution over long-term use. Experimental results on long-horizon dialogue benchmarks demonstrate that HiMem consistently outperforms representative baselines in accuracy, consistency, and long-term reasoning, while maintaining favorable efficiency. Overall, HiMem provides a principled and scalable design paradigm for building adaptive and self-evolving LLM-based conversational agents. The code is available at https://github.com/jojopdq/HiMem.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 34 of its 45 references that are in the map. First posted on arXiv 10 Jan 2026.
Builds on
34 of 45 references.
Closest ancestors · 12
Same direction, newest first
- 2025SGMem: Sentence Graph Memory for Long-Term Conversational Agents25 Sep
- 2025What Deserves Memory: Adaptive Memory Distillation for LLM Agents5 Aug
- 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systems9 Jun
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory28 Apr
- 2025MemInsight: Autonomous Memory Augmentation for LLM Agents27 Mar
- 2025In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agents11 Mar
- 2025A-MEM: Agentic Memory for LLM Agents17 Feb
- 2024Towards Lifelong Dialogue Agents via Timeline-based Memory Management16 Jun
- 2024Toward Conversational Agents with Context and Time Sensitive Long-term Memory29 May
- 2024A Survey on the Memory Mechanism of Large Language Model based Agents21 Apr
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb
- 2024A Human-Inspired Reading Agent with Gist Memory of Very Long Contexts15 Feb
Other references · 22
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
- 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 266
- 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 223
- 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Designcited by 163
- 2025From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMscited by 119
- 2024MemoRAG: Boosting Long Context Processing with Global Memory-Enhanced Retrieval Augmentationcited by 118
10 more
- 2025On Memory Construction and Retrieval for Personalized Conversational Agentscited by 101
- 2024From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMscited by 77
- 2024Human-inspired Episodic Memory for Infinite Context LLMscited by 62
- 2025Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language Modelscited by 58
- 2024Long Term Memory: The Foundation of AI Self-Evolutioncited by 29
- 2025Cognitive Memory in Large Language Modelscited by 28
- 2025AgentCF++: Memory-enhanced LLM-based Agents for Popularity-aware Cross-domain Recommendationscited by 23
- 2024KGARevion: An AI Agent for Knowledge-Intensive Biomedical QAcited by 20
- 2024Human-inspired Perspectives: A Survey on AI Long-term Memorycited by 12
- 2024FragRel: Exploiting Fragment-level Relations in the External Memory of Large Language Modelscited by 1
Built on by
Citing papers per year: 2026: 16.
16 papers.
Sort:
By area:
- 2026Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitationscited by 20
- 2026Governing Evolving Memory in LLM Agents: Risks, Mechanisms, and the Stability and Safety Governed Memory (SSGM) Frameworkcited by 16
- 2026Evaluating Memory Structure in LLM Agentscited by 12
- 2026Mitigating Provenance-Role Collapse in Long-Term Agents via Typed Memory Representationcited by 5
- 2026MemForest: An Efficient Agent Memory System with Hierarchical Temporal Indexingcited by 3
- 2026LycheeMemory V2: Efficient Long-Term Memory for LLM Agents via Semantic Segment-Level Consolidationcited by 3
- 2026DimMem: Dimensional Structuring for Efficient Long-Term Agent Memorycited by 2
- 2026From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agentscited by 1
- 2026SubtleMemory: A Benchmark for Fine-Grained Relational Memory Discrimination in Long-Horizon AI Agentscited by 1
- 2026MemChain: Learning Interpretable Memory Traces for Memory-Augmented LLM Agentscited by 1
- 2026MemoryLACE: Memory Lifecycle-Aware Consolidation and Evidence Retrievalcited by 1
- 2026DeepTutor: Towards Agentic Personalized Tutoringcited by 0
4 more
- 2026Context Recycling for Long-Horizon LLM Inferencecited by 0
- 2026HMARS: A Hierarchical Multi-Agent Memory System for Long-Context Reasoningcited by 0
- 2026AutoViewMem: Self-Configuring Orthogonal Views for Conversational Long-Term Memorycited by 0
- 2026MemFit: Efficient Long-Term Agentic Memorycited by 0
- 2026MemFit: Efficient Long-Term Agentic Memory1 Oct 2026
- 2026AutoViewMem: Self-Configuring Orthogonal Views for Conversational Long-Term Memory18 Sep 2026
- 2026MemoryLACE: Memory Lifecycle-Aware Consolidation and Evidence Retrieval2 Sep 2026
- 2026LycheeMemory V2: Efficient Long-Term Memory for LLM Agents via Semantic Segment-Level Consolidation13 Aug 2026
- 2026MemChain: Learning Interpretable Memory Traces for Memory-Augmented LLM Agents27 Jul 2026
- 2026SubtleMemory: A Benchmark for Fine-Grained Relational Memory Discrimination in Long-Horizon AI Agents4 Jun 2026
- 2026HMARS: A Hierarchical Multi-Agent Memory System for Long-Context Reasoning3 Jun 2026
- 2026Mitigating Provenance-Role Collapse in Long-Term Agents via Typed Memory Representation25 May 2026
- 2026From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents25 May 2026
- 2026MemForest: An Efficient Agent Memory System with Hierarchical Temporal Indexing16 May 2026
- 2026DimMem: Dimensional Structuring for Efficient Long-Term Agent Memory15 May 2026
- 2026Context Recycling for Long-Horizon LLM Inference1 May 2026
4 more
- 2026DeepTutor: Towards Agentic Personalized Tutoring10 Apr 2026
- 2026Governing Evolving Memory in LLM Agents: Risks, Mechanisms, and the Stability and Safety Governed Memory (SSGM) Framework12 Mar 2026
- 2026Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitations22 Feb 2026
- 2026Evaluating Memory Structure in LLM Agents11 Feb 2026
- 2026Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitationscited by 20
- 2026Governing Evolving Memory in LLM Agents: Risks, Mechanisms, and the Stability and Safety Governed Memory (SSGM) Frameworkcited by 16
- 2026Mitigating Provenance-Role Collapse in Long-Term Agents via Typed Memory Representationcited by 5
- 2026MemForest: An Efficient Agent Memory System with Hierarchical Temporal Indexingcited by 3
- 2026LycheeMemory V2: Efficient Long-Term Memory for LLM Agents via Semantic Segment-Level Consolidationcited by 3
- 2026DimMem: Dimensional Structuring for Efficient Long-Term Agent Memorycited by 2
- 2026MemChain: Learning Interpretable Memory Traces for Memory-Augmented LLM Agentscited by 1
- 2026MemoryLACE: Memory Lifecycle-Aware Consolidation and Evidence Retrievalcited by 1
- 2026DeepTutor: Towards Agentic Personalized Tutoringcited by 0
- 2026MemoryLACE: Memory Lifecycle-Aware Consolidation and Evidence Retrieval2 Sep 2026
- 2026LycheeMemory V2: Efficient Long-Term Memory for LLM Agents via Semantic Segment-Level Consolidation13 Aug 2026
- 2026MemChain: Learning Interpretable Memory Traces for Memory-Augmented LLM Agents27 Jul 2026
- 2026Mitigating Provenance-Role Collapse in Long-Term Agents via Typed Memory Representation25 May 2026
- 2026MemForest: An Efficient Agent Memory System with Hierarchical Temporal Indexing16 May 2026
- 2026DimMem: Dimensional Structuring for Efficient Long-Term Agent Memory15 May 2026
- 2026DeepTutor: Towards Agentic Personalized Tutoring10 Apr 2026
- 2026Governing Evolving Memory in LLM Agents: Risks, Mechanisms, and the Stability and Safety Governed Memory (SSGM) Framework12 Mar 2026
- 2026Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitations22 Feb 2026
- 2026MemFit: Efficient Long-Term Agentic Memorycited by 0
- 2026MemFit: Efficient Long-Term Agentic Memory1 Oct 2026
- 2026Evaluating Memory Structure in LLM Agentscited by 12
- 2026Evaluating Memory Structure in LLM Agents11 Feb 2026
- 2026From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agentscited by 1
- 2026SubtleMemory: A Benchmark for Fine-Grained Relational Memory Discrimination in Long-Horizon AI Agentscited by 1
- 2026Context Recycling for Long-Horizon LLM Inferencecited by 0
- 2026HMARS: A Hierarchical Multi-Agent Memory System for Long-Context Reasoningcited by 0
- 2026AutoViewMem: Self-Configuring Orthogonal Views for Conversational Long-Term Memorycited by 0
- 2026AutoViewMem: Self-Configuring Orthogonal Views for Conversational Long-Term Memory18 Sep 2026
- 2026SubtleMemory: A Benchmark for Fine-Grained Relational Memory Discrimination in Long-Horizon AI Agents4 Jun 2026
- 2026HMARS: A Hierarchical Multi-Agent Memory System for Long-Context Reasoning3 Jun 2026
- 2026From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents25 May 2026
- 2026Context Recycling for Long-Horizon LLM Inference1 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026AdaMem: Adaptive User-Centric Memory for Long-Horizon Dialogue Agents
- 2025Hierarchical Memory for High-Efficiency Long-Term Reasoning in LLM Agents
- 2026HiGMem: A Hierarchical and LLM-Guided Memory System for Long-Term Conversational Agents
- 2026Multi-Layered Memory Architectures for LLM Agents: An Experimental Evaluation of Long-Term Context Retention
- 2026Membox: Weaving Topic Continuity into Long-Range Memory for LLM Agents
- 2026LeanMem: Simple and Efficient Long-Term Memory for LLM Agents
- 2026Beyond Dialogue Time: Temporal Semantic Memory for Personalized LLM Agents
- 2026MGRetrieval: Memory-Guided Reflective Retrieval for Long-Term Dialogue Agents