mlsanityData to 14 Oct 2026

Retrieval-Augmented Generation with Hierarchical Knowledge

arXiv 2503.10150 ↗First posted 13 Mar 2025cs.CL cs.AIcited by 47

On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG

Abstract (arXiv)

Graph-based Retrieval-Augmented Generation (RAG) methods have significantly enhanced the performance of large language models (LLMs) in domain-specific tasks. However, existing RAG methods do not adequately utilize the naturally inherent hierarchical knowledge in human cognition, which limits the capabilities of RAG systems. In this paper, we introduce a new RAG approach, called HiRAG, which utilizes hierarchical knowledge to enhance the semantic understanding and structure capturing capabilities of RAG systems in the indexing and retrieval processes. Our extensive experiments demonstrate that HiRAG achieves significant performance improvements over the state-of-the-art baseline methods.

Key facts. Cited by 47 papers in the map (data through 14 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 24 of its 40 references that are in the map. First posted on arXiv 13 Mar 2025.

Builds on

24 of 40 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Models21 Jan
  2. 2024LightRAG: Simple and Fast Retrieval-Augmented Generation8 Oct
  3. 2024KAG: Boosting LLMs in Professional Domains via Knowledge Augmented Generation10 Sep
  4. 2024Graph Retrieval-Augmented Generation: A Survey15 Aug
  5. 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoning30 May
  6. 2024GRAG: Graph Retrieval-Augmented Generation26 May
  7. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarization24 Apr
  8. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval31 Jan

Other references · 16

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  4. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  5. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
  6. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
  7. 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 517
  8. 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 472
  9. 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 452
  10. 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 418
  11. 2018From Louvain to Leiden: guaranteeing well-connected communitiescited by 385
  12. 2024MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queriescited by 257
4 more
  1. 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 231
  2. 2022Learning Causally Invariant Representations for Out-of-Distribution Generalization on Graphscited by 144
  3. 2024StructRAG: Boosting Knowledge Intensive Reasoning of LLMs via Inference-time Hybrid Information Structurizationcited by 71
  4. 2023Iterative Zero-Shot LLM Prompting for Knowledge Graph Constructioncited by 25

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 10; 2026: 37.

47 papers.

Sort:

By area:

  1. 2025LeanRAG: Knowledge-Graph-Based Generation with Semantic Aggregation and Hierarchical Retrievalcited by 16
  2. 2026Beyond Dialogue Time: Temporal Semantic Memory for Personalized LLM Agentscited by 14
  3. 2026HyperMem: Hypergraph Memory for Long-Term Conversationscited by 14
  4. 2025Cog-RAG: Cognitive-Inspired Dual-Hypergraph with Theme Alignment Retrieval-Augmented Generationcited by 9
  5. 2026SkillRAE: Agent Skill-Based Context Compilation for Retrieval-Augmented Executioncited by 8
  6. 2026Corpus2Skill: Distilling Enterprise Knowledge into Navigable Agent Skills for QA and RAGcited by 7
  7. 2026MemSearch-o1: Empowering Large Language Models with Reasoning-Aligned Memory Growth in Agentic Searchcited by 5
  8. 2025HetaRAG: Hybrid Deep Retrieval-Augmented Generation across Heterogeneous Data Storescited by 3
  9. 2026Unlocking the Potentials of Retrieval-Augmented Generation for Diffusion Language Modelscited by 3
  10. 2025An Agile Method for Implementing Retrieval Augmented Generation Tools in Industrial SMEscited by 2
  11. 2026Embodied Task Planning via Graph-Informed Action Generation with Large Language Modelscited by 2
  12. 2026A/B Agent: A Self-Evolving Agent for Strategy Iteration in Industrial A/B Testingcited by 2
35 more
  1. 2025AtlasKV: Augmenting LLMs with Billion-Scale Knowledge Graphs in 20GB VRAMcited by 1
  2. 2025Learning to Debug: LLM-Organized Knowledge Trees for Solving RTL Assertion Failurescited by 1
  3. 2025TagRAG: Tag-guided Hierarchical Knowledge Graph Retrieval-Augmented Generationcited by 1
  4. 2026BEAR: Budgeted Evidence Allocation for Multi-Document Reasoningcited by 1
  5. 2026LLM-Oriented Information Retrieval: A Denoising-First Perspectivecited by 1
  6. 2026ANCHOR: Abductive Network Construction with Hierarchical Orchestration for Reliable Probability Inference in Large Language Modelscited by 1
  7. 2026DeepRefine: Agentic Knowledge Refinement via Reinforcement Learningcited by 1
  8. 2026DOTRAG: Retrieval-Time Reasoning Along Pathscited by 1
  9. 2026ContextRAG: Extraction-Free Hierarchical Graph Construction for Retrieval-Augmented Generationcited by 1
  10. 2026SAG: SQL-Retrieval Augmented Generation with Query-Time Dynamic Hyperedgescited by 1
  11. 2026PonsRAG: A Pons-Inspired RAG Bridging Cognitive Islands for Coordinated Long Narrative Reasoningcited by 1
  12. 2025GOSU: Retrieval-Augmented Generation with Global-Level Optimized Semantic Unit-Centric Frameworkcited by 0
  13. 2025Graph-Guided Concept Selection for Efficient Retrieval-Augmented Generationcited by 0
  14. 2025PROPEX-RAG: Enhanced GraphRAG using Prompt-Driven Prompt Executioncited by 0
  15. 2026T-Retriever: Tree-based Hierarchical Retrieval Augmented Generation for Textual Graphscited by 0
  16. 2026IGMiRAG: Intuition-Guided Retrieval-Augmented Generation with Adaptive Mining of In-Depth Memorycited by 0
  17. 2026Hyper-KGGen: A Skill-Driven Knowledge Extractor for High-Quality Knowledge Hypergraph Generationcited by 0
  18. 2026Adaptive Query Routing: A Tier-Based Framework for Hybrid Retrieval Across Financial, Legal, and Medical Documentscited by 0
  19. 2026Hierarchical Abstract Tree for Cross-Document Retrieval-Augmented Generationcited by 0
  20. 2026ASTRA-QA: A Benchmark for Abstract Question Answering over Documentscited by 0
  21. 2026StateRAG: Typed State Contracts for Complex Retrieval-Augmented Generationcited by 0
  22. 2026LitSeg: Narrative-Aware Document Segmentation for Literary RAGcited by 0
  23. 2026Mind the Gap: Bridging Behavioral Silos with LLMs in Multi-Vertical Recommendationscited by 0
  24. 2026A Unified Framework for Context-Aware and Relation-Aware Graph Retrieval-Augmented Generationcited by 0
  25. 2026R2-Searcher: Calibrating Retrieval and Reasoning Boundaries for Agentic Searchcited by 0
  26. 2026Imprint: Online Memory Compression for Long-Horizon Egocentric QAcited by 0
  27. 2026Constraint-Aware Hierarchical Search for Regulation-Driven Fine-Grained Classificationcited by 0
  28. 2026DocNavRAG: Document-Structured Graph RAG with Stateful Evidence Construction for Complex Document Question Answeringcited by 0
  29. 2026SAG: SQL-Retrieval Augmented Generation with Query-Time Dynamic Hyperedgescited by 0
  30. 2026Handoff-H1: An Orchestrated Vision-Agent System for Material Quantity Takeoff from Construction Blueprintscited by 0
  31. 2026LiteRAG: Cost-Efficient Graph-Based Retrieval-Augmented Generationcited by 0
  32. 2026VikingRAG: Accurate and Token-efficient Retrieval-augmented Generation over Structured Documentscited by 0
  33. 2026Cognition on Graph: Navigating Massive Knowledge Space via Cognitive Cycles and Bidirectional Graph-Text Synergycited by 0
  34. 2026Realize What Matters: Principled Context Representation for Large-Scale Reasoningcited by 0
  35. 2026A Matryoshka Hierarchical RAG for Efficient Multi-Hop Question Answeringcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025HIRAG: Hierarchical-Thought Instruction-Tuning Retrieval-Augmented Generation
  2. 2026HG-RAG: Hierarchy-Guided Retrieval-Augmented Generation for Structured Knowledge Graphs
  3. 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generation
  4. 2025Dynamic and Parametric Retrieval-Augmented Generation
  5. 2025Enhancing Retrieval-Augmented Generation: A Study of Best Practices
  6. 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Survey
  7. 2025Knowledge Graph-Guided Retrieval Augmented Generation
  8. 2024A Comprehensive Survey of Retrieval-Augmented Generation (RAG): Evolution, Current Landscape and Future Directions