mlsanityData to 14 Oct 2026

GRAG: Graph Retrieval-Augmented Generation

arXiv 2405.16506 ↗First posted 26 May 2024cs.LGcited by 78

On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG

Abstract (arXiv)

Naive Retrieval-Augmented Generation (RAG) focuses on individual documents during retrieval and, as a result, falls short in handling networked documents which are very popular in many applications such as citation graphs, social media, and knowledge graphs. To overcome this limitation, we introduce Graph Retrieval-Augmented Generation (GRAG), which tackles the fundamental challenges in retrieving textual subgraphs and integrating the joint textual and topological information into Large Language Models (LLMs) to enhance its generation. To enable efficient textual subgraph retrieval, we propose a novel divide-and-conquer strategy that retrieves the optimal subgraph structure in linear time. To achieve graph context-aware generation, incorporate textual graphs into LLMs through two complementary views-the text view and the graph view-enabling LLMs to more effectively comprehend and utilize the graph context. Extensive experiments on graph reasoning benchmarks demonstrate that in scenarios requiring multi-hop reasoning on textual graphs, our GRAG approach significantly outperforms current state-of-the-art RAG methods. Our datasets as well as codes of GRAG are available at https://github.com/HuieL/GRAG.

Key facts. Cited by 78 papers in the map (data through 14 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 42 of its 63 references that are in the map. First posted on arXiv 26 May 2024.

Builds on

42 of 63 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarization24 Apr
  2. 2024G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answering12 Feb

Other references · 40

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2017Graph Attention Networkscited by 8,923
  6. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  7. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  8. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  9. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
  10. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
  11. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
  12. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
28 more
  1. 2023In-Context Retrieval-Augmented Language Modelscited by 702
  2. 2020Language-agnostic BERT Sentence Embeddingcited by 627
  3. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 388
  4. 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 343
  5. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 328
  6. 2022Teaching language models to support answers with verified quotescited by 292
  7. 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 274
  8. 2024MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queriescited by 257
  9. 2023Can Language Models Solve Graph Problems in Natural Language?cited by 252
  10. 2023Large Language Models on Graphs: A Comprehensive Surveycited by 192
  11. 2023Talk like a Graph: Encoding Graphs for Large Language Modelscited by 176
  12. 2024Do Large Language Models Latently Perform Multi-Hop Reasoning?cited by 169
  13. 2023Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation Learningcited by 133
  14. 2023Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answeringcited by 119
  15. 2023A Survey of Graph Meets Large Language Model: Progress and Future Directionscited by 85
  16. 2023Label-free Node Classification on Graphs with Large Language Models (LLMS)cited by 72
  17. 2023Graph Neural Prompting with Large Language Modelscited by 64
  18. 2021ExplaGraphs: An Explanation Graph Generation Task for Structured Commonsense Reasoningcited by 58
  19. 2023FactKG: Fact Verification via Reasoning on Knowledge Graphscited by 57
  20. 2023Knowledge Graph-Augmented Language Models for Knowledge-Grounded Dialogue Generationcited by 54
  21. 2023Enhancing Knowledge Graph Construction Using Large Language Modelscited by 44
  22. 2023Exploring Large Language Models for Knowledge Graph Completioncited by 43
  23. 2023PDFTriage: Question Answering over Long, Structured Documentscited by 29
  24. 2023Complex Logical Reasoning over Knowledge Graphs using Large Language Modelscited by 28
  25. 2022Prompt Tuning for Generative Multimodal Pretrained Modelscited by 25
  26. 2023Beyond Text: A Deep Dive into Large Language Models' Ability on Understanding Graph Datacited by 25
  27. 2024Distilling Large Language Models for Text-Attributed Graph Learningcited by 20
  28. 2023An Empirical Study of Pre-trained Language Models in Simple Knowledge Graph Question Answeringcited by 19

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 42; 2026: 32.

78 papers.

Sort:

By area:

  1. 2024RepoGraph: Enhancing AI Software Engineering with Repository-level Code Graphcited by 91
  2. 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Modelscited by 88
  3. 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generationcited by 80
  4. 2025When to use Graphs in RAG: A Comprehensive Analysis for Graph Retrieval-Augmented Generationcited by 48
  5. 2025Retrieval-Augmented Generation with Hierarchical Knowledgecited by 47
  6. 2025Graphs Meet AI Agents: Taxonomy, Progress, and Future Opportunitiescited by 23
  7. 2025Graph RAG-Tool Fusioncited by 15
  8. 2025EraRAG: Efficient and Incremental Retrieval Augmented Generation for Growing Corporacited by 15
  9. 2025CRAKEN: Cybersecurity LLM Agent with Knowledge-Based Executioncited by 14
  10. 2024Towards LifeSpan Cognitive Systemscited by 13
  11. 2025Knowledge Graph-based Retrieval-Augmented Generation for Schema Matchingcited by 13
  12. 2025VistaWise: Building Cost-Effective Agent with Cross-Modal Knowledge Graph for Minecraftcited by 13
38 more
  1. 2025Diagnosing and Addressing Pitfalls in KG-RAG Datasets: Toward More Reliable Benchmarkingcited by 12
  2. 2025Align-GRAG: Anchor and Rationale Guided Dual Alignment for Graph Retrieval-Augmented Generationcited by 9
  3. 2025Multi-agent systems for chemical engineering: A review and perspectivecited by 9
  4. 2025Graph-Augmented Reasoning: Evolving Step-by-Step Knowledge Graph Retrieval for LLM Reasoningcited by 8
  5. 2025AGRAG: Advanced Graph-based Retrieval-Augmented Generation for LLMscited by 7
  6. 2025ModiGen: A Large Language Model-Based Workflow for Multi-Task Modelica Code Generationcited by 4
  7. 2025BioMol-MQA: A Multi-Modal Question Answering Dataset For LLM Reasoning Over Bio-Molecular Interactionscited by 4
  8. 2025Agent-as-a-Graph: Knowledge Graph-Based Tool and Agent Retrieval for LLM Multi-Agent Systemscited by 4
  9. 2024Towards Automated Patent Workflows: AI-Orchestrated Multi-Agent Framework for Intellectual Property Management and Analysiscited by 3
  10. 2025Schema Generation for Large Knowledge Graphs Using Large Language Modelscited by 3
  11. 2025URAG: Implementing a Unified Hybrid RAG for Precise Answers in University Admission Chatbots -- A Case Study at HCMUTcited by 2
  12. 2025Scaling Natural-Language Graph-Based Test Time Compute for Automated Theorem Provingcited by 2
  13. 2025Distributed Retrieval-Augmented Generationcited by 2
  14. 2025KAQG: A Knowledge-Graph-Enhanced RAG for Difficulty-Controlled Question Generationcited by 2
  15. 2025Divide by Question, Conquer by Agent: SPLIT-RAG with Question-Driven Graph Partitioningcited by 2
  16. 2025PersonalAI: A Systematic Comparison of Knowledge Graph Storage and Retrieval Approaches for Personalized LLM agentscited by 2
  17. 2025Towards Open-World Retrieval-Augmented Generation on Knowledge Graph: A Multi-Agent Collaboration Frameworkcited by 2
  18. 2025TERAG: Token-Efficient Graph-Based Retrieval-Augmented Generationcited by 2
  19. 2025Question-Adaptive Graph Learning for Multi-hop Retrieval Augmented Generationcited by 2
  20. 2025DPRM: A Dual Implicit Process Reward Model in Multi-Hop Question Answeringcited by 2
  21. 2025HyperbolicRAG: Enhancing Retrieval-Augmented Generation with Hyperbolic Representationscited by 2
  22. 2026When to Trust: A Causality-Aware Calibration Framework for Accurate Knowledge Graph Retrieval-Augmented Generationcited by 2
  23. 2026Knowledge Is Not Static: Order-Aware Hypergraph RAG for Language Modelscited by 2
  24. 2026LARGER: Lexically Anchored Repository Graph Exploration and Retrievalcited by 2
  25. 2025Towards Scalable and Cross-Lingual Specialist Language Models for Oncologycited by 1
  26. 2025SubGCache: Accelerating Graph-based RAG with Subgraph-level KV Cachecited by 1
  27. 2025ClueAnchor: Clue-Anchored Knowledge Reasoning Exploration and Optimization for Retrieval-Augmented Generationcited by 1
  28. 2025KP-A: A Unified Network Knowledge Plane for Catalyzing Agentic Network Intelligencecited by 1
  29. 2025MARC: Multimodal and Multi-Task Agentic Retrieval-Augmented Generation for Cold-Start Recommender Systemcited by 1
  30. 2025NOEM3A: a Neuro-symbolic Ontology-Enhanced Method for Multi-intent understanding in Mobile Agentscited by 1
  31. 2026Disco-RAG: Discourse-Aware Retrieval-Augmented Generationcited by 1
  32. 2026Agentic Graph Retrieval-Augmented Generation for Auditable Commercial Registry Analysiscited by 1
  33. 2026G-Long: Graph-Enhanced Memory Management for Efficient Long-Term Dialogue Agentscited by 1
  34. 2026DeepInstructor: An Agentic AI Instructor for Experience-Driven Idea Evaluationcited by 1
  35. 2025DGRAG: Distributed Graph-based Retrieval-Augmented Generation in Edge-Cloud Systemscited by 0
  36. 2025A Graph-Retrieval-Augmented Generation Framework Enhances Decision-Making in the Circular Economycited by 0
  37. 2025LlamaRec-LKG-RAG: A Single-Pass, Learnable Knowledge Graph-RAG Framework for LLM-Based Rankingcited by 0
  38. 2025REBot: From RAG to CatRAG with Semantic Enrichment and Graph Routingcited by 0

50 most cited of 78 All 78 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024DynaGRAG | Exploring the Topology of Information for Advancing Language Understanding and Generation in Graph Retrieval-Augmented Generation
  2. 2024Graph Retrieval-Augmented Generation: A Survey
  3. 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Survey
  4. 2025RGL: A Graph-Centric, Modular Framework for Efficient Retrieval-Augmented Generation on Graphs
  5. 2025RAG vs. GraphRAG: A Systematic Evaluation and Key Insights
  6. 2024SimGRAG: Leveraging Similar Subgraphs for Knowledge Graphs Driven Retrieval-Augmented Generation
  7. 2025Fast Think-on-Graph: Wider, Deeper and Faster Reasoning of Large Language Model on Knowledge Graph
  8. 2026T-Retriever: Tree-based Hierarchical Retrieval Augmented Generation for Textual Graphs