mlsanityData to 7 Oct 2026

DynaGRAG | Exploring the Topology of Information for Advancing Language Understanding and Generation in Graph Retrieval-Augmented Generation

arXiv 2412.18644 ↗First posted 24 Dec 2024cs.CL cs.AI cs.LGcited by 1

On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG

Abstract (arXiv)

Graph Retrieval-Augmented Generation (GRAG or Graph RAG) architectures aim to enhance language understanding and generation by leveraging external knowledge. However, effectively capturing and integrating the rich semantic information present in textual and structured data remains a challenge. To address this, a novel GRAG framework, Dynamic Graph Retrieval-Agumented Generation (DynaGRAG), is proposed to focus on enhancing subgraph representation and diversity within the knowledge graph. By improving graph density, capturing entity and relation information more effectively, and dynamically prioritizing relevant and diverse subgraphs and information within them, the proposed approach enables a more comprehensive understanding of the underlying semantic structure. This is achieved through a combination of de-duplication processes, two-step mean pooling of embeddings, query-aware retrieval considering unique nodes, and a Dynamic Similarity-Aware BFS (DSA-BFS) traversal algorithm. Integrating Graph Convolutional Networks (GCNs) and Large Language Models (LLMs) through hard prompting further enhances the learning of rich node and edge representations while preserving the hierarchical subgraph structure. Experimental results demonstrate the effectiveness of DynaGRAG, showcasing the significance of enhanced subgraph representation and diversity for improved language understanding and generation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 12 of its 17 references that are in the map. First posted on arXiv 24 Dec 2024.

Builds on

12 of 17 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Graph Retrieval-Augmented Generation: A Survey15 Aug
  2. 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoning30 May
  3. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarization24 Apr

Other references · 9

  1. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  2. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  3. 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 271
  4. 2023Talk like a Graph: Encoding Graphs for Large Language Modelscited by 175
  5. 2020A Systematic Survey on Deep Generative Models for Graph Generationcited by 94
  6. 2024KG-RAG: Bridging the Gap Between Knowledge and Creativitycited by 55
  7. 2024On the Impact of Fine-Tuning on Chain-of-Thought Reasoningcited by 32
  8. 2024LLMs generate structurally realistic social networks but overestimate political homophilycited by 31
  9. 2024Exploring the Potential of Large Language Models in Graph Generationcited by 15

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024GRAG: Graph Retrieval-Augmented Generation
  2. 2024SimGRAG: Leveraging Similar Subgraphs for Knowledge Graphs Driven Retrieval-Augmented Generation
  3. 2026Efficient Retrieval-Augmented Generation via Token Co-occurrence Graphs
  4. 2025GRIL: Knowledge Graph Retrieval-Integrated Learning with Large Language Models
  5. 2025GPR: Empowering Generation with Graph-Pretrained Retriever
  6. 2026A Unified Framework for Context-Aware and Relation-Aware Graph Retrieval-Augmented Generation
  7. 2025ROGRAG: A Robustly Optimized GraphRAG Framework
  8. 2026T-Retriever: Tree-based Hierarchical Retrieval Augmented Generation for Textual Graphs