Generative Subgraph Retrieval for Knowledge Graph-Grounded Dialog Generation
Not on the map. Why?
Abstract (arXiv)
Knowledge graph-grounded dialog generation requires retrieving a dialog-relevant subgraph from the given knowledge base graph and integrating it with the dialog history. Previous works typically represent the graph using an external encoder, such as graph neural networks, and retrieve relevant triplets based on the similarity between single-vector representations of triplets and the dialog history. However, these external encoders fail to leverage the rich knowledge of pretrained language models, and the retrieval process is also suboptimal due to the information bottleneck caused by the single-vector abstraction of the dialog history. In this work, we propose Dialog generation with Generative Subgraph Retrieval (DialogGSR), which retrieves relevant knowledge subgraphs by directly generating their token sequences on top of language models. For effective generative subgraph retrieval, we introduce two key methods: (i) structure-aware knowledge graph linearization with self-supervised graph-specific tokens and (ii) graph-constrained decoding utilizing graph structural proximity-based entity informativeness scores for valid and relevant generative retrieval. DialogGSR achieves state-of-the-art performance in knowledge graph-grounded dialog generation, as demonstrated on OpenDialKG and KOMODIS datasets.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 46 of its 67 references that are in the map. First posted on arXiv 12 Oct 2024.
Builds on
46 of 67 references.
References · 46
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2017Graph Attention Networkscited by 8,854
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
- 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
34 more
- 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
- 2020Autoregressive Entity Retrievalcited by 333
- 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
- 2022Generate rather than Retrieve: Large Language Models are Strong Context Generatorscited by 296
- 2020Sparse, Dense, and Attentional Representations for Text Retrievalcited by 213
- 2017A Knowledge-Grounded Neural Conversation Modelcited by 136
- 2020Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answeringcited by 122
- 2022Autoregressive Search Engines: Generating Substrings as Document Identifierscited by 112
- 2022A Neural Corpus Indexer for Document Retrievalcited by 107
- 2020Transfer Learning of Graph Neural Networks with Ego-graph Information Maximizationcited by 93
- 2022Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answeringcited by 93
- 2019Evaluating the State-of-the-Art of End-to-End Natural Language Generation: The E2E NLG Challengecited by 86
- 2019Learning to Select Knowledge for Response Generation in Dialog Systemscited by 80
- 2020JAKET: Joint Pre-training of Knowledge Graph and Language Understandingcited by 73
- 2020Knowledge Graph-Augmented Abstractive Summarization with Semantic-Driven Cloze Rewardcited by 66
- 2019Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge Graphscited by 59
- 2023Knowledge Graph-Augmented Language Models for Knowledge-Grounded Dialogue Generationcited by 54
- 2018Structured Neural Summarizationcited by 53
- 2020Low-Resource Knowledge-Grounded Dialogue Generationcited by 53
- 2022RHO (ρ): Reducing Hallucination in Open-domain Dialogues with Knowledge Groundingcited by 47
- 2022GERE: Generative Evidence Retrieval for Fact Verificationcited by 38
- 2019Constrained Decoding for Neural NLG from Compositional Representations in Task-Oriented Dialoguecited by 35
- 2019DyKgChat: Benchmarking Dialogue Generation Grounding on Dynamic Knowledge Graphscited by 33
- 2020A Memory Efficient Baseline for Open Domain Question Answeringcited by 32
- 2018Findings of the E2E NLG Challengecited by 28
- 2018Extending Neural Generative Conversational Model using External Knowledge Sourcescited by 16
- 2019Improving Knowledge-aware Dialogue Generation via Knowledge Base Question Answeringcited by 15
- 2023Generative Knowledge Selection for Knowledge-Grounded Dialoguescited by 15
- 2022Towards Large-Scale Interpretable Knowledge Graph Reasoning for Dialogue Systemscited by 10
- 2023An Investigation of LLMs' Inefficacy in Understanding Converse Relationscited by 9
- 2020A Corpus of Controlled Opinionated and Knowledgeable Movie Discussions for Training Neural Conversation Modelscited by 8
- 2022Relation-Aware Language-Graph Transformer for Question Answeringcited by 7
- 2022Data-Efficient Autoregressive Document Retrieval for Fact Verificationcited by 6
Built on by
Citing papers per year: 2025: 3; 2026: 3.
6 papers.
- 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Modelscited by 85
- 2025DeepVideo-R1: Video Reinforcement Fine-Tuning via Difficulty-aware Regressive GRPOcited by 57
- 2026Time is Not a Label: Continuous Phase Rotation for Temporal Knowledge Graphs and Agentic Memorycited by 3
- 2025Improving LLM's Attachment to External Knowledge In Dialogue Generation Tasks Through Entity Anonymizationcited by 0
- 2026Learning to Recommend Multi-Agent Subgraphs from Calling Treescited by 0
- 2026Relevance-aware Multi-context Contrastive Decoding for Retrieval-augmented Visual Question Answeringcited by 0
- 2026Time is Not a Label: Continuous Phase Rotation for Temporal Knowledge Graphs and Agentic Memory13 Apr 2026
- 2026Learning to Recommend Multi-Agent Subgraphs from Calling Trees29 Jan 2026
- 2026Relevance-aware Multi-context Contrastive Decoding for Retrieval-augmented Visual Question Answering14 Jan 2026
- 2025Improving LLM's Attachment to External Knowledge In Dialogue Generation Tasks Through Entity Anonymization14 Nov 2025
- 2025DeepVideo-R1: Video Reinforcement Fine-Tuning via Difficulty-aware Regressive GRPO9 Jun 2025
- 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Models21 Jan 2025