mlsanityData to 7 Oct 2026

Generative Subgraph Retrieval for Knowledge Graph-Grounded Dialog Generation

arXiv 2410.09350 ↗First posted 12 Oct 2024cs.CL cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Knowledge graph-grounded dialog generation requires retrieving a dialog-relevant subgraph from the given knowledge base graph and integrating it with the dialog history. Previous works typically represent the graph using an external encoder, such as graph neural networks, and retrieve relevant triplets based on the similarity between single-vector representations of triplets and the dialog history. However, these external encoders fail to leverage the rich knowledge of pretrained language models, and the retrieval process is also suboptimal due to the information bottleneck caused by the single-vector abstraction of the dialog history. In this work, we propose Dialog generation with Generative Subgraph Retrieval (DialogGSR), which retrieves relevant knowledge subgraphs by directly generating their token sequences on top of language models. For effective generative subgraph retrieval, we introduce two key methods: (i) structure-aware knowledge graph linearization with self-supervised graph-specific tokens and (ii) graph-constrained decoding utilizing graph structural proximity-based entity informativeness scores for valid and relevant generative retrieval. DialogGSR achieves state-of-the-art performance in knowledge graph-grounded dialog generation, as demonstrated on OpenDialKG and KOMODIS datasets.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 46 of its 67 references that are in the map. First posted on arXiv 12 Oct 2024.

Builds on

46 of 67 references.

References · 46

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2017Graph Attention Networkscited by 8,854
  6. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  7. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  8. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  9. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  10. 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
  11. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  12. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
34 more
  1. 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
  2. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
  3. 2020Autoregressive Entity Retrievalcited by 333
  4. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
  5. 2022Generate rather than Retrieve: Large Language Models are Strong Context Generatorscited by 296
  6. 2020Sparse, Dense, and Attentional Representations for Text Retrievalcited by 213
  7. 2017A Knowledge-Grounded Neural Conversation Modelcited by 136
  8. 2020Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answeringcited by 122
  9. 2022Autoregressive Search Engines: Generating Substrings as Document Identifierscited by 112
  10. 2022A Neural Corpus Indexer for Document Retrievalcited by 107
  11. 2020Transfer Learning of Graph Neural Networks with Ego-graph Information Maximizationcited by 93
  12. 2022Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answeringcited by 93
  13. 2019Evaluating the State-of-the-Art of End-to-End Natural Language Generation: The E2E NLG Challengecited by 86
  14. 2019Learning to Select Knowledge for Response Generation in Dialog Systemscited by 80
  15. 2020JAKET: Joint Pre-training of Knowledge Graph and Language Understandingcited by 73
  16. 2020Knowledge Graph-Augmented Abstractive Summarization with Semantic-Driven Cloze Rewardcited by 66
  17. 2019Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge Graphscited by 59
  18. 2023Knowledge Graph-Augmented Language Models for Knowledge-Grounded Dialogue Generationcited by 54
  19. 2018Structured Neural Summarizationcited by 53
  20. 2020Low-Resource Knowledge-Grounded Dialogue Generationcited by 53
  21. 2022RHO (ρ): Reducing Hallucination in Open-domain Dialogues with Knowledge Groundingcited by 47
  22. 2022GERE: Generative Evidence Retrieval for Fact Verificationcited by 38
  23. 2019Constrained Decoding for Neural NLG from Compositional Representations in Task-Oriented Dialoguecited by 35
  24. 2019DyKgChat: Benchmarking Dialogue Generation Grounding on Dynamic Knowledge Graphscited by 33
  25. 2020A Memory Efficient Baseline for Open Domain Question Answeringcited by 32
  26. 2018Findings of the E2E NLG Challengecited by 28
  27. 2018Extending Neural Generative Conversational Model using External Knowledge Sourcescited by 16
  28. 2019Improving Knowledge-aware Dialogue Generation via Knowledge Base Question Answeringcited by 15
  29. 2023Generative Knowledge Selection for Knowledge-Grounded Dialoguescited by 15
  30. 2022Towards Large-Scale Interpretable Knowledge Graph Reasoning for Dialogue Systemscited by 10
  31. 2023An Investigation of LLMs' Inefficacy in Understanding Converse Relationscited by 9
  32. 2020A Corpus of Controlled Opinionated and Knowledgeable Movie Discussions for Training Neural Conversation Modelscited by 8
  33. 2022Relation-Aware Language-Graph Transformer for Question Answeringcited by 7
  34. 2022Data-Efficient Autoregressive Document Retrieval for Fact Verificationcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 3.

6 papers.