Knowledge-Grounded Dialogue Generation with Pre-trained Language Models
Not on the map. Why?
Abstract (arXiv)
We study knowledge-grounded dialogue generation with pre-trained language models. To leverage the redundant external knowledge under capacity constraint, we propose equipping response generation defined by a pre-trained language model with a knowledge selection module, and an unsupervised approach to jointly optimizing knowledge selection and response generation with unlabeled dialogues. Empirical results on two benchmarks indicate that our model can significantly outperform state-of-the-art methods in both automatic evaluation and human judgment.
Key facts. Cited by 107 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 21; 2022: 38; 2023: 31; 2024: 13; 2025: 4.
107 papers.
Sort:
By area:
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
- 2021Internet-Augmented Dialogue Generationcited by 217
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2022FaithDial: A Faithful Benchmark for Information-Seeking Dialoguecited by 108
- 2021Pretrained Language Models for Text Generation: A Surveycited by 95
- 2021Language Models are Few-shot Multilingual Learnerscited by 92
- 2024Beyond Turn-Based Interfaces: Synchronous LLMs as Full-Duplex Dialogue Agentscited by 69
- 2022RHO (ρ): Reducing Hallucination in Open-domain Dialogues with Knowledge Groundingcited by 47
- 2022Contrastive Learning Reduces Hallucination in Conversationscited by 39
- 2021Efficient Retrieval Augmented Generation from Unstructured Knowledge for Task-Oriented Dialogcited by 33
38 more
- 2021Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representationcited by 32
- 2022Summarization as Indirect Supervision for Relation Extractioncited by 31
- 2021Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generationcited by 26
- 2023Large Language Models are Strong Zero-Shot Retrievercited by 25
- 2021Focused Attention Improves Document-Grounded Generationcited by 24
- 2021Retrieval-Free Knowledge-Grounded Dialogue Response Generation with Adapterscited by 23
- 2021RetGen: A Joint framework for Retrieval and Grounded Text Generation Modelingcited by 22
- 2022Multi-Stage Prompting for Knowledgeable Dialogue Generationcited by 22
- 2024Adaptive Retrieval-Augmented Generation for Conversational Systemscited by 22
- 2021DIALKI: Knowledge Identification in Conversational Systems through Dialogue-Document Contextualizationcited by 21
- 2022Open-world Story Generation with Structured Knowledge Enhancement: A Comprehensive Surveycited by 21
- 2021Maria: A Visual Experience Powered Conversational Agentcited by 19
- 2021A Three-Stage Learning Framework for Low-Resource Knowledge-Grounded Dialogue Generationcited by 19
- 2021End-to-End Learning of Flowchart Grounded Task-Oriented Dialogscited by 19
- 2021OpenViDial 2.0: A Larger-Scale, Open-Domain Dialogue Generation Dataset with Visual Contextscited by 16
- 2022There Are a Thousand Hamlets in a Thousand People's Eyes: Enhancing Knowledge-grounded Dialogue with Personal Memorycited by 16
- 2023Enhancing Dialogue Generation via Dynamic Graph Knowledge Aggregationcited by 16
- 2023Generative Knowledge Selection for Knowledge-Grounded Dialoguescited by 15
- 2021Knowledge Enhanced Fine-Tuning for Better Handling Unseen Entities in Dialogue Generationcited by 13
- 2022BotsTalk: Machine-sourced Framework for Automatic Curation of Large-scale Multi-skill Dialogue Datasetscited by 13
- 2022Multi-hop Evidence Retrieval for Cross-document Relation Extractioncited by 13
- 2022Knowledge Infused Decodingcited by 12
- 2022Enhanced Knowledge Selection for Grounded Dialogues via Document Semantic Graphscited by 11
- 2023Think Before You Speak: Cultivating Communication Skills of Large Language Models via Inner Monologuecited by 11
- 2022Eliciting Knowledge from Large Pre-Trained Models for Unsupervised Knowledge-Grounded Conversationcited by 10
- 2022PanGu-Bot: Efficient Generative Dialogue Pre-training from Pre-trained Language Modelcited by 9
- 2023GLM-Dialog: Noise-tolerant Pre-training for Knowledge-grounded Dialogue Generationcited by 9
- 2023DialoGPS: Dialogue Path Sampling in Continuous Semantic Space for Data Augmentation in Multi-Turn Conversationscited by 9
- 2022Commonsense and Named Entity Aware Knowledge Grounded Dialogue Generationcited by 8
- 2022Target-Guided Open-Domain Conversation Planningcited by 8
- 2023Opening up Minds with Argumentative Dialoguescited by 8
- 2022LARD: Large-scale Artificial Disfluency Generationcited by 7
- 2024Are LLMs Robust for Spoken Dialogues?cited by 7
- 2024Harnessing Business and Media Insights with Large Language Modelscited by 7
- 2024Script-Strategy Aligned Generation: Aligning LLMs with Expert-Crafted Dialogue Scripts and Therapeutic Strategies for Psychotherapycited by 7
- 2021Towards Standard Criteria for human evaluation of Chatbots: A Surveycited by 6
- 2023Coarse-to-Fine Knowledge Selection for Document Grounded Dialogscited by 6
- 2023Response Generation in Longitudinal Dialogues: Which Knowledge Representation Helps?cited by 6
50 most cited of 107 All 107 (JSON)
- 2025Breaking the Trade-Off Between Faithfulness and Expressiveness for Large Language Models26 Aug 2025
- 2025KGRAG-Ex: Explainable Retrieval-Augmented Generation with Knowledge Graph-based Perturbations11 Jul 2025
- 2025Entriever: Energy-based Retriever for Knowledge-Grounded Dialog Systems31 May 2025
- 2025CPTuning: Contrastive Prompt Tuning for Generative Relation Extraction4 Jan 2025
- 2024Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey14 Nov 2024
- 2024Script-Strategy Aligned Generation: Aligning LLMs with Expert-Crafted Dialogue Scripts and Therapeutic Strategies for Psychotherapy11 Nov 2024
- 2024Policy-driven Knowledge Selection and Response Generation for Document-grounded Dialogue21 Oct 2024
- 2024Beyond Turn-Based Interfaces: Synchronous LLMs as Full-Duplex Dialogue Agents23 Sep 2024
- 2024Adaptive Retrieval-Augmented Generation for Conversational Systems31 Jul 2024
- 2024A Factuality and Diversity Reconciled Decoding Method for Knowledge-Grounded Dialogue Generation8 Jul 2024
- 2024On the Transformations across Reward Model, Parameter Update, and In-Context Prompt24 Jun 2024
- 2024Harnessing Business and Media Insights with Large Language Models2 Jun 2024
38 more
- 2024R4: Reinforced Retriever-Reorder-Responder for Retrieval-Augmented Large Language Models4 May 2024
- 2024CET2: Modelling Topic Transitions for Coherent and Engaging Knowledge-Grounded Conversations4 Mar 2024
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems28 Feb 2024
- 2024UniRQR: A Unified Model for Retrieval Decision, Query, and Response Generation in Internet-Based Knowledge Dialogue Systems11 Jan 2024
- 2024Are LLMs Robust for Spoken Dialogues?4 Jan 2024
- 2023K-ESConv: Knowledge Injection for Emotional Support Dialogue Systems via Prompt Learning16 Dec 2023
- 2023Graph vs. Sequence: An Empirical Study on Knowledge Forms for Knowledge-Grounded Dialogue13 Dec 2023
- 2023Multi-Step Dialogue Workflow Action Prediction16 Nov 2023
- 2023Think Before You Speak: Cultivating Communication Skills of Large Language Models via Inner Monologue13 Nov 2023
- 2023Blending Reward Functions via Few Expert Demonstrations for Faithful and Accurate Knowledge-Grounded Dialogue Generation2 Nov 2023
- 2023Retrieval-Augmented Neural Response Generation Using Logical Reasoning and Relevance Scoring20 Oct 2023
- 2023Who Are All The Stochastic Parrots Imitating? They Should Tell Us!16 Oct 2023
- 2023Well Begun is Half Done: Generator-agnostic Knowledge Pre-Selection for Knowledge-Grounded Dialogue11 Oct 2023
- 2023Hexa: Self-Improving for Knowledge-Grounded Dialogue System10 Oct 2023
- 2023PICK: Polished & Informed Candidate Scoring for Knowledge-Grounded Dialogue Systems19 Sep 2023
- 2023Hi Model, generating 'nice' instead of 'good' is not as bad as generating 'rice'! Towards Context and Semantic Infused Dialogue Generation Loss Function and Evaluation Metric11 Sep 2023
- 2023Advancing Relation Extraction through Language Probing with Exemplars from Set Co-Expansion18 Aug 2023
- 2023Generating Faithful Text From a Knowledge Graph with Noisy Reference Text12 Aug 2023
- 2023Neural Conversation Models and How to Rein Them in: A Survey of Failures and Fixes11 Aug 2023
- 2023DialoGPS: Dialogue Path Sampling in Continuous Semantic Space for Data Augmentation in Multi-Turn Conversations29 Jun 2023
- 2023Enhancing Dialogue Generation via Dynamic Graph Knowledge Aggregation28 Jun 2023
- 2023KnowPrefix-Tuning: A Two-Stage Prefix-Tuning Framework for Knowledge-Grounded Dialogue Generation27 Jun 2023
- 2023Diverse and Faithful Knowledge-Grounded Dialogue Generation via Sequential Posterior Inference1 Jun 2023
- 2023Contextual Knowledge Learning For Dialogue Generation29 May 2023
- 2023Response Generation in Longitudinal Dialogues: Which Knowledge Representation Helps?25 May 2023
- 2023i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data21 May 2023
- 2023Large Language Models are Strong Zero-Shot Retriever27 Apr 2023
- 2023Generative Knowledge Selection for Knowledge-Grounded Dialogues10 Apr 2023
- 2023Multi-View Zero-Shot Open Intent Induction from Dialogues: Multi Domain Batch and Proxy Gradient Transfer23 Mar 2023
- 2023GLM-Dialog: Noise-tolerant Pre-training for Knowledge-grounded Dialogue Generation28 Feb 2023
- 2023Coarse-to-Fine Knowledge Selection for Document Grounded Dialogs23 Feb 2023
- 2023Search-Engine-augmented Dialogue Response Generation with Cheaply Supervised Query Production16 Feb 2023
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity8 Feb 2023
- 2023GE-Blender: Graph-Based Knowledge Enhancement for Blender30 Jan 2023
- 2023Opening up Minds with Argumentative Dialogues16 Jan 2023
- 2023Channel-aware Decoupling Network for Multi-turn Dialogue Comprehension10 Jan 2023
- 2022A Survey on Knowledge-Enhanced Pre-trained Language Models27 Dec 2022
- 2022Multi-hop Evidence Retrieval for Cross-document Relation Extraction21 Dec 2022
50 newest of 107 All 107 (JSON)
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
- 2023Think Before You Speak: Cultivating Communication Skills of Large Language Models via Inner Monologuecited by 11
- 2022Collaborative Reasoning on Multi-Modal Semantic Graphs for Video-Grounded Dialogue Generationcited by 3
- 2023Retrieval-Augmented Neural Response Generation Using Logical Reasoning and Relevance Scoringcited by 1
- 2023Think Before You Speak: Cultivating Communication Skills of Large Language Models via Inner Monologue13 Nov 2023
- 2023Retrieval-Augmented Neural Response Generation Using Logical Reasoning and Relevance Scoring20 Oct 2023
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity8 Feb 2023
- 2022Collaborative Reasoning on Multi-Modal Semantic Graphs for Video-Grounded Dialogue Generation22 Oct 2022
- 2021Efficient Retrieval Augmented Generation from Unstructured Knowledge for Task-Oriented Dialogcited by 33
- 2024Adaptive Retrieval-Augmented Generation for Conversational Systemscited by 22
- 2025KGRAG-Ex: Explainable Retrieval-Augmented Generation with Knowledge Graph-based Perturbationscited by 4
- 2024R4: Reinforced Retriever-Reorder-Responder for Retrieval-Augmented Large Language Modelscited by 1
- 2025KGRAG-Ex: Explainable Retrieval-Augmented Generation with Knowledge Graph-based Perturbations11 Jul 2025
- 2024Adaptive Retrieval-Augmented Generation for Conversational Systems31 Jul 2024
- 2024R4: Reinforced Retriever-Reorder-Responder for Retrieval-Augmented Large Language Models4 May 2024
- 2021Efficient Retrieval Augmented Generation from Unstructured Knowledge for Task-Oriented Dialog9 Feb 2021
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
- 2021Internet-Augmented Dialogue Generationcited by 217
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2022FaithDial: A Faithful Benchmark for Information-Seeking Dialoguecited by 108
- 2021Pretrained Language Models for Text Generation: A Surveycited by 95
- 2021Language Models are Few-shot Multilingual Learnerscited by 92
- 2022RHO (ρ): Reducing Hallucination in Open-domain Dialogues with Knowledge Groundingcited by 47
- 2022Contrastive Learning Reduces Hallucination in Conversationscited by 39
- 2021Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representationcited by 32
- 2022Summarization as Indirect Supervision for Relation Extractioncited by 31
- 2021Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generationcited by 26
12 most cited of 95 All 95 (JSON)
- 2025Breaking the Trade-Off Between Faithfulness and Expressiveness for Large Language Models26 Aug 2025
- 2025Entriever: Energy-based Retriever for Knowledge-Grounded Dialog Systems31 May 2025
- 2025CPTuning: Contrastive Prompt Tuning for Generative Relation Extraction4 Jan 2025
- 2024Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey14 Nov 2024
- 2024Script-Strategy Aligned Generation: Aligning LLMs with Expert-Crafted Dialogue Scripts and Therapeutic Strategies for Psychotherapy11 Nov 2024
- 2024Policy-driven Knowledge Selection and Response Generation for Document-grounded Dialogue21 Oct 2024
- 2024A Factuality and Diversity Reconciled Decoding Method for Knowledge-Grounded Dialogue Generation8 Jul 2024
- 2024Harnessing Business and Media Insights with Large Language Models2 Jun 2024
- 2024CET2: Modelling Topic Transitions for Coherent and Engaging Knowledge-Grounded Conversations4 Mar 2024
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems28 Feb 2024
- 2024UniRQR: A Unified Model for Retrieval Decision, Query, and Response Generation in Internet-Based Knowledge Dialogue Systems11 Jan 2024
- 2024Are LLMs Robust for Spoken Dialogues?4 Jan 2024
12 newest of 95 All 95 (JSON)