A Dataset for Document Grounded Conversations
Not on the map. Why?
Abstract (arXiv)
This paper introduces a document grounded dataset for text conversations. We define "Document Grounded Conversations" as conversations that are about the contents of a specified document. In this dataset the specified documents were Wikipedia articles about popular movies. The dataset contains 4112 conversations with an average of 21.43 turns per conversation. This positions this dataset to not only provide a relevant chat history while generating responses but also provide a source of information that the models could use. We describe two neural architectures that provide benchmark performance on the task of generating the next response. We also evaluate our models for engagement and fluency, and find that the information from the document helps in generating more engaging and fluent responses.
Key facts. Cited by 104 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 36; 2023: 21; 2024: 15; 2025: 6; 2026: 2.
104 papers.
Sort:
By area:
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
- 2021Internet-Augmented Dialogue Generationcited by 217
- 2022A Survey on Retrieval-Augmented Text Generationcited by 157
- 2022On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models?cited by 137
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2022FaithDial: A Faithful Benchmark for Information-Seeking Dialoguecited by 108
- 2023Topical-Chat: Towards Knowledge-Grounded Open-Domain Conversationscited by 88
- 2022A Survey of Knowledge Enhanced Pre-trained Language Modelscited by 76
- 2021Evaluating Attribution in Dialogue Systems: The BEGIN Benchmarkcited by 75
- 2022MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversationcited by 56
- 2022Read before Generate! Faithful Long Form Question Answering with Machine Readingcited by 47
38 more
- 2021Grounding 'Grounding' in NLPcited by 44
- 2024Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversationcited by 40
- 2021Hindsight: Posterior-guided training of retrievers for improved open-ended generationcited by 38
- 2021NaturalConv: A Chinese Dialogue Dataset Towards Multi-turn Topic-driven Conversationcited by 35
- 2022SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generationcited by 34
- 2023Opportunities and Challenges in Neural Dialog Tutoringcited by 33
- 2021Reason first, then respond: Modular Generation for Knowledge-infused Dialoguecited by 32
- 2021Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representationcited by 32
- 2021Call for Customized Conversation: Customized Conversation Grounding Persona and Knowledgecited by 30
- 2022HybriDialogue: An Information-Seeking Dialogue Dataset Grounded on Tabular and Textual Datacited by 28
- 2022SPACE-2: Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understandingcited by 28
- 2022INSCIT: Information-Seeking Conversations with Mixed-Initiative Interactionscited by 27
- 2021Focused Attention Improves Document-Grounded Generationcited by 24
- 2024Jill Watson: A Virtual Teaching Assistant powered by ChatGPTcited by 24
- 2021Retrieval-Free Knowledge-Grounded Dialogue Response Generation with Adapterscited by 23
- 2021RetGen: A Joint framework for Retrieval and Grounded Text Generation Modelingcited by 22
- 2021Am I Me or You? State-of-the-Art Dialogue Models Cannot Maintain an Identitycited by 22
- 2022Multi-Stage Prompting for Knowledgeable Dialogue Generationcited by 22
- 2024Adaptive Retrieval-Augmented Generation for Conversational Systemscited by 22
- 2021DIALKI: Knowledge Identification in Conversational Systems through Dialogue-Document Contextualizationcited by 21
- 2021Exploring Prompt-based Few-shot Learning for Grounded Dialog Generationcited by 20
- 2021A Three-Stage Learning Framework for Low-Resource Knowledge-Grounded Dialogue Generationcited by 19
- 2023Improving Factual Consistency for Knowledge-Grounded Dialogue Systems via Knowledge Enhancement and Alignmentcited by 19
- 2021Thinking Clearly, Talking Fast: Concept-Guided Non-Autoregressive Generation for Open-Domain Dialogue Systemscited by 17
- 2022There Are a Thousand Hamlets in a Thousand People's Eyes: Enhancing Knowledge-grounded Dialogue with Personal Memorycited by 16
- 2022MVP: Multi-task Supervised Pre-training for Natural Language Generationcited by 16
- 2023Generative Knowledge Selection for Knowledge-Grounded Dialoguescited by 15
- 2024Improving Model Factuality with Fine-grained Critique-based Evaluatorcited by 15
- 2022PCC: Paraphrasing with Bottom-k Sampling and Cyclic Learning for Curriculum Data Augmentationcited by 14
- 2022Enhanced Knowledge Selection for Grounded Dialogues via Document Semantic Graphscited by 11
- 2023Pointwise Mutual Information Based Metric and Decoding Strategy for Faithful Generation in Document Grounded Dialogscited by 11
- 2021Content Selection Network for Document-grounded Retrieval-based Chatbotscited by 10
- 2022Eliciting Knowledge from Large Pre-Trained Models for Unsupervised Knowledge-Grounded Conversationcited by 10
- 2023SuperDialseg: A Large-scale Dataset for Supervised Dialogue Segmentationcited by 10
- 2023Overview of Robust and Multilingual Automatic Evaluation Metrics for Open-Domain Dialogue Systems at DSTC 11 Track 4cited by 10
- 2022CALCS 2021 Shared Task: Machine Translation for Code-Switched Datacited by 9
- 2022TegTok: Augmenting Text Generation via Task-specific and Open-world Knowledgecited by 9
- 2023textitDial BeInfo for Faithfulness: Improving Factuality of Information-Seeking Dialogue via Behavioural Fine-Tuningcited by 9
50 most cited of 104 All 104 (JSON)
- 2026TalkFa: A Unified Benchmark for Farsi Dialogue Generation and Understanding1 Sep 2026
- 2026When Misinformation Speaks and Converses: Rethinking Fact-Checking in Audio Platforms18 Apr 2026
- 2025FedDTRE: Federated Dialogue Generation Models Powered by Trustworthiness Evaluation9 Oct 2025
- 2025Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems26 Sep 2025
- 2025Attribution, Citation, and Quotation: A Survey of Evidence-based Text Generation with Large Language Models21 Aug 2025
- 2025Evaluating Evaluation Metrics -- The Mirage of Hallucination Detection25 Apr 2025
- 2025Grammar Control in Dialogue Response Generation for Language Learning Chatbots11 Feb 2025
- 2025Through the Prism of Culture: Evaluating LLMs' Understanding of Indian Subcultures and Traditions28 Jan 2025
- 2024Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey14 Nov 2024
- 2024Improving Model Factuality with Fine-grained Critique-based Evaluator24 Oct 2024
- 2024Policy-driven Knowledge Selection and Response Generation for Document-grounded Dialogue21 Oct 2024
- 2024Mitigating the Negative Impact of Over-association for Conversational Query Production29 Sep 2024
38 more
- 2024Adaptive Retrieval-Augmented Generation for Conversational Systems31 Jul 2024
- 2024TransferTOD: A Generalizable Chinese Multi-Domain Task-Oriented Dialogue System with Transfer Capabilities31 Jul 2024
- 2024Enhancing Hallucination Detection through Perturbation-Based Synthetic Data Generation in System Responses7 Jul 2024
- 2024DIEKAE: Difference Injection for Efficient Knowledge Augmentation and Editing of Large Language Models15 Jun 2024
- 2024Detecting Response Generation Not Requiring Factual Judgment14 Jun 2024
- 2024Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversation12 Jun 2024
- 2024Should We Fine-Tune or RAG? Evaluating Different Techniques to Adapt LLMs for Dialogue10 Jun 2024
- 2024Jill Watson: A Virtual Teaching Assistant powered by ChatGPT17 May 2024
- 2024R4: Reinforced Retriever-Reorder-Responder for Retrieval-Augmented Large Language Models4 May 2024
- 2024Empowering Air Travelers: A Chatbot for Canadian Air Passenger Rights19 Mar 2024
- 2024Investigating Content Planning for Navigating Trade-offs in Knowledge-Grounded Dialogue3 Feb 2024
- 2023textitDial BeInfo for Faithfulness: Improving Factuality of Information-Seeking Dialogue via Behavioural Fine-Tuning16 Nov 2023
- 2023Sequence-Level Certainty Reduces Hallucination In Knowledge-Grounded Dialogue Generation28 Oct 2023
- 2023Multi-Stage Pre-training Enhanced by ChatGPT for Multi-Scenario Multi-Domain Dialogue Summarization16 Oct 2023
- 2023Multi-level Adaptive Contrastive Learning for Knowledge Internalization in Dialogue Generation13 Oct 2023
- 2023Improving Factual Consistency for Knowledge-Grounded Dialogue Systems via Knowledge Enhancement and Alignment12 Oct 2023
- 2023UniPCM: Universal Pre-trained Conversation Model with Task-aware Automatic Prompt20 Sep 2023
- 2023Topical-Chat: Towards Knowledge-Grounded Open-Domain Conversations23 Aug 2023
- 2023NewsDialogues: Towards Proactive News Grounded Conversation12 Aug 2023
- 2023Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systems14 Jul 2023
- 2023Advancements in Scientific Controllable Text Generation Methods8 Jul 2023
- 2023KnowPrefix-Tuning: A Two-Stage Prefix-Tuning Framework for Knowledge-Grounded Dialogue Generation27 Jun 2023
- 2023Overview of Robust and Multilingual Automatic Evaluation Metrics for Open-Domain Dialogue Systems at DSTC 11 Track 422 Jun 2023
- 2023Contextual Knowledge Learning For Dialogue Generation29 May 2023
- 2023Cross-lingual Data Augmentation for Document-grounded Dialog Systems in Low Resource Languages24 May 2023
- 2023Pointwise Mutual Information Based Metric and Decoding Strategy for Faithful Generation in Document Grounded Dialogs20 May 2023
- 2023"What do others think?": Task-Oriented Conversational Modeling with Subjective Knowledge20 May 2023
- 2023SuperDialseg: A Large-scale Dataset for Supervised Dialogue Segmentation15 May 2023
- 2023Generative Knowledge Selection for Knowledge-Grounded Dialogues10 Apr 2023
- 2023Search-Engine-augmented Dialogue Response Generation with Cheaply Supervised Query Production16 Feb 2023
- 2023Opportunities and Challenges in Neural Dialog Tutoring24 Jan 2023
- 2023Opening up Minds with Argumentative Dialogues16 Jan 2023
- 2022A Survey on Knowledge-Enhanced Pre-trained Language Models27 Dec 2022
- 2022Query Enhanced Knowledge-Intensive Conversation via Unsupervised Joint Modeling19 Dec 2022
- 2022Mind the Knowledge Gap: A Survey of Knowledge-enhanced Dialogue Systems19 Dec 2022
- 2022A Survey of Knowledge Enhanced Pre-trained Language Models11 Nov 2022
- 2022MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversation10 Nov 2022
- 2022Eliciting Knowledge from Large Pre-Trained Models for Unsupervised Knowledge-Grounded Conversation3 Nov 2022
50 newest of 104 All 104 (JSON)
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
- 2021Internet-Augmented Dialogue Generationcited by 217
- 2022On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models?cited by 137
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2022FaithDial: A Faithful Benchmark for Information-Seeking Dialoguecited by 108
- 2023Topical-Chat: Towards Knowledge-Grounded Open-Domain Conversationscited by 88
- 2022A Survey of Knowledge Enhanced Pre-trained Language Modelscited by 76
- 2021Evaluating Attribution in Dialogue Systems: The BEGIN Benchmarkcited by 75
- 2022MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversationcited by 56
- 2022Read before Generate! Faithful Long Form Question Answering with Machine Readingcited by 47
- 2021Grounding 'Grounding' in NLPcited by 44
12 most cited of 98 All 98 (JSON)
- 2026TalkFa: A Unified Benchmark for Farsi Dialogue Generation and Understanding1 Sep 2026
- 2026When Misinformation Speaks and Converses: Rethinking Fact-Checking in Audio Platforms18 Apr 2026
- 2025FedDTRE: Federated Dialogue Generation Models Powered by Trustworthiness Evaluation9 Oct 2025
- 2025Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems26 Sep 2025
- 2025Attribution, Citation, and Quotation: A Survey of Evidence-based Text Generation with Large Language Models21 Aug 2025
- 2025Evaluating Evaluation Metrics -- The Mirage of Hallucination Detection25 Apr 2025
- 2025Grammar Control in Dialogue Response Generation for Language Learning Chatbots11 Feb 2025
- 2025Through the Prism of Culture: Evaluating LLMs' Understanding of Indian Subcultures and Traditions28 Jan 2025
- 2024Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey14 Nov 2024
- 2024Improving Model Factuality with Fine-grained Critique-based Evaluator24 Oct 2024
- 2024Policy-driven Knowledge Selection and Response Generation for Document-grounded Dialogue21 Oct 2024
- 2024Mitigating the Negative Impact of Over-association for Conversational Query Production29 Sep 2024
12 newest of 98 All 98 (JSON)