Prediction, Selection, and Generation: Exploration of Knowledge-Driven Conversation System
Not on the map. Why?
Abstract (arXiv)
In open-domain conversational systems, it is important but challenging to leverage background knowledge. We can use the incorporation of knowledge to make the generation of dialogue controllable, and can generate more diverse sentences that contain real knowledge. In this paper, we combine the knowledge bases and pre-training model to propose a knowledge-driven conversation system. The system includes modules such as dialogue topic prediction, knowledge matching and dialogue generation. Based on this system, we study the performance factors that maybe affect the generation of knowledge-driven dialogue: topic coarse recall algorithm, number of knowledge choices, generation model choices, etc., and finally made the system reach state-of-the-art. These experimental results will provide some guiding significance for the future research of this task. As far as we know, this is the first work to study and analyze the effects of the related factors.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 34 references that are in the map. First posted on arXiv 23 Apr 2021.
Builds on
26 of 34 references.
References · 26
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,077
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 528
- 2020ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-trainingcited by 222
- 2019Multi-Stage Document Ranking with BERTcited by 201
- 2015A Neural Conversational Modelcited by 196
- 2017A Knowledge-Grounded Neural Conversation Modelcited by 136
- 2020Towards Conversational Recommendation over Multi-Type Dialogscited by 107
14 more
- 2020A Large-Scale Chinese Short-Text Conversation Datasetcited by 77
- 2020Interactive Path Reasoning on Graph for Conversational Recommendationcited by 72
- 2020KdConv: A Chinese Multi-domain Dialogue Dataset Towards Multi-turn Knowledge-driven Conversationcited by 59
- 2016A Simple, Fast Diverse Decoding Algorithm for Neural Generationcited by 58
- 2018Knowledgeable Reader: Enhancing Cloze-Style Reading Comprehension with External Commonsense Knowledgecited by 48
- 2020GLGE: A New General Language Generation Evaluation Benchmarkcited by 47
- 2017Neural Natural Language Inference Models Enhanced with External Knowledgecited by 40
- 2020PiRhDy: Learning Pitch-, Rhythm-, and Dynamics-aware Embeddings for Symbolic Musiccited by 24
- 2018Explicit State Tracking with Semi-Supervision for Neural Dialogue Generationcited by 17
- 2020Difference-aware Knowledge Selection for Knowledge-grounded Conversation Generationcited by 14
- 2020Let's be Humorous: Knowledge Enhanced Humor Generationcited by 10
- 2019Generating Multiple Diverse Responses with Multi-Mapping and Posterior Mapping Selectioncited by 8
- 2020Diverse, Controllable, and Keyphrase-Aware: A Corpus and Method for News Multi-Headline Generationcited by 8
- 2020Generalized Relation Learning with Semantic Correlation Awareness for Link Predictioncited by 6
Built on by
Not cited yet.