mlsanityData to 14 Oct 2026

Prediction, Selection, and Generation: Exploration of Knowledge-Driven Conversation System

arXiv 2104.11454 ↗First posted 23 Apr 2021cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

In open-domain conversational systems, it is important but challenging to leverage background knowledge. We can use the incorporation of knowledge to make the generation of dialogue controllable, and can generate more diverse sentences that contain real knowledge. In this paper, we combine the knowledge bases and pre-training model to propose a knowledge-driven conversation system. The system includes modules such as dialogue topic prediction, knowledge matching and dialogue generation. Based on this system, we study the performance factors that maybe affect the generation of knowledge-driven dialogue: topic coarse recall algorithm, number of knowledge choices, generation model choices, etc., and finally made the system reach state-of-the-art. These experimental results will provide some guiding significance for the future research of this task. As far as we know, this is the first work to study and analyze the effects of the related factors.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 34 references that are in the map. First posted on arXiv 23 Apr 2021.

Builds on

26 of 34 references.

References · 26

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2017Decoupled Weight Decay Regularizationcited by 1,831
  5. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,077
  6. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  7. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 528
  8. 2020ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-trainingcited by 222
  9. 2019Multi-Stage Document Ranking with BERTcited by 201
  10. 2015A Neural Conversational Modelcited by 196
  11. 2017A Knowledge-Grounded Neural Conversation Modelcited by 136
  12. 2020Towards Conversational Recommendation over Multi-Type Dialogscited by 107
14 more
  1. 2020A Large-Scale Chinese Short-Text Conversation Datasetcited by 77
  2. 2020Interactive Path Reasoning on Graph for Conversational Recommendationcited by 72
  3. 2020KdConv: A Chinese Multi-domain Dialogue Dataset Towards Multi-turn Knowledge-driven Conversationcited by 59
  4. 2016A Simple, Fast Diverse Decoding Algorithm for Neural Generationcited by 58
  5. 2018Knowledgeable Reader: Enhancing Cloze-Style Reading Comprehension with External Commonsense Knowledgecited by 48
  6. 2020GLGE: A New General Language Generation Evaluation Benchmarkcited by 47
  7. 2017Neural Natural Language Inference Models Enhanced with External Knowledgecited by 40
  8. 2020PiRhDy: Learning Pitch-, Rhythm-, and Dynamics-aware Embeddings for Symbolic Musiccited by 24
  9. 2018Explicit State Tracking with Semi-Supervision for Neural Dialogue Generationcited by 17
  10. 2020Difference-aware Knowledge Selection for Knowledge-grounded Conversation Generationcited by 14
  11. 2020Let's be Humorous: Knowledge Enhanced Humor Generationcited by 10
  12. 2019Generating Multiple Diverse Responses with Multi-Mapping and Posterior Mapping Selectioncited by 8
  13. 2020Diverse, Controllable, and Keyphrase-Aware: A Corpus and Method for News Multi-Headline Generationcited by 8
  14. 2020Generalized Relation Learning with Semantic Correlation Awareness for Link Predictioncited by 6

Built on by

Not cited yet.