Topic-switch adapted Japanese Dialogue System based on PLATO-2
Not on the map. Why?
Abstract (arXiv)
Large-scale open-domain dialogue systems such as PLATO-2 have achieved state-of-the-art scores in both English and Chinese. However, little work explores whether such dialogue systems also work well in the Japanese language. In this work, we create a large-scale Japanese dialogue dataset, Dialogue-Graph, which contains 1.656 million dialogue data in a tree structure from News, TV subtitles, and Wikipedia corpus. Then, we train PLATO-2 using Dialogue-Graph to build a large-scale Japanese dialogue system, PLATO-JDS. In addition, to improve the PLATO-JDS in the topic switch issue, we introduce a topic-switch algorithm composed of a topic discriminator to switch to a new topic when user input differs from the previous topic. We evaluate the user experience by using our model with respect to four metrics, namely, coherence, informativeness, engagingness, and humanness. As a result, our proposed PLATO-JDS achieves an average score of 1.500 for the human evaluation with human-bot chat strategy, which is close to the maximum score of 2.000 and suggests the high-quality dialogue generation capability of PLATO-2 in Japanese. Furthermore, our proposed topic-switch algorithm achieves an average score of 1.767 and outperforms PLATO-JDS by 0.267, indicating its effectiveness in improving the user experience of our system.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 30 references that are in the map. First posted on arXiv 22 Feb 2023.
Builds on
24 of 30 references.
References · 24
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
- 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
- 2020Towards a Human-like Open-Domain Chatbotcited by 467
- 2016Deep Reinforcement Learning for Dialogue Generationcited by 286
- 2019TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agentscited by 188
12 more
- 2019PLATO: Pre-trained Dialogue Generation Model with Discrete Latent Variablecited by 145
- 2020Sequential Latent Knowledge Selection for Knowledge-Grounded Dialoguecited by 82
- 2020PLATO-2: Towards Building an Open-Domain Chatbot via Curriculum Learningcited by 79
- 2020Topic-Aware Multi-turn Dialogue Modelingcited by 46
- 2020Controlling Style in Generated Dialoguecited by 38
- 2021PLATO-XL: Exploring the Large-scale Pre-training of Dialogue Generationcited by 37
- 2021EVA: An Open-Domain Chinese Dialogue System with Large-Scale Generative Pre-Trainingcited by 34
- 2022Building a Role Specified Open-Domain Dialogue System Leveraging Large-Scale Language Modelscited by 26
- 2021Empirical Analysis of Training Strategies of Transformer-based Japanese Chit-chat Systemscited by 19
- 2020Designing the Business Conversation Corpuscited by 14
- 2021SideControl: Controlled Open-domain Dialogue Generation via Additive Side Networkscited by 5
- 2019Building chatbots from large scale domain-specific knowledge bases: challenges and opportunitiescited by 3
Built on by
Not cited yet.