Unified Conversational Models with System-Initiated Transitions between Chit-Chat and Task-Oriented Dialogues
Not on the map. Why?
Abstract (arXiv)
Spoken dialogue systems (SDSs) have been separately developed under two different categories, task-oriented and chit-chat. The former focuses on achieving functional goals and the latter aims at creating engaging social conversations without special goals. Creating a unified conversational model that can engage in both chit-chat and task-oriented dialogue is a promising research topic in recent years. However, the potential ``initiative'' that occurs when there is a change between dialogue modes in one dialogue has rarely been explored. In this work, we investigate two kinds of dialogue scenarios, one starts from chit-chat implicitly involving task-related topics and finally switching to task-oriented requests; the other starts from task-oriented interaction and eventually changes to casual chat after all requested information is provided. We contribute two efficient prompt models which can proactively generate a transition sentence to trigger system-initiated transitions in a unified dialogue model. One is a discrete prompt model trained with two discrete tokens, the other one is a continuous prompt model using continuous prompt embeddings automatically generated by a classifier. We furthermore show that the continuous prompt model can also be used to guide the proactive transitions between particular domains in a multi-domain task-oriented setting.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 22 of its 41 references that are in the map. First posted on arXiv 4 Jul 2023.
Builds on
22 of 41 references.
References · 22
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
- 2021GPT Understands, Toocited by 715
- 2019Leveraging Pre-trained Checkpoints for Sequence Generation Taskscited by 182
- 2021MultiWOZ 2.4: A Multi-Domain Task-Oriented Dialogue Dataset with Essential Annotation Corrections to Improve State Tracking Evaluationcited by 86
- 2022Personalized Prompt Learning for Explainable Recommendationcited by 79
10 more
- 2020Adding Chit-Chat to Enhance Task-Oriented Dialoguescited by 48
- 2019The Dialogue Dodecathlon: Open-Domain Knowledge and Image Grounded Conversational Agentscited by 45
- 2020The Adapter-Bot: All-In-One Controllable Conversational Modelcited by 38
- 2021OTTers: One-turn Topic Transitions for Open-Domain Dialoguecited by 29
- 2021Fusing task-oriented and open-domain dialogues in conversational agentscited by 28
- 2021AUGNLG: Few-shot Natural Language Generation using Self-trained Data Augmentationcited by 17
- 2022SalesBot: Transitioning from Chit-Chat to Task-Oriented Dialoguescited by 16
- 2017Generative Encoder-Decoder Models for Task-Oriented Spoken Dialog Systems with Chatting Capabilitycited by 14
- 2021UniDS: A Unified Dialogue System for Chit-Chat and Task-oriented Dialoguescited by 12
- 2021Empathetic Dialogue Generation with Pre-trained RoBERTa-GPT2 and External Knowledgecited by 8
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 1.
2 papers.