A Dual Prompt Learning Framework for Few-Shot Dialogue State Tracking
Not on the map. Why?
Abstract (arXiv)
Dialogue state tracking (DST) module is an important component for task-oriented dialog systems to understand users' goals and needs. Collecting dialogue state labels including slots and values can be costly, especially with the wide application of dialogue systems in more and more new-rising domains. In this paper, we focus on how to utilize the language understanding and generation ability of pre-trained language models for DST. We design a dual prompt learning framework for few-shot DST. Specifically, we consider the learning of slot generation and value generation as dual tasks, and two prompts are designed based on such a dual structure to incorporate task-related knowledge of these two tasks respectively. In this way, the DST task can be formulated as a language modeling task efficiently under few-shot settings. Experimental results on two task-oriented dialogue datasets show that the proposed method not only outperforms existing state-of-the-art few-shot methods, but also can generate unseen slots. It indicates that DST-related knowledge can be probed from PLM and utilized to address low-resource DST efficiently with the help of prompt learning.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 34 of its 46 references that are in the map. First posted on arXiv 15 Jan 2022.
Builds on
34 of 46 references.
References · 34
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
- 2019How Can We Know What Language Models Know?cited by 953
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
- 2021GPT Understands, Toocited by 715
- 2016Self-critical Sequence Training for Image Captioningcited by 544
- 2019Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Datasetcited by 426
- 2020A Simple Language Model for Task-Oriented Dialoguecited by 331
- 2016A Network-based End-to-End Trainable Task-oriented Dialogue Systemcited by 252
22 more
- 2019Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systemscited by 215
- 2021How Many Data Points is a Prompt Worth?cited by 197
- 2019Commonsense Knowledge Mining from Pretrained Modelscited by 189
- 2020TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialoguecited by 185
- 2021Template-Based Named Entity Recognition Using BARTcited by 153
- 2019Taskmaster-1: Toward a Realistic and Diverse Dialog Datasetcited by 139
- 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
- 2020MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systemscited by 103
- 2021Dialogue State Tracking with a Language Model using Schema-Driven Promptingcited by 94
- 2020Zero-Shot Transfer Learning with Synthesized Data for Multi-Domain Dialogue State Trackingcited by 65
- 2019Dialog State Tracking: A Neural Reading Comprehension Approachcited by 62
- 2021Leveraging Slot Descriptions for Zero-Shot Cross-Domain Dialogue State Trackingcited by 61
- 2021Zero-Shot Dialogue State Tracking via Cross-Task Transfercited by 52
- 2020From Machine Reading Comprehension to Dialogue State Tracking: Bridging the Gapcited by 40
- 2019Multi-domain Dialogue State Tracking as Dynamic Knowledge Graph Enhanced Question Answeringcited by 39
- 2021Zero-shot Generalization in Dialog State Tracking through Generative Question Answeringcited by 33
- 2018Zero-Shot Adaptive Transfer for Conversational Language Understandingcited by 20
- 2021Knowledge-Aware Graph-Enhanced GPT-2 for Dialogue State Trackingcited by 20
- 2020Improving Limited Labeled Dialogue State Tracking with Self-Supervisioncited by 16
- 2021Few Shot Dialogue State Tracking using Meta-learningcited by 16
- 2020C2C-GenDA: Cluster-to-Cluster Generation for Data Augmentation of Slot Fillingcited by 11
- 2020Dialogue State Induction Using Neural Latent Variable Modelscited by 10
Built on by
Citing papers per year: 2023: 3; 2024: 5.
8 papers.
- 2023Prompt Engineering for Healthcare: Methodologies and Applicationscited by 52
- 2024SynthDST: Synthetic Data is All You Need for Few-Shot Dialog State Trackingcited by 17
- 2023PromptAttack: Probing Dialogue State Trackers with Adversarial Promptscited by 6
- 2024Zero-Shot Cross-Domain Dialogue State Tracking via Dual Low-Rank Adaptationcited by 5
- 2024Enhancing Depression-Diagnosis-Oriented Chat with Psychological State Trackingcited by 2
- 2023UNO-DST: Leveraging Unlabelled Data in Zero-Shot Dialogue State Trackingcited by 1
- 2024IncSAR: A Dual Fusion Incremental Learning Framework for SAR Target Recognitioncited by 1
- 2024Intent-driven In-context Learning for Few-shot Dialogue State Trackingcited by 1
- 2024Intent-driven In-context Learning for Few-shot Dialogue State Tracking4 Dec 2024
- 2024IncSAR: A Dual Fusion Incremental Learning Framework for SAR Target Recognition8 Oct 2024
- 2024Zero-Shot Cross-Domain Dialogue State Tracking via Dual Low-Rank Adaptation31 Jul 2024
- 2024Enhancing Depression-Diagnosis-Oriented Chat with Psychological State Tracking12 Mar 2024
- 2024SynthDST: Synthetic Data is All You Need for Few-Shot Dialog State Tracking3 Feb 2024
- 2023UNO-DST: Leveraging Unlabelled Data in Zero-Shot Dialogue State Tracking16 Oct 2023
- 2023PromptAttack: Probing Dialogue State Trackers with Adversarial Prompts7 Jun 2023
- 2023Prompt Engineering for Healthcare: Methodologies and Applications28 Apr 2023