mlsanityData to 7 Oct 2026

A Dual Prompt Learning Framework for Few-Shot Dialogue State Tracking

arXiv 2201.05780 ↗First posted 15 Jan 2022cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

Dialogue state tracking (DST) module is an important component for task-oriented dialog systems to understand users' goals and needs. Collecting dialogue state labels including slots and values can be costly, especially with the wide application of dialogue systems in more and more new-rising domains. In this paper, we focus on how to utilize the language understanding and generation ability of pre-trained language models for DST. We design a dual prompt learning framework for few-shot DST. Specifically, we consider the learning of slot generation and value generation as dual tasks, and two prompts are designed based on such a dual structure to incorporate task-related knowledge of these two tasks respectively. In this way, the DST task can be formulated as a language modeling task efficiently under few-shot settings. Experimental results on two task-oriented dialogue datasets show that the proposed method not only outperforms existing state-of-the-art few-shot methods, but also can generate unseen slots. It indicates that DST-related knowledge can be probed from PLM and utilized to address low-resource DST efficiently with the help of prompt learning.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 34 of its 46 references that are in the map. First posted on arXiv 15 Jan 2022.

Builds on

34 of 46 references.

References · 34

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  3. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  4. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  5. 2019How Can We Know What Language Models Know?cited by 953
  6. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
  7. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
  8. 2021GPT Understands, Toocited by 715
  9. 2016Self-critical Sequence Training for Image Captioningcited by 544
  10. 2019Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Datasetcited by 426
  11. 2020A Simple Language Model for Task-Oriented Dialoguecited by 331
  12. 2016A Network-based End-to-End Trainable Task-oriented Dialogue Systemcited by 252
22 more
  1. 2019Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systemscited by 215
  2. 2021How Many Data Points is a Prompt Worth?cited by 197
  3. 2019Commonsense Knowledge Mining from Pretrained Modelscited by 189
  4. 2020TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialoguecited by 185
  5. 2021Template-Based Named Entity Recognition Using BARTcited by 153
  6. 2019Taskmaster-1: Toward a Realistic and Diverse Dialog Datasetcited by 139
  7. 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
  8. 2020MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systemscited by 103
  9. 2021Dialogue State Tracking with a Language Model using Schema-Driven Promptingcited by 94
  10. 2020Zero-Shot Transfer Learning with Synthesized Data for Multi-Domain Dialogue State Trackingcited by 65
  11. 2019Dialog State Tracking: A Neural Reading Comprehension Approachcited by 62
  12. 2021Leveraging Slot Descriptions for Zero-Shot Cross-Domain Dialogue State Trackingcited by 61
  13. 2021Zero-Shot Dialogue State Tracking via Cross-Task Transfercited by 52
  14. 2020From Machine Reading Comprehension to Dialogue State Tracking: Bridging the Gapcited by 40
  15. 2019Multi-domain Dialogue State Tracking as Dynamic Knowledge Graph Enhanced Question Answeringcited by 39
  16. 2021Zero-shot Generalization in Dialog State Tracking through Generative Question Answeringcited by 33
  17. 2018Zero-Shot Adaptive Transfer for Conversational Language Understandingcited by 20
  18. 2021Knowledge-Aware Graph-Enhanced GPT-2 for Dialogue State Trackingcited by 20
  19. 2020Improving Limited Labeled Dialogue State Tracking with Self-Supervisioncited by 16
  20. 2021Few Shot Dialogue State Tracking using Meta-learningcited by 16
  21. 2020C2C-GenDA: Cluster-to-Cluster Generation for Data Augmentation of Slot Fillingcited by 11
  22. 2020Dialogue State Induction Using Neural Latent Variable Modelscited by 10

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 5.

8 papers.