mlsanityData to 14 Oct 2026

Improving Longer-range Dialogue State Tracking

arXiv 2103.00109 ↗First posted 27 Feb 2021cs.CL cs.AI cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Dialogue state tracking (DST) is a pivotal component in task-oriented dialogue systems. While it is relatively easy for a DST model to capture belief states in short conversations, the task of DST becomes more challenging as the length of a dialogue increases due to the injection of more distracting contexts. In this paper, we aim to improve the overall performance of DST with a special focus on handling longer dialogues. We tackle this problem from three perspectives: 1) A model designed to enable hierarchical slot status prediction; 2) Balanced training procedure for generic and task-specific language understanding; 3) Data perturbation which enhances the model's ability in handling longer conversations. We conduct experiments on the MultiWOZ benchmark, and demonstrate the effectiveness of each component via a set of ablation tests, especially on longer conversations.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 15 of its 20 references that are in the map. First posted on arXiv 27 Feb 2021.

Builds on

15 of 20 references.

References · 15

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
  6. 2020Towards a Human-like Open-Domain Chatbotcited by 470
  7. 2020A Simple Language Model for Task-Oriented Dialoguecited by 332
  8. 2019Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systemscited by 216
  9. 2020TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialoguecited by 185
  10. 2020TripPy: A Triple Copy Strategy for Value Independent Neural Dialog State Trackingcited by 130
  11. 2020DialoGLUE: A Natural Language Understanding Benchmark for Task-Oriented Dialoguecited by 89
  12. 2019Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modelingcited by 86
3 more
  1. 2019Find or Classify? Dual Strategy for Slot-Value Predictions on Multi-Domain Dialog State Trackingcited by 75
  2. 2020CoCo: Controllable Counterfactuals for Evaluating Dialogue State Trackerscited by 43
  3. 2019BERT-DST: Scalable End-to-End Dialogue State Tracking with Bidirectional Encoder Representations from Transformercited by 38

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 1.

2 papers.

  1. 2022"Do you follow me?": A Survey of Recent Approaches in Dialogue State Trackingcited by 22
  2. 2021Effective Sequence-to-Sequence Dialogue State Trackingcited by 20