mlsanityData to 14 Oct 2026

Are cascade dialogue state tracking models speaking out of turn in spoken dialogues?

arXiv 2311.04922 ↗First posted 3 Nov 2023cs.CL cs.AI eess.AScited by 0

Not on the map. Why?

Abstract (arXiv)

In Task-Oriented Dialogue (TOD) systems, correctly updating the system's understanding of the user's needs is key to a smooth interaction. Traditionally TOD systems are composed of several modules that interact with one another. While each of these components is the focus of active research communities, their behavior in interaction can be overlooked. This paper proposes a comprehensive analysis of the errors of state of the art systems in complex settings such as Dialogue State Tracking which highly depends on the dialogue context. Based on spoken MultiWoz, we identify that errors on non-categorical slots' values are essential to address in order to bridge the gap between spoken and chat-based dialogue systems. We explore potential solutions to improve transcriptions and help dialogue state tracking generative models correct such errors.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 26 references that are in the map. First posted on arXiv 3 Nov 2023.

Builds on

18 of 26 references.

References · 18

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  3. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  4. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 804
  5. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
  6. 2019NeMo: a toolkit for building AI applications using Neural Modulescited by 235
  7. 2019Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systemscited by 216
  8. 2018Neural Approaches to Conversational AIcited by 165
  9. 2021Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Trainingcited by 151
  10. 2020TripPy: A Triple Copy Strategy for Value Independent Neural Dialog State Trackingcited by 130
  11. 2018Towards end-to-end spoken language understandingcited by 92
  12. 2021A Survey on Spoken Language Understanding: Recent Advances and New Frontierscited by 53
6 more
  1. 2020A Sequence-to-Sequence Approach to Dialogue State Trackingcited by 43
  2. 2021Annotation Inconsistency and Entity Bias in MultiWOZcited by 30
  3. 2021"How Robust r u?": Evaluating Task-Oriented Dialogue Systems on Spoken Conversationscited by 30
  4. 2021Revisiting the Boundary between ASR and NLU in the Age of Conversational Dialog Systemscited by 15
  5. 2021Know Thy Strengths: Comprehensive Dialogue State Tracking Diagnosticscited by 9
  6. 2023OLISIA: a Cascade System for Spoken Dialogue State Trackingcited by 5

Built on by

Not cited yet.