mlsanityData to 13 Oct 2026

MultiWOZ 2.3: A multi-domain task-oriented dialogue dataset enhanced with annotation corrections and co-reference annotation

arXiv 2010.05594 ↗First posted 12 Oct 2020cs.CLcited by 51

Not on the map. Why?

Abstract (arXiv)

Task-oriented dialogue systems have made unprecedented progress with multiple state-of-the-art (SOTA) models underpinned by a number of publicly available MultiWOZ datasets. Dialogue state annotations are error-prone, leading to sub-optimal performance. Various efforts have been put in rectifying the annotation errors presented in the original MultiWOZ dataset. In this paper, we introduce MultiWOZ 2.3, in which we differentiate incorrect annotations in dialogue acts from dialogue states, identifying a lack of co-reference when publishing the updated dataset. To ensure consistency between dialogue acts and dialogue states, we implement co-reference features and unify annotations of dialogue acts and dialogue states. We update the state of the art performance of natural language understanding and dialogue state tracking on MultiWOZ 2.3, where the results show significant improvements than on previous versions of MultiWOZ datasets (2.0-2.2).

Key facts. Cited by 51 papers in the map (data through 13 Oct 2026). First posted on arXiv 12 Oct 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2021: 6; 2022: 12; 2023: 12; 2024: 10; 2025: 6; 2026: 5.

51 papers.

Sort:

By area:

  1. 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
  2. 2023MathDial: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problemscited by 129
  3. 2021MultiWOZ 2.4: A Multi-Domain Task-Oriented Dialogue Dataset with Essential Annotation Corrections to Improve State Tracking Evaluationcited by 86
  4. 2022Description-Driven Task-Oriented Dialog Modelingcited by 50
  5. 2022Controllable Dialogue Simulation with In-Context Learningcited by 42
  6. 2022Multi2WOZ: A Robust Multilingual Dataset and Conversational Pretraining for Task-Oriented Dialogcited by 30
  7. 2023Towards LLM-driven Dialogue State Trackingcited by 25
  8. 2024Enhancing Dialogue State Tracking Models through LLM-backed User-Agents Simulationcited by 24
  9. 2022"Do you follow me?": A Survey of Recent Approaches in Dialogue State Trackingcited by 22
  10. 2022Dialogue Summaries as Dialogue States (DS2), Template-Guided Summarization for Few-shot Dialogue State Trackingcited by 21
  11. 2024SynthDST: Synthetic Data is All You Need for Few-Shot Dialog State Trackingcited by 17
  12. 2023Multi3WOZ: A Multilingual, Multi-Domain, Multi-Parallel Dataset for Training and Evaluating Culturally Adapted Task-Oriented Dialog Systemscited by 16
38 more
  1. 2024Multi-News+: Cost-efficient Dataset Cleansing via LLM-based Data Annotationcited by 16
  2. 2022Robust Dialogue State Tracking with Weak Supervision and Sparse Datacited by 15
  3. 2022A Survey of Intent Classification and Slot-Filling Datasets for Task-Oriented Dialogcited by 14
  4. 2021TOD-DA: Towards Boosting the Robustness of Task-oriented Dialogue Modeling on Spoken Conversationscited by 11
  5. 2021Database Search Results Disambiguation for Task-Oriented Dialog Systemscited by 10
  6. 2023Diverse Retrieval-Augmented In-Context Learning for Dialogue State Trackingcited by 10
  7. 2025Wizard of Shopping: Target-Oriented E-commerce Dialogue Generation with Decision Tree Branchingcited by 10
  8. 2021Know Thy Strengths: Comprehensive Dialogue State Tracking Diagnosticscited by 9
  9. 2021AllWOZ: Towards Multilingual Task-Oriented Dialog Systems for Allcited by 9
  10. 2022Metaphorical User Simulators for Evaluating Task-oriented Dialogue Systemscited by 9
  11. 2022UniDU: Towards A Unified Generative Dialogue Understanding Frameworkcited by 9
  12. 2024DARD: A Multi-Agent Approach for Task-Oriented Dialog Systemscited by 9
  13. 2021Robustness through Data Augmentation Loss Consistencycited by 8
  14. 2024Are LLMs Robust for Spoken Dialogues?cited by 7
  15. 2022A Multi-Task BERT Model for Schema-Guided Dialogue State Trackingcited by 5
  16. 2023Diable: Efficient Dialogue State Tracking as Operations on Tablescited by 4
  17. 2023A Systematic Study of Performance Disparities in Multilingual Task-Oriented Dialogue Systemscited by 4
  18. 2023Task Conditioned BERT for Joint Intent Detection and Slot-fillingcited by 3
  19. 2023Span-Selective Linear Attention Transformers for Effective and Robust Schema-Guided Dialogue State Trackingcited by 2
  20. 2023A Confidence-based Acquisition Model for Self-supervised Active Learning and Label Correctioncited by 2
  21. 2024Plan, Generate and Complicate: Improving Low-resource Dialogue State Tracking via Easy-to-Difficult Zero-shot Data Augmentationcited by 2
  22. 2024A Zero-Shot Open-Vocabulary Pipeline for Dialogue Understandingcited by 2
  23. 2025Multi-Intent Recognition in Dialogue Understanding: A Comparison Between Smaller Open-Source LLMscited by 2
  24. 2022Sources of Noise in Dialogue and How to Deal with Themcited by 1
  25. 2023Few-Shot Structured Policy Learning for Multi-Domain and Multi-Task Dialoguescited by 1
  26. 2023Replicating Complex Dialogue Policy of Humans via Offline Imitation Learning with Supervised Regularizationcited by 1
  27. 2024Benchmarks Underestimate the Readiness of Multi-lingual Dialogue Agentscited by 1
  28. 2025NOEM3A: a Neuro-symbolic Ontology-Enhanced Method for Multi-intent understanding in Mobile Agentscited by 1
  29. 2026IntentGrasp: A Comprehensive Benchmark for Intent Understandingcited by 1
  30. 2022ViWOZ: A Multi-Domain Task-Oriented Dialogue Systems Dataset For Low-resource Languagecited by 0
  31. 2023Injecting linguistic knowledge into BERT for Dialogue State Trackingcited by 0
  32. 2024Training Zero-Shot Generalizable End-to-End Task-Oriented Dialog System Without Turn-level Dialog Annotationscited by 0
  33. 2025Learning LLM Preference over Intra-Dialogue Pairs: A Framework for Utterance-level Understandingscited by 0
  34. 2025textttDIAMONDs: A Dataset for mathbbDynamic mathbbInformation mathbbAnd mathbbMental modeling mathbbOf mathbbNumeric mathbbDiscussionscited by 0
  35. 2025Improving Dialogue State Tracking through Combinatorial Search for In-Context Examplescited by 0
  36. 2026Dynamic Knowledge Fusion for Multi-Domain Dialogue State Trackingcited by 0
  37. 2026GBC: Gradient-Based Connections for Optimizing Multi-Agent Systemscited by 0
  38. 2026PredAct-Bench: Benchmarking Tool-Augmented Dialogue under Controlled Tool Noisecited by 0

50 most cited of 51 All 51 (JSON)