"Do you follow me?": A Survey of Recent Approaches in Dialogue State Tracking
Not on the map. Why?
Abstract (arXiv)
While communicating with a user, a task-oriented dialogue system has to track the user's needs at each turn according to the conversation history. This process called dialogue state tracking (DST) is crucial because it directly informs the downstream dialogue policy. DST has received a lot of interest in recent years with the text-to-text paradigm emerging as the favored approach. In this review paper, we first present the task and its associated datasets. Then, considering a large number of recent publications, we identify highlights and advances of research in 2021-2022. Although neural approaches have enabled significant progress, we argue that some critical aspects of dialogue systems such as generalizability are still underexplored. To motivate future studies, we propose several research avenues.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 77 of its 105 references that are in the map. First posted on arXiv 29 Jul 2022.
Builds on
77 of 105 references.
References · 77
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
- 2019Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Datasetcited by 426
- 2020A Simple Language Model for Task-Oriented Dialoguecited by 331
- 2019Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systemscited by 215
- 2020MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselinescited by 201
- 2020TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialoguecited by 185
- 2019Challenges in Building Intelligent Open-domain Dialog Systemscited by 147
- 2016Neural Belief Tracker: Data-Driven Dialogue State Trackingcited by 142
- 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
38 more
- 2020TripPy: A Triple Copy Strategy for Value Independent Neural Dialog State Trackingcited by 130
- 2020Task-Oriented Dialogue as Dataflow Synthesiscited by 122
- 2016Learning End-to-End Goal-Oriented Dialogcited by 104
- 2020MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systemscited by 103
- 2021Dialogue State Tracking with a Language Model using Schema-Driven Promptingcited by 94
- 2021MultiWOZ 2.4: A Multi-Domain Task-Oriented Dialogue Dataset with Essential Annotation Corrections to Improve State Tracking Evaluationcited by 86
- 2020Continual Learning in Task-Oriented Dialogue Systemscited by 82
- 2019Efficient Dialogue State Tracking by Selectively Overwriting Memorycited by 76
- 2019Find or Classify? Dual Strategy for Slot-Value Predictions on Multi-Domain Dialog State Trackingcited by 75
- 2021Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systemscited by 73
- 2020CrossWOZ: A Large-Scale Chinese Cross-Domain Task-Oriented Dialogue Datasetcited by 66
- 2020Zero-Shot Transfer Learning with Synthesized Data for Multi-Domain Dialogue State Trackingcited by 65
- 2019Dialog State Tracking: A Neural Reading Comprehension Approachcited by 62
- 2021Leveraging Slot Descriptions for Zero-Shot Cross-Domain Dialogue State Trackingcited by 61
- 2021BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modelingcited by 55
- 2021SIMMC 2.0: A Task-oriented Dialog Dataset for Immersive Multimodal Conversationscited by 54
- 2021Zero-Shot Dialogue State Tracking via Cross-Task Transfercited by 52
- 2020MultiWOZ 2.3: A multi-domain task-oriented dialogue dataset enhanced with annotation corrections and co-reference annotationcited by 51
- 2022Description-Driven Task-Oriented Dialog Modelingcited by 50
- 2020Overview of the Ninth Dialog System Technology Challenge: DSTC9cited by 49
- 2020Adding Chit-Chat to Enhance Task-Oriented Dialoguescited by 48
- 2022Continual Prompt Tuning for Dialog State Trackingcited by 44
- 2020CoCo: Controllable Counterfactuals for Evaluating Dialogue State Trackerscited by 43
- 2020A Sequence-to-Sequence Approach to Dialogue State Trackingcited by 43
- 2020From Machine Reading Comprehension to Dialogue State Tracking: Bridging the Gapcited by 40
- 2020RiSAWOZ: A Large-Scale Multi-Domain Wizard-of-Oz Dataset with Rich Semantic Annotations for Task-Oriented Dialogue Modelingcited by 40
- 2020Conversational Semantic Parsing for Dialog State Trackingcited by 40
- 2020RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systemscited by 36
- 2021Preview, Attend and Review: Schema-Aware Curriculum Learning for Multi-Domain Dialog State Trackingcited by 35
- 2021SGD-X: A Benchmark for Robust Generalization in Schema-Guided Dialogue Systemscited by 34
- 2021Zero-shot Generalization in Dialog State Tracking through Generative Question Answeringcited by 33
- 2020Schema-Guided Dialogue State Tracking Task at DSTC8cited by 32
- 2021Annotation Inconsistency and Entity Bias in MultiWOZcited by 30
- 2021"How Robust r u?": Evaluating Task-Oriented Dialogue Systems on Spoken Conversationscited by 30
- 2021GlobalWoZ: Globalizing MultiWoZ to Develop Multilingual Task-Oriented Dialogue Systemscited by 30
- 2021Slot Self-Attentive Dialogue State Trackingcited by 27
- 2022Cross-Lingual Dialogue Dataset Creation via Outline-Based Generationcited by 23
- 2021DS-TOD: Efficient Domain Specialization for Task Oriented Dialogcited by 21
50 most cited of 77 All 77 (JSON)
Built on by
Citing papers per year: 2022: 1; 2023: 8; 2024: 2; 2025: 6; 2026: 5.
22 papers.
Sort:
By area:
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 203
- 2023Minding Language Models' (Lack of) Theory of Mind: A Plug-and-Play Multi-Character Belief Trackercited by 95
- 2025ToolDial: Multi-turn Dialogue Generation Method for Tool-Augmented Language Modelscited by 34
- 2023A Preliminary Evaluation of ChatGPT for Zero-shot Dialogue Understandingcited by 31
- 2023A Survey of the Evolution of Language Model-Based Dialogue Systems: Data, Task and Modelscited by 23
- 2025WildSpeech-Bench: Benchmarking End-to-End SpeechLLMs in the Wildcited by 11
- 2022DiSTRICT: Dialogue State Tracking with Retriever Driven In-Context Tuningcited by 9
- 2023The timing bottleneck: Why timing and overlap are mission-critical for conversational user interfaces, speech recognition and dialogue systemscited by 9
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directionscited by 9
- 2023Diable: Efficient Dialogue State Tracking as Operations on Tablescited by 4
- 2025StableToken: A Noise-Robust Semantic Speech Tokenizer for Resilient SpeechLLMscited by 4
- 2025Interpretable and Robust Dialogue State Tracking via Natural Language Summarization with LLMscited by 3
10 more
- 2025Open-Ended Goal Inference through Actions and Language for Human-Robot Collaborationcited by 3
- 2023Agreement Tracking for Multi-Issue Negotiation Dialoguescited by 2
- 2024Plan, Generate and Complicate: Improving Low-resource Dialogue State Tracking via Easy-to-Difficult Zero-shot Data Augmentationcited by 2
- 2026Can LLM Agents Stick to the Script? A Benchmark for Long-Horizon Consistency in Interactive Narrativescited by 2
- 2026Vox-Infinity: Benchmarking the Limits of Long-Context Spoken Language Modelscited by 2
- 2023Who's in Charge? Roles and Responsibilities of Decision-Making Components in Conversational Robotscited by 1
- 2023Grounding Description-Driven Dialogue State Trackers with Knowledge-Seeking Turnscited by 1
- 2026Using Machine Mental Imagery for Representing Common Ground in Situated Dialoguecited by 0
- 2026No Action Without a NOD: A Heterogeneous Multi-Agent Architecture for Reliable Service Agentscited by 0
- 2026An Auditable Symbolic-RAG-Generative AI Architecture for Goal-Oriented Conversation Orchestrationcited by 0
- 2026Vox-Infinity: Benchmarking the Limits of Long-Context Spoken Language Models18 Sep 2026
- 2026An Auditable Symbolic-RAG-Generative AI Architecture for Goal-Oriented Conversation Orchestration7 Sep 2026
- 2026Can LLM Agents Stick to the Script? A Benchmark for Long-Horizon Consistency in Interactive Narratives8 Aug 2026
- 2026No Action Without a NOD: A Heterogeneous Multi-Agent Architecture for Reliable Service Agents12 May 2026
- 2026Using Machine Mental Imagery for Representing Common Ground in Situated Dialogue22 Apr 2026
- 2025Open-Ended Goal Inference through Actions and Language for Human-Robot Collaboration4 Dec 2025
- 2025StableToken: A Noise-Robust Semantic Speech Tokenizer for Resilient SpeechLLMs26 Sep 2025
- 2025WildSpeech-Bench: Benchmarking End-to-End SpeechLLMs in the Wild27 Jun 2025
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions7 Apr 2025
- 2025Interpretable and Robust Dialogue State Tracking via Natural Language Summarization with LLMs11 Mar 2025
- 2025ToolDial: Multi-turn Dialogue Generation Method for Tool-Augmented Language Models1 Mar 2025
- 2024Plan, Generate and Complicate: Improving Low-resource Dialogue State Tracking via Easy-to-Difficult Zero-shot Data Augmentation13 Jun 2024
10 more
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalization3 Jun 2024
- 2023A Survey of the Evolution of Language Model-Based Dialogue Systems: Data, Task and Models28 Nov 2023
- 2023Grounding Description-Driven Dialogue State Trackers with Knowledge-Seeking Turns23 Sep 2023
- 2023The timing bottleneck: Why timing and overlap are mission-critical for conversational user interfaces, speech recognition and dialogue systems28 Jul 2023
- 2023Agreement Tracking for Multi-Issue Negotiation Dialogues13 Jul 2023
- 2023Minding Language Models' (Lack of) Theory of Mind: A Plug-and-Play Multi-Character Belief Tracker1 Jun 2023
- 2023Diable: Efficient Dialogue State Tracking as Operations on Tables26 May 2023
- 2023A Preliminary Evaluation of ChatGPT for Zero-shot Dialogue Understanding9 Apr 2023
- 2023Who's in Charge? Roles and Responsibilities of Decision-Making Components in Conversational Robots15 Mar 2023
- 2022DiSTRICT: Dialogue State Tracking with Retriever Driven In-Context Tuning6 Dec 2022
- 2025ToolDial: Multi-turn Dialogue Generation Method for Tool-Augmented Language Modelscited by 34
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directionscited by 9
- 2026Can LLM Agents Stick to the Script? A Benchmark for Long-Horizon Consistency in Interactive Narrativescited by 2
- 2026No Action Without a NOD: A Heterogeneous Multi-Agent Architecture for Reliable Service Agentscited by 0
- 2026Can LLM Agents Stick to the Script? A Benchmark for Long-Horizon Consistency in Interactive Narratives8 Aug 2026
- 2026No Action Without a NOD: A Heterogeneous Multi-Agent Architecture for Reliable Service Agents12 May 2026
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions7 Apr 2025
- 2025ToolDial: Multi-turn Dialogue Generation Method for Tool-Augmented Language Models1 Mar 2025
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 203
- 2023Minding Language Models' (Lack of) Theory of Mind: A Plug-and-Play Multi-Character Belief Trackercited by 95
- 2023A Preliminary Evaluation of ChatGPT for Zero-shot Dialogue Understandingcited by 31
- 2023A Survey of the Evolution of Language Model-Based Dialogue Systems: Data, Task and Modelscited by 23
- 2022DiSTRICT: Dialogue State Tracking with Retriever Driven In-Context Tuningcited by 9
- 2023The timing bottleneck: Why timing and overlap are mission-critical for conversational user interfaces, speech recognition and dialogue systemscited by 9
- 2023Diable: Efficient Dialogue State Tracking as Operations on Tablescited by 4
- 2025StableToken: A Noise-Robust Semantic Speech Tokenizer for Resilient SpeechLLMscited by 4
- 2025Interpretable and Robust Dialogue State Tracking via Natural Language Summarization with LLMscited by 3
- 2025Open-Ended Goal Inference through Actions and Language for Human-Robot Collaborationcited by 3
- 2023Agreement Tracking for Multi-Issue Negotiation Dialoguescited by 2
- 2024Plan, Generate and Complicate: Improving Low-resource Dialogue State Tracking via Easy-to-Difficult Zero-shot Data Augmentationcited by 2
12 most cited of 17 All 17 (JSON)
- 2026Vox-Infinity: Benchmarking the Limits of Long-Context Spoken Language Models18 Sep 2026
- 2026An Auditable Symbolic-RAG-Generative AI Architecture for Goal-Oriented Conversation Orchestration7 Sep 2026
- 2026Using Machine Mental Imagery for Representing Common Ground in Situated Dialogue22 Apr 2026
- 2025Open-Ended Goal Inference through Actions and Language for Human-Robot Collaboration4 Dec 2025
- 2025StableToken: A Noise-Robust Semantic Speech Tokenizer for Resilient SpeechLLMs26 Sep 2025
- 2025Interpretable and Robust Dialogue State Tracking via Natural Language Summarization with LLMs11 Mar 2025
- 2024Plan, Generate and Complicate: Improving Low-resource Dialogue State Tracking via Easy-to-Difficult Zero-shot Data Augmentation13 Jun 2024
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalization3 Jun 2024
- 2023A Survey of the Evolution of Language Model-Based Dialogue Systems: Data, Task and Models28 Nov 2023
- 2023Grounding Description-Driven Dialogue State Trackers with Knowledge-Seeking Turns23 Sep 2023
- 2023The timing bottleneck: Why timing and overlap are mission-critical for conversational user interfaces, speech recognition and dialogue systems28 Jul 2023
- 2023Agreement Tracking for Multi-Issue Negotiation Dialogues13 Jul 2023
12 newest of 17 All 17 (JSON)