# From Machine Reading Comprehension to Dialogue State Tracking: Bridging the Gap

arXiv: https://arxiv.org/abs/2004.05827 · HTML: https://mlsanity.com/paper/2004.05827/

## Key facts

- Cited by 40 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 13 Apr 2020.

## Built on by (most cited first, 30 of 40)

- [Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey](https://mlsanity.com/paper/2111.01243/) (2021)
- [State-of-the-art generalisation research in NLP: A taxonomy and review](https://mlsanity.com/paper/2210.03050/) (2022)
- [Leveraging Slot Descriptions for Zero-Shot Cross-Domain Dialogue State Tracking](https://mlsanity.com/paper/2105.04222/) (2021)
- [Zero-Shot Dialogue State Tracking via Cross-Task Transfer](https://mlsanity.com/paper/2109.04655/) (2021)
- [Description-Driven Task-Oriented Dialog Modeling](https://mlsanity.com/paper/2201.08904/) (2022)
- [In-Context Learning for Few-Shot Dialogue State Tracking](https://mlsanity.com/paper/2203.08568/) (2022)
- [ChatGPT for Zero-shot Dialogue State Tracking: A Solution or an Opportunity?](https://mlsanity.com/paper/2306.01386/) (2023)
- [Zero-shot Generalization in Dialog State Tracking through Generative Question Answering](https://mlsanity.com/paper/2101.08333/) (2021)
- [Slot Self-Attentive Dialogue State Tracking](https://mlsanity.com/paper/2101.09374/) (2021)
- [Enhancing Dialogue State Tracking Models through LLM-backed User-Agents Simulation](https://mlsanity.com/paper/2405.13037/) (2024)
- ["Do you follow me?": A Survey of Recent Approaches in Dialogue State Tracking](https://mlsanity.com/paper/2207.14627/) (2022)
- [Dialogue Summaries as Dialogue States (DS2), Template-Guided Summarization for Few-shot Dialogue State Tracking](https://mlsanity.com/paper/2203.01552/) (2022)
- [Dynamic Schema Graph Fusion Network for Multi-Domain Dialogue State Tracking](https://mlsanity.com/paper/2204.06677/) (2022)
- [Few Shot Dialogue State Tracking using Meta-learning](https://mlsanity.com/paper/2101.06779/) (2021)
- [Dependency Parsing as MRC-based Span-Span Prediction](https://mlsanity.com/paper/2105.07654/) (2021)
- [ASSIST: Towards Label Noise-Robust Dialogue State Tracking](https://mlsanity.com/paper/2202.13024/) (2022)
- [Improved and Efficient Conversational Slot Labeling through Question Answering](https://mlsanity.com/paper/2204.02123/) (2022)
- [Divide, Conquer, and Combine: Mixture of Semantic-Independent Experts for Zero-Shot Dialogue State Tracking](https://mlsanity.com/paper/2306.00434/) (2023)
- [DiSTRICT: Dialogue State Tracking with Retriever Driven In-Context Tuning](https://mlsanity.com/paper/2212.02851/) (2022)
- [A Dual Prompt Learning Framework for Few-Shot Dialogue State Tracking](https://mlsanity.com/paper/2201.05780/) (2022)
- [Efficient Task-Oriented Dialogue Systems with Response Selection as an Auxiliary Task](https://mlsanity.com/paper/2208.07097/) (2022)
- [Parameter-Efficient Low-Resource Dialogue State Tracking by Prompt Tuning](https://mlsanity.com/paper/2301.10915/) (2023)
- [Effective and Efficient Conversation Retrieval for Dialogue State Tracking with Implicit Text Summaries](https://mlsanity.com/paper/2402.13043/) (2024)
- [Beyond the Granularity: Multi-Perspective Dialogue Collaborative Selection for Dialogue State Tracking](https://mlsanity.com/paper/2205.10059/) (2022)
- [ZEROTOP: Zero-Shot Task-Oriented Semantic Parsing using Large Language Models](https://mlsanity.com/paper/2212.10815/) (2022)
- [Dual Slot Selector via Local Reliability Verification for Dialogue State Tracking](https://mlsanity.com/paper/2107.12578/) (2021)
- [Towards Zero and Few-shot Knowledge-seeking Turn Detection in Task-orientated Dialogue Systems](https://mlsanity.com/paper/2109.08820/) (2021)
- [Inference is All You Need: Self Example Retriever for Cross-domain Dialogue State Tracking with ChatGPT](https://mlsanity.com/paper/2409.06243/) (2024)
- [Prompt-based Generative Approach towards Multi-Hierarchical Medical Dialogue State Tracking](https://mlsanity.com/paper/2203.09946/) (2022)
- [XQA-DST: Multi-Domain and Multi-Lingual Dialogue State Tracking](https://mlsanity.com/paper/2204.05895/) (2022)

## Abstract (arXiv)

Dialogue state tracking (DST) is at the heart of task-oriented dialogue systems. However, the scarcity of labeled data is an obstacle to building accurate and robust state tracking systems that work across a variety of domains. Existing approaches generally require some dialogue data with state information and their ability to generalize to unknown domains is limited. In this paper, we propose using machine reading comprehension (RC) in state tracking from two perspectives: model architectures and datasets. We divide the slot types in dialogue state into categorical or extractive to borrow the advantages from both multiple-choice and span-based reading comprehension models. Our method achieves near the current state-of-the-art in joint goal accuracy on MultiWOZ 2.1 given full training data. More importantly, by leveraging machine reading comprehension datasets, our method outperforms the existing approaches by many a large margin in few-shot scenarios when the availability of in-domain data is limited. Lastly, even without any state tracking data, i.e., zero-shot scenario, our proposed approach achieves greater than 90% average slot accuracy in 12 out of 30 slots in MultiWOZ 2.1.
