Schema Augmentation for Zero-Shot Domain Adaptation in Dialogue State Tracking
Not on the map. Why?
Abstract (arXiv)
Zero-shot domain adaptation for dialogue state tracking (DST) remains a challenging problem in task-oriented dialogue (TOD) systems, where models must generalize to target domains unseen at training time. Current large language model approaches for zero-shot domain adaptation rely on prompting to introduce knowledge pertaining to the target domains. However, their efficacy strongly depends on prompt engineering, as well as the zero-shot ability of the underlying language model. In this work, we devise a novel data augmentation approach, Schema Augmentation, that improves the zero-shot domain adaptation of language models through fine-tuning. Schema Augmentation is a simple but effective technique that enhances generalization by introducing variations of slot names within the schema provided in the prompt. Experiments on MultiWOZ and SpokenWOZ showed that the proposed approach resulted in a substantial improvement over the baseline, in some experiments achieving over a twofold accuracy gain over unseen domains while maintaining equal or superior performance over all domains.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 42 references that are in the map. First posted on arXiv 31 Oct 2024.
Builds on
18 of 42 references.
References · 18
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
- 2019Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Datasetcited by 434
- 2020A Simple Language Model for Task-Oriented Dialoguecited by 332
- 2020MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselinescited by 204
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2021Dialogue State Tracking with a Language Model using Schema-Driven Promptingcited by 94
- 2023SpokenWOZ: A Large-Scale Speech-Text Benchmark for Spoken Task-Oriented Dialogue Agentscited by 71
- 2021Zero-Shot Dialogue State Tracking via Cross-Task Transfercited by 52
- 2022Description-Driven Task-Oriented Dialog Modelingcited by 50
- 2023ChatGPT for Zero-shot Dialogue State Tracking: A Solution or an Opportunity?cited by 38
- 2021Zero-shot Generalization in Dialog State Tracking through Generative Question Answeringcited by 33
6 more
- 2019Scaling Multi-Domain Dialogue State Tracking via Query Reformulationcited by 20
- 2019An End-to-End Dialogue State Tracking System with Machine Reading Comprehension and Wide & Deep Classificationcited by 20
- 2021Few Shot Dialogue State Tracking using Meta-learningcited by 16
- 2023Prompter: Zero-shot Adaptive Prefixes for Dialogue State Tracking Domain Adaptationcited by 7
- 2020mForms : Multimodal Form-Filling with Question Answeringcited by 5
- 2024Zero-Shot Cross-Domain Dialogue State Tracking via Dual Low-Rank Adaptationcited by 5
Built on by
Citing papers per year: 2025: 1.
1 paper.