Show, Don't Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialogue
Not on the map. Why?
Abstract (arXiv)
Building universal dialogue systems that operate across multiple domains/APIs and generalize to new ones with minimal overhead is a critical challenge. Recent works have leveraged natural language descriptions of schema elements to enable such systems; however, descriptions only indirectly convey schema semantics. In this work, we propose Show, Don't Tell, which prompts seq2seq models with a labeled example dialogue to show the semantics of schema elements rather than tell the model through descriptions. While requiring similar effort from service developers as generating descriptions, we show that using short examples as schema representations with large language models results in state-of-the-art performance on two popular dialogue state tracking benchmarks designed to measure zero-shot generalization - the Schema-Guided Dialogue dataset and the MultiWOZ leave-one-out benchmark.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 27 of its 40 references that are in the map. First posted on arXiv 8 Apr 2022.
Builds on
27 of 40 references.
References · 27
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,392
- 2019How Can We Know What Language Models Know?cited by 959
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
- 2017In-Datacenter Performance Analysis of a Tensor Processing Unitcited by 618
- 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 606
- 2019Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Datasetcited by 434
- 2019Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systemscited by 216
- 2021How Many Data Points is a Prompt Worth?cited by 198
15 more
- 2020TripPy: A Triple Copy Strategy for Value Independent Neural Dialog State Trackingcited by 130
- 2021Dialogue State Tracking with a Language Model using Schema-Driven Promptingcited by 94
- 2020Zero-Shot Transfer Learning with Synthesized Data for Multi-Domain Dialogue State Trackingcited by 65
- 2019SUMBT: Slot-Utterance Matching for Universal and Scalable Belief Trackingcited by 63
- 2021Leveraging Slot Descriptions for Zero-Shot Cross-Domain Dialogue State Trackingcited by 61
- 2021Zero-Shot Dialogue State Tracking via Cross-Task Transfercited by 52
- 2022Description-Driven Task-Oriented Dialog Modelingcited by 50
- 2020A Sequence-to-Sequence Approach to Dialogue State Trackingcited by 43
- 2020Language Models as Few-Shot Learner for Task-Oriented Dialogue Systemscited by 41
- 2021SGD-X: A Benchmark for Robust Generalization in Schema-Guided Dialogue Systemscited by 34
- 2020Schema-Guided Dialogue State Tracking Task at DSTC8cited by 32
- 2020MA-DST: Multi-Attention Based Scalable Dialog State Trackingcited by 24
- 2019An End-to-End Dialogue State Tracking System with Machine Reading Comprehension and Wide & Deep Classificationcited by 20
- 2020Fine-Tuning BERT for Schema-Guided Zero-Shot Dialogue State Trackingcited by 11
- 2021SGD-QA: Fast Schema-Guided Dialogue State Tracking for Unseen Servicescited by 4
Built on by
Citing papers per year: 2022: 4; 2023: 8; 2024: 2; 2025: 1; 2026: 1.
16 papers.
Sort:
By area:
- 2024Large Language Models Meet NLP: A Surveycited by 103
- 2022"Do you follow me?": A Survey of Recent Approaches in Dialogue State Trackingcited by 22
- 2024Retrieval Augmented End-to-End Spoken Dialog Modelscited by 20
- 2022AnyTOD: A Programmable Task-Oriented Dialog Systemcited by 10
- 2023Diverse Retrieval-Augmented In-Context Learning for Dialogue State Trackingcited by 10
- 2022DiSTRICT: Dialogue State Tracking with Retriever Driven In-Context Tuningcited by 9
- 2023Speech-to-Text Adapter and Speech-to-Entity Retriever Augmented LLMs for Speech Understandingcited by 9
- 2023Parameter-Efficient Low-Resource Dialogue State Tracking by Prompt Tuningcited by 8
- 2022Knowledge-grounded Dialog State Trackingcited by 5
- 2023Continual Dialogue State Tracking via Example-Guided Question Answeringcited by 4
- 2023Controllable Generation of Dialogue Acts for Dialogue Systems via Few-Shot Response Generation and Rankingcited by 4
- 2023Span-Selective Linear Attention Transformers for Effective and Robust Schema-Guided Dialogue State Trackingcited by 2
4 more
- 2025Generative Induction of Dialogue Task Schemas with Streaming Refinement and Simulated Interactionscited by 2
- 2023Grounding Description-Driven Dialogue State Trackers with Knowledge-Seeking Turnscited by 1
- 2023UNO-DST: Leveraging Unlabelled Data in Zero-Shot Dialogue State Trackingcited by 1
- 2026Show, Don't Tell: Detecting Novel Objects by Watching Human Videoscited by 0
- 2026Show, Don't Tell: Detecting Novel Objects by Watching Human Videos13 Mar 2026
- 2025Generative Induction of Dialogue Task Schemas with Streaming Refinement and Simulated Interactions25 Apr 2025
- 2024Large Language Models Meet NLP: A Survey21 May 2024
- 2024Retrieval Augmented End-to-End Spoken Dialog Models2 Feb 2024
- 2023UNO-DST: Leveraging Unlabelled Data in Zero-Shot Dialogue State Tracking16 Oct 2023
- 2023Grounding Description-Driven Dialogue State Trackers with Knowledge-Seeking Turns23 Sep 2023
- 2023Controllable Generation of Dialogue Acts for Dialogue Systems via Few-Shot Response Generation and Ranking26 Jul 2023
- 2023Diverse Retrieval-Augmented In-Context Learning for Dialogue State Tracking4 Jul 2023
- 2023Span-Selective Linear Attention Transformers for Effective and Robust Schema-Guided Dialogue State Tracking15 Jun 2023
- 2023Speech-to-Text Adapter and Speech-to-Entity Retriever Augmented LLMs for Speech Understanding8 Jun 2023
- 2023Continual Dialogue State Tracking via Example-Guided Question Answering23 May 2023
- 2023Parameter-Efficient Low-Resource Dialogue State Tracking by Prompt Tuning26 Jan 2023
4 more
- 2024Large Language Models Meet NLP: A Surveycited by 103
- 2022"Do you follow me?": A Survey of Recent Approaches in Dialogue State Trackingcited by 22
- 2022AnyTOD: A Programmable Task-Oriented Dialog Systemcited by 10
- 2022DiSTRICT: Dialogue State Tracking with Retriever Driven In-Context Tuningcited by 9
- 2023Speech-to-Text Adapter and Speech-to-Entity Retriever Augmented LLMs for Speech Understandingcited by 9
- 2023Parameter-Efficient Low-Resource Dialogue State Tracking by Prompt Tuningcited by 8
- 2022Knowledge-grounded Dialog State Trackingcited by 5
- 2023Continual Dialogue State Tracking via Example-Guided Question Answeringcited by 4
- 2023Controllable Generation of Dialogue Acts for Dialogue Systems via Few-Shot Response Generation and Rankingcited by 4
- 2023Span-Selective Linear Attention Transformers for Effective and Robust Schema-Guided Dialogue State Trackingcited by 2
- 2025Generative Induction of Dialogue Task Schemas with Streaming Refinement and Simulated Interactionscited by 2
- 2023Grounding Description-Driven Dialogue State Trackers with Knowledge-Seeking Turnscited by 1
12 most cited of 14 All 14 (JSON)
- 2026Show, Don't Tell: Detecting Novel Objects by Watching Human Videos13 Mar 2026
- 2025Generative Induction of Dialogue Task Schemas with Streaming Refinement and Simulated Interactions25 Apr 2025
- 2024Large Language Models Meet NLP: A Survey21 May 2024
- 2023UNO-DST: Leveraging Unlabelled Data in Zero-Shot Dialogue State Tracking16 Oct 2023
- 2023Grounding Description-Driven Dialogue State Trackers with Knowledge-Seeking Turns23 Sep 2023
- 2023Controllable Generation of Dialogue Acts for Dialogue Systems via Few-Shot Response Generation and Ranking26 Jul 2023
- 2023Span-Selective Linear Attention Transformers for Effective and Robust Schema-Guided Dialogue State Tracking15 Jun 2023
- 2023Speech-to-Text Adapter and Speech-to-Entity Retriever Augmented LLMs for Speech Understanding8 Jun 2023
- 2023Continual Dialogue State Tracking via Example-Guided Question Answering23 May 2023
- 2023Parameter-Efficient Low-Resource Dialogue State Tracking by Prompt Tuning26 Jan 2023
- 2022AnyTOD: A Programmable Task-Oriented Dialog System20 Dec 2022
- 2022DiSTRICT: Dialogue State Tracking with Retriever Driven In-Context Tuning6 Dec 2022
12 newest of 14 All 14 (JSON)