STAR: A Schema-Guided Dialog Dataset for Transfer Learning
Not on the map. Why?
Abstract (arXiv)
We present STAR, a schema-guided task-oriented dialog dataset consisting of 127,833 utterances and knowledge base queries across 5,820 task-oriented dialogs in 13 domains that is especially designed to facilitate task and domain transfer learning in task-oriented dialog. Furthermore, we propose a scalable crowd-sourcing paradigm to collect arbitrarily large datasets of the same quality as STAR. Moreover, we introduce novel schema-guided dialog models that use an explicit description of the task(s) to generalize from known to unknown tasks. We demonstrate the effectiveness of these models, particularly for zero-shot generalization across tasks and domains.
Key facts. Cited by 44 papers in the map (data through 14 Oct 2026). First posted on arXiv 22 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 10; 2023: 8; 2024: 9; 2025: 7; 2026: 3.
44 papers.
Sort:
By area:
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 208
- 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102
- 2021Few-Shot Bot: Prompt-Based Learning for Dialogue Systemscited by 64
- 2021BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modelingcited by 56
- 2023ToolTalk: Evaluating Tool-Usage in a Conversational Settingcited by 45
- 2024FlowBench: Revisiting and Benchmarking Workflow-Guided Planning for LLM-based Agentscited by 40
- 2023SGP-TOD: Building Task Bots Effortlessly via Schema-Guided LLM Promptingcited by 39
- 2021SGD-X: A Benchmark for Robust Generalization in Schema-Guided Dialogue Systemscited by 34
- 2022SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generationcited by 34
- 2023A Survey on Out-of-Distribution Detection in NLPcited by 31
- 2022SPACE-2: Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understandingcited by 28
- 2023DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AIcited by 22
32 more
- 2021GOLD: Improving Out-of-Scope Detection in Dialogues using Data Augmentationcited by 20
- 2022LAD: Language Models as Data for Zero-Shot Dialogcited by 18
- 2025VistaDPO: Video Hierarchical Spatial-Temporal Direct Preference Optimization for Large Video Modelscited by 17
- 2021Schema-Guided Paradigm for Zero-Shot Dialogcited by 14
- 2022Where to Go for the Holidays: Towards Mixed-Type Dialogs for Clarification of User Goalscited by 12
- 2024FLAP: Flow-Adhering Planning with Constrained Decoding in LLMscited by 11
- 2022AnyTOD: A Programmable Task-Oriented Dialog Systemcited by 10
- 2022CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluationcited by 9
- 2023Out-of-Domain Intent Detection Considering Multi-Turn Dialogue Contextscited by 6
- 2023DiactTOD: Learning Generalizable Latent Dialogue Acts for Controllable Task-Oriented Dialogue Systemscited by 6
- 2022A Multi-Task BERT Model for Schema-Guided Dialogue State Trackingcited by 5
- 2023Self-Explanation Prompting Improves Dialogue Understanding in Large Language Modelscited by 5
- 2025Turning Conversations into Workflows: A Framework to Extract and Evaluate Dialog Workflows for Service AI Agentscited by 5
- 2024TOAD: Task-Oriented Automatic Dialogs with Diverse Response Stylescited by 4
- 2024LLM-based Frameworks for API Argument Filling in Task-Oriented Conversational Systemscited by 4
- 2024Dialog Flow Induction for Constrainable LLM-Based Chatbotscited by 4
- 2023Zero-Shot Generalizable End-to-End Task-Oriented Dialog System using Context Summarization and Domain Schemacited by 3
- 2025Agent WARPP: Workflow Adherence via Runtime Parallel Personalizationcited by 3
- 2021Oh My Mistake!: Toward Realistic Dialogue State Tracking including Turnback Utterancescited by 2
- 2022A Flexible Schema-Guided Dialogue Management Framework: From Friendly Peer to Virtual Standardized Cancer Patientcited by 2
- 2022Knowledge-Grounded Conversational Data Augmentation with Generative Conversational Networkscited by 2
- 2024JMultiWOZ: A Large-Scale Japanese Multi-Domain Task-Oriented Dialogue Datasetcited by 2
- 2025PicPersona-TOD : A Dataset for Personalizing Utterance Style in Task-Oriented Dialogue with Image Personacited by 2
- 2025TOD-ProcBench: Benchmarking Complex Instruction-Following in Task-Oriented Dialoguescited by 2
- 2024DFlow: Diverse Dialogue Flow Simulation with Large Language Modelscited by 1
- 2025CoDial: Interpretable Task-Oriented Dialogue Systems Through Dialogue Flow Alignmentcited by 1
- 2025PyTOD: Programmable Task-Oriented Dialogue with Execution Feedbackcited by 1
- 2026All Required, In Order: Phase-Level Evaluation for AI-Human Dialogue in Healthcare and Beyondcited by 1
- 2026INSURE-Dial: A Phase-Aware Conversational Dataset & Benchmark for Compliance Verification and Phase Detectioncited by 1
- 2022Pseudo-OOD training for robust language modelscited by 0
- 2024Graph Integrated Language Transformers for Next Action Prediction in Complex Phone Callscited by 0
- 2026CUEing User Simulators: Calibrated User Embeddings for Multi-Turn Benchmarkingcited by 0
- 2026CUEing User Simulators: Calibrated User Embeddings for Multi-Turn Benchmarking1 Oct 2026
- 2026INSURE-Dial: A Phase-Aware Conversational Dataset & Benchmark for Compliance Verification and Phase Detection28 Jan 2026
- 2026All Required, In Order: Phase-Level Evaluation for AI-Human Dialogue in Healthcare and Beyond13 Jan 2026
- 2025TOD-ProcBench: Benchmarking Complex Instruction-Following in Task-Oriented Dialogues20 Nov 2025
- 2025PyTOD: Programmable Task-Oriented Dialogue with Execution Feedback21 Aug 2025
- 2025Agent WARPP: Workflow Adherence via Runtime Parallel Personalization23 Jul 2025
- 2025CoDial: Interpretable Task-Oriented Dialogue Systems Through Dialogue Flow Alignment2 Jun 2025
- 2025PicPersona-TOD : A Dataset for Personalizing Utterance Style in Task-Oriented Dialogue with Image Persona24 Apr 2025
- 2025VistaDPO: Video Hierarchical Spatial-Temporal Direct Preference Optimization for Large Video Models17 Apr 2025
- 2025Turning Conversations into Workflows: A Framework to Extract and Evaluate Dialog Workflows for Service AI Agents24 Feb 2025
- 2024DFlow: Diverse Dialogue Flow Simulation with Large Language Models18 Oct 2024
- 2024Dialog Flow Induction for Constrainable LLM-Based Chatbots3 Aug 2024
32 more
- 2024LLM-based Frameworks for API Argument Filling in Task-Oriented Conversational Systems27 Jun 2024
- 2024FlowBench: Revisiting and Benchmarking Workflow-Guided Planning for LLM-based Agents21 Jun 2024
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalization3 Jun 2024
- 2024Graph Integrated Language Transformers for Next Action Prediction in Complex Phone Calls11 Apr 2024
- 2024JMultiWOZ: A Large-Scale Japanese Multi-Domain Task-Oriented Dialogue Dataset26 Mar 2024
- 2024FLAP: Flow-Adhering Planning with Constrained Decoding in LLMs9 Mar 2024
- 2024TOAD: Task-Oriented Automatic Dialogs with Diverse Response Styles15 Feb 2024
- 2023ToolTalk: Evaluating Tool-Usage in a Conversational Setting15 Nov 2023
- 2023Self-Explanation Prompting Improves Dialogue Understanding in Large Language Models22 Sep 2023
- 2023DiactTOD: Learning Generalizable Latent Dialogue Acts for Controllable Task-Oriented Dialogue Systems1 Aug 2023
- 2023DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AI19 Jul 2023
- 2023SGP-TOD: Building Task Bots Effortlessly via Schema-Guided LLM Prompting15 May 2023
- 2023Out-of-Domain Intent Detection Considering Multi-Turn Dialogue Contexts5 May 2023
- 2023A Survey on Out-of-Distribution Detection in NLP5 May 2023
- 2023Zero-Shot Generalizable End-to-End Task-Oriented Dialog System using Context Summarization and Domain Schema28 Mar 2023
- 2022AnyTOD: A Programmable Task-Oriented Dialog System20 Dec 2022
- 2022CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluation21 Nov 2022
- 2022Pseudo-OOD training for robust language models17 Oct 2022
- 2022SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generation14 Sep 2022
- 2022SPACE-2: Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understanding14 Sep 2022
- 2022LAD: Language Models as Data for Zero-Shot Dialog28 Jul 2022
- 2022Knowledge-Grounded Conversational Data Augmentation with Generative Conversational Networks22 Jul 2022
- 2022A Flexible Schema-Guided Dialogue Management Framework: From Friendly Peer to Virtual Standardized Cancer Patient15 Jul 2022
- 2022A Multi-Task BERT Model for Schema-Guided Dialogue State Tracking2 Jul 2022
- 2022Where to Go for the Holidays: Towards Mixed-Type Dialogs for Clarification of User Goals15 Apr 2022
- 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injection29 Nov 2021
- 2021Few-Shot Bot: Prompt-Based Learning for Dialogue Systems15 Oct 2021
- 2021SGD-X: A Benchmark for Robust Generalization in Schema-Guided Dialogue Systems13 Oct 2021
- 2021GOLD: Improving Out-of-Scope Detection in Dialogues using Data Augmentation7 Sep 2021
- 2021Oh My Mistake!: Toward Realistic Dialogue State Tracking including Turnback Utterances28 Aug 2021
- 2021Schema-Guided Paradigm for Zero-Shot Dialog13 Jun 2021
- 2021BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modeling5 Jun 2021
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 208
- 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102
- 2021Few-Shot Bot: Prompt-Based Learning for Dialogue Systemscited by 64
- 2021BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modelingcited by 56
- 2023ToolTalk: Evaluating Tool-Usage in a Conversational Settingcited by 45
- 2023SGP-TOD: Building Task Bots Effortlessly via Schema-Guided LLM Promptingcited by 39
- 2021SGD-X: A Benchmark for Robust Generalization in Schema-Guided Dialogue Systemscited by 34
- 2022SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generationcited by 34
- 2023A Survey on Out-of-Distribution Detection in NLPcited by 31
- 2022SPACE-2: Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understandingcited by 28
- 2023DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AIcited by 22
- 2021GOLD: Improving Out-of-Scope Detection in Dialogues using Data Augmentationcited by 20
12 most cited of 40 All 40 (JSON)
- 2026CUEing User Simulators: Calibrated User Embeddings for Multi-Turn Benchmarking1 Oct 2026
- 2026INSURE-Dial: A Phase-Aware Conversational Dataset & Benchmark for Compliance Verification and Phase Detection28 Jan 2026
- 2026All Required, In Order: Phase-Level Evaluation for AI-Human Dialogue in Healthcare and Beyond13 Jan 2026
- 2025TOD-ProcBench: Benchmarking Complex Instruction-Following in Task-Oriented Dialogues20 Nov 2025
- 2025PyTOD: Programmable Task-Oriented Dialogue with Execution Feedback21 Aug 2025
- 2025PicPersona-TOD : A Dataset for Personalizing Utterance Style in Task-Oriented Dialogue with Image Persona24 Apr 2025
- 2025Turning Conversations into Workflows: A Framework to Extract and Evaluate Dialog Workflows for Service AI Agents24 Feb 2025
- 2024DFlow: Diverse Dialogue Flow Simulation with Large Language Models18 Oct 2024
- 2024Dialog Flow Induction for Constrainable LLM-Based Chatbots3 Aug 2024
- 2024LLM-based Frameworks for API Argument Filling in Task-Oriented Conversational Systems27 Jun 2024
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalization3 Jun 2024
- 2024Graph Integrated Language Transformers for Next Action Prediction in Complex Phone Calls11 Apr 2024
12 newest of 40 All 40 (JSON)