TOAD: Task-Oriented Automatic Dialogs with Diverse Response Styles
Not on the map. Why?
Abstract (arXiv)
In light of recent advances in large language models (LLMs), the expectations for the next generation of virtual assistants include enhanced naturalness and adaptability across diverse usage scenarios. However, the creation of high-quality annotated data for Task-Oriented Dialog (TOD) is recognized to be slow and costly. To address these challenges, we introduce Task-Oriented Automatic Dialogs (TOAD), a novel and scalable TOD dataset along with its automatic generation pipeline. The TOAD dataset simulates realistic app context interaction and provide a variety of system response style options. Two aspects of system response styles are considered, verbosity level and users' expression mirroring. We benchmark TOAD on two response generation tasks, and the results show that modeling more verbose responses or responses without user expression mirroring is more challenging.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 18 of its 38 references that are in the map. First posted on arXiv 15 Feb 2024.
Builds on
18 of 38 references.
References · 18
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 825
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
- 2019Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Datasetcited by 426
- 2023Evaluating Large Language Models at Evaluating Instruction Followingcited by 290
- 2016A Network-based End-to-End Trainable Task-oriented Dialogue Systemcited by 252
- 2022SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualizationcited by 166
- 2023Exploring the Use of Large Language Models for Reference-Free Text Quality Evaluation: An Empirical Studycited by 85
- 2017Frames: A Corpus for Adding Memory to Goal-Oriented Dialogue Systemscited by 84
- 2023PLACES: Prompting Language Models for Social Conversation Synthesiscited by 72
6 more
- 2018Building a Conversational Agent Overnight with Dialogue Self-Playcited by 70
- 2021SIMMC 2.0: A Task-oriented Dialog Dataset for Immersive Multimodal Conversationscited by 54
- 2020STAR: A Schema-Guided Dialog Dataset for Transfer Learningcited by 43
- 2023PRESTO: A Multilingual Dataset for Parsing Realistic Task-Oriented Dialogscited by 16
- 2023Multi3WOZ: A Multilingual, Multi-Domain, Multi-Parallel Dataset for Training and Evaluating Culturally Adapted Task-Oriented Dialog Systemscited by 16
- 2022A Survey of Intent Classification and Slot-Filling Datasets for Task-Oriented Dialogcited by 14
Built on by
Citing papers per year: 2024: 2; 2025: 1; 2026: 1.
4 papers.
- 2024Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluatorscited by 146
- 2025MemGuide: Intent-Driven Memory Selection for Goal-Oriented Multi-Session LLM Agentscited by 16
- 2024LUCID: LLM-Generated Utterances for Complex and Interesting Dialoguescited by 7
- 2026Action-Space Shaping for LLM Agents: Measuring and Mitigating Tool-Schema Biascited by 0
- 2026Action-Space Shaping for LLM Agents: Measuring and Mitigating Tool-Schema Bias28 Sep 2026
- 2025MemGuide: Intent-Driven Memory Selection for Goal-Oriented Multi-Session LLM Agents26 May 2025
- 2024Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators25 Mar 2024
- 2024LUCID: LLM-Generated Utterances for Complex and Interesting Dialogues1 Mar 2024