MonoTODia: Translating Monologue Requests to Task-Oriented Dialogues
Not on the map. Why?
Abstract (arXiv)
Data scarcity is one of the main problems when it comes to real-world applications of transformer-based models. This is especially evident for task-oriented dialogue (TOD) systems, which require specialized datasets, that are usually not readily available. This can hinder companies from adding TOD systems to their services. This study therefore investigates a novel approach to sourcing annotated dialogues from existing German monologue material. Focusing on a real-world example, we investigate whether these monologues can be transformed into dialogue formats suitable for training TOD systems. We show the approach with the concrete example of a company specializing in travel bookings via e-mail. We fine-tune state-of-the-art Large Language Models for the task of rewriting e-mails as dialogues and annotating them. To ensure the quality and validity of the generated data, we employ crowd workers to evaluate the dialogues across multiple criteria and to provide gold-standard annotations for the test dataset. We further evaluate the usefulness of the dialogues for training TOD systems. Our evaluation shows that the dialogues and annotations are of high quality and can serve as a valuable starting point for training TOD systems. Finally, we make the annotated dataset publicly available to foster future research.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 49 references that are in the map. First posted on arXiv 24 Feb 2025.
Builds on
31 of 49 references.
References · 31
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
- 2023Instruction Tuning for Large Language Models: A Surveycited by 617
- 2019Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Datasetcited by 426
- 2022Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Textcited by 154
- 2024Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Datacited by 143
- 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
- 2017Key-Value Retrieval Networks for Task-Oriented Dialoguecited by 137
19 more
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2019Survey on Evaluation Methods for Dialogue Systemscited by 126
- 2024A Note on Shumailov et al. (2024): `AI Models Collapse When Trained on Recursively Generated Data'cited by 114
- 2020MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systemscited by 103
- 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102
- 2023PLACES: Prompting Language Models for Social Conversation Synthesiscited by 72
- 2022Controllable Dialogue Simulation with In-Context Learningcited by 42
- 2021AuGPT: Auxiliary Tasks and Data Augmentation for End-To-End Dialogue with Pre-Trained Language Modelscited by 31
- 2023Task-Optimized Adapters for an End-to-End Task-Oriented Dialogue Systemcited by 30
- 2022Building a Role Specified Open-Domain Dialogue System Leveraging Large-Scale Language Modelscited by 26
- 2022LAD: Language Models as Data for Zero-Shot Dialogcited by 18
- 2024SynthDST: Synthetic Data is All You Need for Few-Shot Dialog State Trackingcited by 17
- 2020Conversation Graph: Data Augmentation, Training and Evaluation for Non-Deterministic Dialogue Managementcited by 13
- 2024HR-MultiWOZ: A Task Oriented Dialogue (TOD) Dataset for HR LLM Agentcited by 12
- 2018Sequence-to-Sequence Models for Data-to-Text Natural Language Generation: Word- vs. Character-based Processing and Output Diversitycited by 6
- 2021CAiRE in DialDoc21: Data Augmentation for Information-Seeking Dialogue Systemcited by 5
- 2021SYNERGY: Building Task Bots at Scale Using Symbolic Knowledge and Machine Teachingcited by 3
- 2023Contextual Data Augmentation for Task-Oriented Dialog Systemscited by 2
- 2024CoPrUS: Consistency Preserving Utterance Synthesis towards more realistic benchmark dialoguescited by 2
Built on by
Not cited yet.