InstructTODS: Large Language Models for End-to-End Task-Oriented Dialogue Systems
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) have been used for diverse tasks in natural language processing (NLP), yet remain under-explored for task-oriented dialogue systems (TODS), especially for end-to-end TODS. We present InstructTODS, a novel off-the-shelf framework for zero-shot end-to-end task-oriented dialogue systems that can adapt to diverse domains without fine-tuning. By leveraging LLMs, InstructTODS generates a proxy belief state that seamlessly translates user intentions into dynamic queries for efficient interaction with any KB. Our extensive experiments demonstrate that InstructTODS achieves comparable performance to fully fine-tuned TODS in guiding dialogues to successful completion without prior knowledge or task-specific data. Furthermore, a rigorous human evaluation of end-to-end TODS shows that InstructTODS produces dialogue responses that notably outperform both the gold responses and the state-of-the-art TODS in terms of helpfulness, informativeness, and humanness. Moreover, the effectiveness of LLMs in TODS is further supported by our comprehensive evaluations on TODS subtasks: dialogue state tracking, intent classification, and response generation. Code and implementations could be found here https://github.com/WillyHC22/InstructTODS/
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 62 of its 93 references that are in the map. First posted on arXiv 13 Oct 2023.
Builds on
62 of 93 references.
References · 62
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
38 more
- 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
- 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 739
- 2020Efficient Intent Detection with Dual Sentence Encoderscited by 433
- 2019An Evaluation Dataset for Intent Classification and Out-of-Scope Predictioncited by 386
- 2020A Simple Language Model for Task-Oriented Dialoguecited by 332
- 2019Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systemscited by 216
- 2022Leveraging Large Language Models for Multiple Choice Question Answeringcited by 203
- 2018Neural Approaches to Conversational AIcited by 165
- 2017A Survey on Dialogue Systems: Recent Advances and New Frontierscited by 162
- 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
- 2017Key-Value Retrieval Networks for Task-Oriented Dialoguecited by 138
- 2023LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructionscited by 124
- 2020UBAR: Towards Fully End-to-End Task-Oriented Dialog Systems with GPT-2cited by 111
- 2020MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systemscited by 103
- 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102
- 2019Task-Oriented Dialog Systems that Consider Multiple Appropriate Responses under the Same Contextcited by 99
- 2020Recent Advances and Challenges in Task-oriented Dialog Systemcited by 78
- 2018Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systemscited by 70
- 2023BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfercited by 68
- 2020CrossWOZ: A Large-Scale Chinese Cross-Domain Task-Oriented Dialogue Datasetcited by 66
- 2023Multilingual Large Language Models Are Not (Yet) Code-Switcherscited by 65
- 2021BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modelingcited by 56
- 2021Zero-Shot Dialogue State Tracking via Cross-Task Transfercited by 52
- 2023Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languagescited by 51
- 2019Global-to-local Memory Pointer Networks for Task-Oriented Dialoguecited by 47
- 2020Discriminative Nearest Neighbor Few-Shot Intent Detection by Transferring Natural Language Inferencecited by 47
- 2020Deconstruct to Reconstruct a Configurable Evaluation Metric for Open-Domain Dialogue Systemscited by 47
- 2023Multi-lingual and Multi-cultural Figurative Language Understandingcited by 47
- 2021Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuningcited by 46
- 2019Structured Fusion Networks for Dialogcited by 40
- 2020Dynamic Fusion Network for Multi-Domain End-to-end Task-Oriented Dialogcited by 37
- 2022BigBIO: A Framework for Data-Centric Biomedical Natural Language Processingcited by 36
- 2020Learning Knowledge Bases with Parameters for Task-Oriented Dialogue Systemscited by 35
- 2021AuGPT: Auxiliary Tasks and Data Augmentation for End-To-End Dialogue with Pre-Trained Language Modelscited by 31
- 2021GlobalWoZ: Globalizing MultiWoZ to Develop Multilingual Task-Oriented Dialogue Systemscited by 31
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2024: 2; 2025: 2; 2026: 1.
5 papers.
- 2024Large Language Models Meet NLP: A Surveycited by 103
- 2025MemGuide: Intent-Driven Memory Selection for Goal-Oriented Multi-Session LLM Agentscited by 17
- 2024Beyond Ontology in Dialogue State Tracking for Goal-Oriented Chatbotcited by 0
- 2025MAC: A Multi-Agent Framework for Interactive User Clarification in Multi-turn Conversationscited by 0
- 2026GEM: Graph-Enhanced Mixture-of-Experts with ReAct Agents for Dialogue State Trackingcited by 0
- 2026GEM: Graph-Enhanced Mixture-of-Experts with ReAct Agents for Dialogue State Tracking6 May 2026
- 2025MAC: A Multi-Agent Framework for Interactive User Clarification in Multi-turn Conversations15 Dec 2025
- 2025MemGuide: Intent-Driven Memory Selection for Goal-Oriented Multi-Session LLM Agents26 May 2025
- 2024Beyond Ontology in Dialogue State Tracking for Goal-Oriented Chatbot30 Oct 2024
- 2024Large Language Models Meet NLP: A Survey21 May 2024