mlsanityData to 14 Oct 2026

InstructTODS: Large Language Models for End-to-End Task-Oriented Dialogue Systems

arXiv 2310.08885 ↗First posted 13 Oct 2023cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) have been used for diverse tasks in natural language processing (NLP), yet remain under-explored for task-oriented dialogue systems (TODS), especially for end-to-end TODS. We present InstructTODS, a novel off-the-shelf framework for zero-shot end-to-end task-oriented dialogue systems that can adapt to diverse domains without fine-tuning. By leveraging LLMs, InstructTODS generates a proxy belief state that seamlessly translates user intentions into dynamic queries for efficient interaction with any KB. Our extensive experiments demonstrate that InstructTODS achieves comparable performance to fully fine-tuned TODS in guiding dialogues to successful completion without prior knowledge or task-specific data. Furthermore, a rigorous human evaluation of end-to-end TODS shows that InstructTODS produces dialogue responses that notably outperform both the gold responses and the state-of-the-art TODS in terms of helpfulness, informativeness, and humanness. Moreover, the effectiveness of LLMs in TODS is further supported by our comprehensive evaluations on TODS subtasks: dialogue state tracking, intent classification, and response generation. Code and implementations could be found here https://github.com/WillyHC22/InstructTODS/

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 62 of its 93 references that are in the map. First posted on arXiv 13 Oct 2023.

Builds on

62 of 93 references.

References · 62

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  7. 2017Deep reinforcement learning from human preferencescited by 3,912
  8. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  9. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  10. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  11. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
  12. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
38 more
  1. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
  2. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  3. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  4. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
  5. 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 739
  6. 2020Efficient Intent Detection with Dual Sentence Encoderscited by 433
  7. 2019An Evaluation Dataset for Intent Classification and Out-of-Scope Predictioncited by 386
  8. 2020A Simple Language Model for Task-Oriented Dialoguecited by 332
  9. 2019Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systemscited by 216
  10. 2022Leveraging Large Language Models for Multiple Choice Question Answeringcited by 203
  11. 2018Neural Approaches to Conversational AIcited by 165
  12. 2017A Survey on Dialogue Systems: Recent Advances and New Frontierscited by 162
  13. 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
  14. 2017Key-Value Retrieval Networks for Task-Oriented Dialoguecited by 138
  15. 2023LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructionscited by 124
  16. 2020UBAR: Towards Fully End-to-End Task-Oriented Dialog Systems with GPT-2cited by 111
  17. 2020MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systemscited by 103
  18. 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102
  19. 2019Task-Oriented Dialog Systems that Consider Multiple Appropriate Responses under the Same Contextcited by 99
  20. 2020Recent Advances and Challenges in Task-oriented Dialog Systemcited by 78
  21. 2018Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systemscited by 70
  22. 2023BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfercited by 68
  23. 2020CrossWOZ: A Large-Scale Chinese Cross-Domain Task-Oriented Dialogue Datasetcited by 66
  24. 2023Multilingual Large Language Models Are Not (Yet) Code-Switcherscited by 65
  25. 2021BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modelingcited by 56
  26. 2021Zero-Shot Dialogue State Tracking via Cross-Task Transfercited by 52
  27. 2023Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languagescited by 51
  28. 2019Global-to-local Memory Pointer Networks for Task-Oriented Dialoguecited by 47
  29. 2020Discriminative Nearest Neighbor Few-Shot Intent Detection by Transferring Natural Language Inferencecited by 47
  30. 2020Deconstruct to Reconstruct a Configurable Evaluation Metric for Open-Domain Dialogue Systemscited by 47
  31. 2023Multi-lingual and Multi-cultural Figurative Language Understandingcited by 47
  32. 2021Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuningcited by 46
  33. 2019Structured Fusion Networks for Dialogcited by 40
  34. 2020Dynamic Fusion Network for Multi-Domain End-to-end Task-Oriented Dialogcited by 37
  35. 2022BigBIO: A Framework for Data-Centric Biomedical Natural Language Processingcited by 36
  36. 2020Learning Knowledge Bases with Parameters for Task-Oriented Dialogue Systemscited by 35
  37. 2021AuGPT: Auxiliary Tasks and Data Augmentation for End-To-End Dialogue with Pre-Trained Language Modelscited by 31
  38. 2021GlobalWoZ: Globalizing MultiWoZ to Develop Multilingual Task-Oriented Dialogue Systemscited by 31

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 2; 2026: 1.

5 papers.