mlsanityData to 7 Oct 2026

SGP-TOD: Building Task Bots Effortlessly via Schema-Guided LLM Prompting

arXiv 2305.09067 ↗First posted 15 May 2023cs.CLcited by 39

Not on the map. Why?

Abstract (arXiv)

Building end-to-end task bots and maintaining their integration with new functionalities using minimal human efforts is a long-standing challenge in dialog research. Recently large language models (LLMs) have demonstrated exceptional proficiency in conversational engagement and adherence to instructions across various downstream tasks. In this work, we introduce SGP-TOD, Schema-Guided Prompting for building Task-Oriented Dialog systems effortlessly based on LLMs. Utilizing the symbolic knowledge -- task schema, we instruct fixed LLMs to generate appropriate responses on novel tasks, circumventing the need for training data. Specifically, SGP-TOD comprises three components: a LLM for engaging with users, a DST Prompter to aid the LLM with dialog state tracking, which is then used to retrieve database items, and a Policy Prompter to elicit proper responses adhering to the provided dialog policy. Experimental results on Multiwoz, RADDLE and STAR datasets show that our training-free strategy SGP-TOD, without any task-specific data, yields state-of-the-art (SOTA) zero-shot performance, greatly surpasses the few-shot approaches. In a domain-extension setting, SGP-TOD aptly adapts to new functionalities by merely adding supplementary schema rules. We make our code and data publicly available.

Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). Builds on 52 of its 66 references that are in the map. First posted on arXiv 15 May 2023.

Builds on

52 of 66 references.

References · 52

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  6. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  7. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  8. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  9. 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
  10. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  11. 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 858
  12. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
38 more
  1. 2022A Survey on In-context Learningcited by 717
  2. 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 486
  3. 2019Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Datasetcited by 426
  4. 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 351
  5. 2020A Simple Language Model for Task-Oriented Dialoguecited by 331
  6. 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
  7. 2022Binding Language Models in Symbolic Languagescited by 224
  8. 2019Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systemscited by 215
  9. 2023On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspectivecited by 208
  10. 2020MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselinescited by 201
  11. 2022Scaling Up Models and Data with textttt5x and textttseqiocited by 187
  12. 2023TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIscited by 184
  13. 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
  14. 2020UBAR: Towards Fully End-to-End Task-Oriented Dialog Systems with GPT-2cited by 111
  15. 2020MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systemscited by 103
  16. 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102
  17. 2019Task-Oriented Dialog Systems that Consider Multiple Appropriate Responses under the Same Contextcited by 99
  18. 2021Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoningcited by 85
  19. 2020Zero-Shot Transfer Learning with Synthesized Data for Multi-Domain Dialogue State Trackingcited by 65
  20. 2021Few-Shot Bot: Prompt-Based Learning for Dialogue Systemscited by 64
  21. 2021Leveraging Slot Descriptions for Zero-Shot Cross-Domain Dialogue State Trackingcited by 61
  22. 2021Zero-Shot Dialogue State Tracking via Cross-Task Transfercited by 52
  23. 2021Few-Shot Semantic Parsing with Language Models Trained On Codecited by 50
  24. 2020Overview of the Ninth Dialog System Technology Challenge: DSTC9cited by 49
  25. 2020STAR: A Schema-Guided Dialog Dataset for Transfer Learningcited by 43
  26. 2022Controllable Dialogue Simulation with In-Context Learningcited by 42
  27. 2017Machine Teaching: A New Paradigm for Building Machine Learning Systemscited by 41
  28. 2019Domain Adaptive Dialog Generation via Meta Learningcited by 41
  29. 2019Robust Zero-Shot Cross-Domain Slot Filling with Example Valuescited by 38
  30. 2020RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systemscited by 36
  31. 2022Towards Identifying Social Bias in Dialog Systems: Frame, Datasets, and Benchmarkscited by 36
  32. 2021Few-shot Intent Classification and Slot Filling with Retrieved Examplescited by 35
  33. 2017BBQ-Networks: Efficient Exploration in Deep Reinforcement Learning for Task-Oriented Dialogue Systemscited by 30
  34. 2018Zero-Shot Dialog Generation with Cross-Domain Latent Actionscited by 23
  35. 2022LAD: Language Models as Data for Zero-Shot Dialogcited by 18
  36. 2021Schema-Guided Paradigm for Zero-Shot Dialogcited by 13
  37. 2022AnyTOD: A Programmable Task-Oriented Dialog Systemcited by 10
  38. 2020Conversation Learner -- A Machine Teaching Tool for Building Dialog Managers for Task-Oriented Dialog Systemscited by 9

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 6; 2024: 16; 2025: 15; 2026: 2.

39 papers.

Sort:

By area:

  1. 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 347
  2. 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaborationcited by 115
  3. 2024Large Language Models Meet NLP: A Surveycited by 102
  4. 2025Critique-GRPO: Advancing LLM Reasoning with Natural Language and Numerical Feedbackcited by 86
  5. 2024Self-Alignment for Factuality: Mitigating Hallucinations in LLMs via Self-Evaluationcited by 79
  6. 2023Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agentscited by 76
  7. 2023Recursively Summarizing Enables Long-Term Dialogue Memory in Large Language Modelscited by 62
  8. 2024Bootstrapping LLM-based Task-Oriented Dialogue Agents via Self-Talkcited by 34
  9. 2024Large Language Models as Zero-shot Dialogue State Tracker through Function Callingcited by 34
  10. 2024Planning Like Human: A Dual-process Framework for Dialogue Planningcited by 32
  11. 2025Can a Single Model Master Both Multi-turn Conversations and Tool Use? CoALM: A Unified Conversational Agentic Language Modelcited by 20
  12. 2024Self-Tuning: Instructing LLMs to Effectively Acquire New Knowledge through Self-Teachingcited by 17
27 more
  1. 2024Large Language Models as Software Components: A Taxonomy for LLM-Integrated Applicationscited by 17
  2. 2024PRACTIQ: A Practical Conversational Text-to-SQL dataset with Ambiguous and Unanswerable Queriescited by 17
  3. 2024ReSpAct: Harmonizing Reasoning, Speaking, and Acting Towards Building Large Language Model-Based Conversational AI Agentscited by 14
  4. 2025Rethinking Stateful Tool Use in Multi-Turn Dialogues: Benchmarks and Challengescited by 12
  5. 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directionscited by 9
  6. 2025Will Pre-Training Ever End? A First Step Toward Next-Generation Foundation MLLMs via Self-Improving Systematic Cognitioncited by 7
  7. 2024Simulating Task-Oriented Dialogues with State Transition Graphs and Large Language Modelscited by 6
  8. 2025The Behavior Gap: Evaluating Zero-shot LLM Agents in Complex Task-Oriented Dialogscited by 6
  9. 2024Unsupervised End-to-End Task-Oriented Dialogue with LLMs: The Power of the Noisy Channelcited by 5
  10. 2024TransferTOD: A Generalizable Chinese Multi-Domain Task-Oriented Dialogue System with Transfer Capabilitiescited by 4
  11. 2025FishBargain: An LLM-Empowered Bargaining Agent for Online Fleamarket Platform Sellerscited by 4
  12. 2023Speech-based Slot Filling using Large Language Modelscited by 3
  13. 2024Learning from Implicit User Feedback, Emotions and Demographic Information in Task-Oriented and Document-Grounded Dialoguescited by 3
  14. 2025PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowchartscited by 3
  15. 2025Empowering LLMs in Task-Oriented Dialogues: A Domain-Independent Multi-Agent Framework and Fine-Tuning Strategycited by 3
  16. 2025FairCauseSyn: Towards Causally Fair LLM-Augmented Synthetic Data Generationcited by 3
  17. 2024Controllable and Reliable Knowledge-Intensive Task-Oriented Conversational Agents with Declarative Genie Worksheetscited by 2
  18. 2025Towards AI-Driven Human-Machine Co-Teaming for Adaptive and Agile Cyber Security Operation Centerscited by 2
  19. 2023Application of frozen large-scale models to multimodal task-oriented dialoguecited by 1
  20. 2024DIALIGHT: Lightweight Multilingual Development and Evaluation of Task-Oriented Dialogue Systems with Large Language Modelscited by 1
  21. 2024HR-Agent: A Task-Oriented Dialogue (TOD) LLM Agent Tailored for HR Applicationscited by 1
  22. 2025CoDial: Interpretable Task-Oriented Dialogue Systems Through Dialogue Flow Alignmentcited by 1
  23. 2025PyTOD: Programmable Task-Oriented Dialogue with Execution Feedbackcited by 1
  24. 2026One Model, Multiple Goals: Adaptive Multi-Objective Learning for E-commerce Dialogue Systemscited by 1
  25. 2025Spec-TOD: A Specialized Instruction-Tuned LLM Framework for Efficient Task-Oriented Dialogue Systemscited by 0
  26. 2025DSCC-HS: A Dynamic Self-Reinforcing Framework for Hallucination Suppression in Large Language Modelscited by 0
  27. 2026ESAinsTOD: A Unified End-to-End Schema-Aware Instruction-Tuning Framework for Task-Oriented Dialog Modelingcited by 0