SGP-TOD: Building Task Bots Effortlessly via Schema-Guided LLM Prompting
Not on the map. Why?
Abstract (arXiv)
Building end-to-end task bots and maintaining their integration with new functionalities using minimal human efforts is a long-standing challenge in dialog research. Recently large language models (LLMs) have demonstrated exceptional proficiency in conversational engagement and adherence to instructions across various downstream tasks. In this work, we introduce SGP-TOD, Schema-Guided Prompting for building Task-Oriented Dialog systems effortlessly based on LLMs. Utilizing the symbolic knowledge -- task schema, we instruct fixed LLMs to generate appropriate responses on novel tasks, circumventing the need for training data. Specifically, SGP-TOD comprises three components: a LLM for engaging with users, a DST Prompter to aid the LLM with dialog state tracking, which is then used to retrieve database items, and a Policy Prompter to elicit proper responses adhering to the provided dialog policy. Experimental results on Multiwoz, RADDLE and STAR datasets show that our training-free strategy SGP-TOD, without any task-specific data, yields state-of-the-art (SOTA) zero-shot performance, greatly surpasses the few-shot approaches. In a domain-extension setting, SGP-TOD aptly adapts to new functionalities by merely adding supplementary schema rules. We make our code and data publicly available.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). Builds on 52 of its 66 references that are in the map. First posted on arXiv 15 May 2023.
Builds on
52 of 66 references.
References · 52
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
- 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 858
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
38 more
- 2022A Survey on In-context Learningcited by 717
- 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 486
- 2019Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Datasetcited by 426
- 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 351
- 2020A Simple Language Model for Task-Oriented Dialoguecited by 331
- 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
- 2022Binding Language Models in Symbolic Languagescited by 224
- 2019Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systemscited by 215
- 2023On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspectivecited by 208
- 2020MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselinescited by 201
- 2022Scaling Up Models and Data with textttt5x and textttseqiocited by 187
- 2023TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIscited by 184
- 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
- 2020UBAR: Towards Fully End-to-End Task-Oriented Dialog Systems with GPT-2cited by 111
- 2020MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systemscited by 103
- 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102
- 2019Task-Oriented Dialog Systems that Consider Multiple Appropriate Responses under the Same Contextcited by 99
- 2021Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoningcited by 85
- 2020Zero-Shot Transfer Learning with Synthesized Data for Multi-Domain Dialogue State Trackingcited by 65
- 2021Few-Shot Bot: Prompt-Based Learning for Dialogue Systemscited by 64
- 2021Leveraging Slot Descriptions for Zero-Shot Cross-Domain Dialogue State Trackingcited by 61
- 2021Zero-Shot Dialogue State Tracking via Cross-Task Transfercited by 52
- 2021Few-Shot Semantic Parsing with Language Models Trained On Codecited by 50
- 2020Overview of the Ninth Dialog System Technology Challenge: DSTC9cited by 49
- 2020STAR: A Schema-Guided Dialog Dataset for Transfer Learningcited by 43
- 2022Controllable Dialogue Simulation with In-Context Learningcited by 42
- 2017Machine Teaching: A New Paradigm for Building Machine Learning Systemscited by 41
- 2019Domain Adaptive Dialog Generation via Meta Learningcited by 41
- 2019Robust Zero-Shot Cross-Domain Slot Filling with Example Valuescited by 38
- 2020RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systemscited by 36
- 2022Towards Identifying Social Bias in Dialog Systems: Frame, Datasets, and Benchmarkscited by 36
- 2021Few-shot Intent Classification and Slot Filling with Retrieved Examplescited by 35
- 2017BBQ-Networks: Efficient Exploration in Deep Reinforcement Learning for Task-Oriented Dialogue Systemscited by 30
- 2018Zero-Shot Dialog Generation with Cross-Domain Latent Actionscited by 23
- 2022LAD: Language Models as Data for Zero-Shot Dialogcited by 18
- 2021Schema-Guided Paradigm for Zero-Shot Dialogcited by 13
- 2022AnyTOD: A Programmable Task-Oriented Dialog Systemcited by 10
- 2020Conversation Learner -- A Machine Teaching Tool for Building Dialog Managers for Task-Oriented Dialog Systemscited by 9
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2023: 6; 2024: 16; 2025: 15; 2026: 2.
39 papers.
Sort:
By area:
- 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 347
- 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaborationcited by 115
- 2024Large Language Models Meet NLP: A Surveycited by 102
- 2025Critique-GRPO: Advancing LLM Reasoning with Natural Language and Numerical Feedbackcited by 86
- 2024Self-Alignment for Factuality: Mitigating Hallucinations in LLMs via Self-Evaluationcited by 79
- 2023Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agentscited by 76
- 2023Recursively Summarizing Enables Long-Term Dialogue Memory in Large Language Modelscited by 62
- 2024Bootstrapping LLM-based Task-Oriented Dialogue Agents via Self-Talkcited by 34
- 2024Large Language Models as Zero-shot Dialogue State Tracker through Function Callingcited by 34
- 2024Planning Like Human: A Dual-process Framework for Dialogue Planningcited by 32
- 2025Can a Single Model Master Both Multi-turn Conversations and Tool Use? CoALM: A Unified Conversational Agentic Language Modelcited by 20
- 2024Self-Tuning: Instructing LLMs to Effectively Acquire New Knowledge through Self-Teachingcited by 17
27 more
- 2024Large Language Models as Software Components: A Taxonomy for LLM-Integrated Applicationscited by 17
- 2024PRACTIQ: A Practical Conversational Text-to-SQL dataset with Ambiguous and Unanswerable Queriescited by 17
- 2024ReSpAct: Harmonizing Reasoning, Speaking, and Acting Towards Building Large Language Model-Based Conversational AI Agentscited by 14
- 2025Rethinking Stateful Tool Use in Multi-Turn Dialogues: Benchmarks and Challengescited by 12
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directionscited by 9
- 2025Will Pre-Training Ever End? A First Step Toward Next-Generation Foundation MLLMs via Self-Improving Systematic Cognitioncited by 7
- 2024Simulating Task-Oriented Dialogues with State Transition Graphs and Large Language Modelscited by 6
- 2025The Behavior Gap: Evaluating Zero-shot LLM Agents in Complex Task-Oriented Dialogscited by 6
- 2024Unsupervised End-to-End Task-Oriented Dialogue with LLMs: The Power of the Noisy Channelcited by 5
- 2024TransferTOD: A Generalizable Chinese Multi-Domain Task-Oriented Dialogue System with Transfer Capabilitiescited by 4
- 2025FishBargain: An LLM-Empowered Bargaining Agent for Online Fleamarket Platform Sellerscited by 4
- 2023Speech-based Slot Filling using Large Language Modelscited by 3
- 2024Learning from Implicit User Feedback, Emotions and Demographic Information in Task-Oriented and Document-Grounded Dialoguescited by 3
- 2025PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowchartscited by 3
- 2025Empowering LLMs in Task-Oriented Dialogues: A Domain-Independent Multi-Agent Framework and Fine-Tuning Strategycited by 3
- 2025FairCauseSyn: Towards Causally Fair LLM-Augmented Synthetic Data Generationcited by 3
- 2024Controllable and Reliable Knowledge-Intensive Task-Oriented Conversational Agents with Declarative Genie Worksheetscited by 2
- 2025Towards AI-Driven Human-Machine Co-Teaming for Adaptive and Agile Cyber Security Operation Centerscited by 2
- 2023Application of frozen large-scale models to multimodal task-oriented dialoguecited by 1
- 2024DIALIGHT: Lightweight Multilingual Development and Evaluation of Task-Oriented Dialogue Systems with Large Language Modelscited by 1
- 2024HR-Agent: A Task-Oriented Dialogue (TOD) LLM Agent Tailored for HR Applicationscited by 1
- 2025CoDial: Interpretable Task-Oriented Dialogue Systems Through Dialogue Flow Alignmentcited by 1
- 2025PyTOD: Programmable Task-Oriented Dialogue with Execution Feedbackcited by 1
- 2026One Model, Multiple Goals: Adaptive Multi-Objective Learning for E-commerce Dialogue Systemscited by 1
- 2025Spec-TOD: A Specialized Instruction-Tuned LLM Framework for Efficient Task-Oriented Dialogue Systemscited by 0
- 2025DSCC-HS: A Dynamic Self-Reinforcing Framework for Hallucination Suppression in Large Language Modelscited by 0
- 2026ESAinsTOD: A Unified End-to-End Schema-Aware Instruction-Tuning Framework for Task-Oriented Dialog Modelingcited by 0
- 2026One Model, Multiple Goals: Adaptive Multi-Objective Learning for E-commerce Dialogue Systems8 Jun 2026
- 2026ESAinsTOD: A Unified End-to-End Schema-Aware Instruction-Tuning Framework for Task-Oriented Dialog Modeling10 Mar 2026
- 2025DSCC-HS: A Dynamic Self-Reinforcing Framework for Hallucination Suppression in Large Language Models17 Sep 2025
- 2025PyTOD: Programmable Task-Oriented Dialogue with Execution Feedback21 Aug 2025
- 2025Spec-TOD: A Specialized Instruction-Tuned LLM Framework for Efficient Task-Oriented Dialogue Systems7 Jul 2025
- 2025FairCauseSyn: Towards Causally Fair LLM-Augmented Synthetic Data Generation23 Jun 2025
- 2025The Behavior Gap: Evaluating Zero-shot LLM Agents in Complex Task-Oriented Dialogs13 Jun 2025
- 2025Critique-GRPO: Advancing LLM Reasoning with Natural Language and Numerical Feedback3 Jun 2025
- 2025CoDial: Interpretable Task-Oriented Dialogue Systems Through Dialogue Flow Alignment2 Jun 2025
- 2025Empowering LLMs in Task-Oriented Dialogues: A Domain-Independent Multi-Agent Framework and Fine-Tuning Strategy20 May 2025
- 2025Rethinking Stateful Tool Use in Multi-Turn Dialogues: Benchmarks and Challenges19 May 2025
- 2025Towards AI-Driven Human-Machine Co-Teaming for Adaptive and Agile Cyber Security Operation Centers9 May 2025
27 more
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions7 Apr 2025
- 2025Will Pre-Training Ever End? A First Step Toward Next-Generation Foundation MLLMs via Self-Improving Systematic Cognition16 Mar 2025
- 2025PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowcharts9 Mar 2025
- 2025Can a Single Model Master Both Multi-turn Conversations and Tool Use? CoALM: A Unified Conversational Agentic Language Model12 Feb 2025
- 2025FishBargain: An LLM-Empowered Bargaining Agent for Online Fleamarket Platform Sellers22 Jan 2025
- 2024ReSpAct: Harmonizing Reasoning, Speaking, and Acting Towards Building Large Language Model-Based Conversational AI Agents1 Nov 2024
- 2024HR-Agent: A Task-Oriented Dialogue (TOD) LLM Agent Tailored for HR Applications15 Oct 2024
- 2024PRACTIQ: A Practical Conversational Text-to-SQL dataset with Ambiguous and Unanswerable Queries14 Oct 2024
- 2024TransferTOD: A Generalizable Chinese Multi-Domain Task-Oriented Dialogue System with Transfer Capabilities31 Jul 2024
- 2024Controllable and Reliable Knowledge-Intensive Task-Oriented Conversational Agents with Declarative Genie Worksheets8 Jul 2024
- 2024Large Language Models as Software Components: A Taxonomy for LLM-Integrated Applications13 Jun 2024
- 2024Self-Tuning: Instructing LLMs to Effectively Acquire New Knowledge through Self-Teaching10 Jun 2024
- 2024Planning Like Human: A Dual-process Framework for Dialogue Planning8 Jun 2024
- 2024Large Language Models Meet NLP: A Survey21 May 2024
- 2024Unsupervised End-to-End Task-Oriented Dialogue with LLMs: The Power of the Noisy Channel23 Apr 2024
- 2024Simulating Task-Oriented Dialogues with State Transition Graphs and Large Language Models23 Apr 2024
- 2024Large Language Models as Zero-shot Dialogue State Tracker through Function Calling16 Feb 2024
- 2024Self-Alignment for Factuality: Mitigating Hallucinations in LLMs via Self-Evaluation14 Feb 2024
- 2024Learning from Implicit User Feedback, Emotions and Demographic Information in Task-Oriented and Document-Grounded Dialogues17 Jan 2024
- 2024Bootstrapping LLM-based Task-Oriented Dialogue Agents via Self-Talk10 Jan 2024
- 2024DIALIGHT: Lightweight Multilingual Development and Evaluation of Task-Oriented Dialogue Systems with Large Language Models4 Jan 2024
- 2023Speech-based Slot Filling using Large Language Models13 Nov 2023
- 2023Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agents1 Nov 2023
- 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Rails16 Oct 2023
- 2023Application of frozen large-scale models to multimodal task-oriented dialogue2 Oct 2023
- 2023Recursively Summarizing Enables Long-Term Dialogue Memory in Large Language Models29 Aug 2023
- 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaboration23 May 2023
- 2023Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agentscited by 76
- 2024Bootstrapping LLM-based Task-Oriented Dialogue Agents via Self-Talkcited by 34
- 2024Large Language Models as Zero-shot Dialogue State Tracker through Function Callingcited by 34
- 2025Can a Single Model Master Both Multi-turn Conversations and Tool Use? CoALM: A Unified Conversational Agentic Language Modelcited by 20
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directionscited by 9
- 2025The Behavior Gap: Evaluating Zero-shot LLM Agents in Complex Task-Oriented Dialogscited by 6
- 2025FishBargain: An LLM-Empowered Bargaining Agent for Online Fleamarket Platform Sellerscited by 4
- 2025Empowering LLMs in Task-Oriented Dialogues: A Domain-Independent Multi-Agent Framework and Fine-Tuning Strategycited by 3
- 2024Controllable and Reliable Knowledge-Intensive Task-Oriented Conversational Agents with Declarative Genie Worksheetscited by 2
- 2024HR-Agent: A Task-Oriented Dialogue (TOD) LLM Agent Tailored for HR Applicationscited by 1
- 2025The Behavior Gap: Evaluating Zero-shot LLM Agents in Complex Task-Oriented Dialogs13 Jun 2025
- 2025Empowering LLMs in Task-Oriented Dialogues: A Domain-Independent Multi-Agent Framework and Fine-Tuning Strategy20 May 2025
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions7 Apr 2025
- 2025Can a Single Model Master Both Multi-turn Conversations and Tool Use? CoALM: A Unified Conversational Agentic Language Model12 Feb 2025
- 2025FishBargain: An LLM-Empowered Bargaining Agent for Online Fleamarket Platform Sellers22 Jan 2025
- 2024HR-Agent: A Task-Oriented Dialogue (TOD) LLM Agent Tailored for HR Applications15 Oct 2024
- 2024Controllable and Reliable Knowledge-Intensive Task-Oriented Conversational Agents with Declarative Genie Worksheets8 Jul 2024
- 2024Large Language Models as Zero-shot Dialogue State Tracker through Function Calling16 Feb 2024
- 2024Bootstrapping LLM-based Task-Oriented Dialogue Agents via Self-Talk10 Jan 2024
- 2023Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agents1 Nov 2023
- 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 347
- 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaborationcited by 115
- 2024Large Language Models Meet NLP: A Surveycited by 102
- 2023Recursively Summarizing Enables Long-Term Dialogue Memory in Large Language Modelscited by 62
- 2024Planning Like Human: A Dual-process Framework for Dialogue Planningcited by 32
- 2024Self-Tuning: Instructing LLMs to Effectively Acquire New Knowledge through Self-Teachingcited by 17
- 2024Large Language Models as Software Components: A Taxonomy for LLM-Integrated Applicationscited by 17
- 2024PRACTIQ: A Practical Conversational Text-to-SQL dataset with Ambiguous and Unanswerable Queriescited by 17
- 2024Unsupervised End-to-End Task-Oriented Dialogue with LLMs: The Power of the Noisy Channelcited by 5
- 2024TransferTOD: A Generalizable Chinese Multi-Domain Task-Oriented Dialogue System with Transfer Capabilitiescited by 4
- 2023Speech-based Slot Filling using Large Language Modelscited by 3
- 2024Learning from Implicit User Feedback, Emotions and Demographic Information in Task-Oriented and Document-Grounded Dialoguescited by 3
12 most cited of 21 All 21 (JSON)
- 2026One Model, Multiple Goals: Adaptive Multi-Objective Learning for E-commerce Dialogue Systems8 Jun 2026
- 2026ESAinsTOD: A Unified End-to-End Schema-Aware Instruction-Tuning Framework for Task-Oriented Dialog Modeling10 Mar 2026
- 2025DSCC-HS: A Dynamic Self-Reinforcing Framework for Hallucination Suppression in Large Language Models17 Sep 2025
- 2025PyTOD: Programmable Task-Oriented Dialogue with Execution Feedback21 Aug 2025
- 2025Spec-TOD: A Specialized Instruction-Tuned LLM Framework for Efficient Task-Oriented Dialogue Systems7 Jul 2025
- 2025Towards AI-Driven Human-Machine Co-Teaming for Adaptive and Agile Cyber Security Operation Centers9 May 2025
- 2025PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowcharts9 Mar 2025
- 2024PRACTIQ: A Practical Conversational Text-to-SQL dataset with Ambiguous and Unanswerable Queries14 Oct 2024
- 2024TransferTOD: A Generalizable Chinese Multi-Domain Task-Oriented Dialogue System with Transfer Capabilities31 Jul 2024
- 2024Large Language Models as Software Components: A Taxonomy for LLM-Integrated Applications13 Jun 2024
- 2024Self-Tuning: Instructing LLMs to Effectively Acquire New Knowledge through Self-Teaching10 Jun 2024
- 2024Planning Like Human: A Dual-process Framework for Dialogue Planning8 Jun 2024
12 newest of 21 All 21 (JSON)