Synergizing In-context Learning with Hints for End-to-end Task-oriented Dialog Systems
Not on the map. Why?
Abstract (arXiv)
End-to-end Task-Oriented Dialog (TOD) systems typically require extensive training datasets to perform well. In contrast, large language model (LLM) based TOD systems can excel even with limited data due to their ability to learn tasks through in-context exemplars. However, these models lack alignment with the style of responses in training data and often generate comprehensive responses, making it difficult for users to grasp the information quickly. In response, we propose SyncTOD that synergizes LLMs with task-specific hints to improve alignment in low-data settings. SyncTOD employs small auxiliary models to provide hints and select exemplars for in-context prompts. With ChatGPT, SyncTOD achieves superior performance compared to LLM-based baselines and SoTA models in low-data settings, while retaining competitive performance in full-data settings.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 32 of its 59 references that are in the map. First posted on arXiv 24 May 2024.
Builds on
32 of 59 references.
References · 32
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
- 2023In-Context Retrieval-Augmented Language Modelscited by 702
- 2019Passage Re-ranking with BERTcited by 645
- 2020A Simple Language Model for Task-Oriented Dialoguecited by 332
- 2016A Network-based End-to-End Trainable Task-oriented Dialogue Systemcited by 252
- 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
20 more
- 2017Key-Value Retrieval Networks for Task-Oriented Dialoguecited by 138
- 2023Guiding Large Language Models via Directional Stimulus Promptingcited by 95
- 2018Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systemscited by 70
- 2023A Multi-Task Embedder For Retrieval Augmented LLMscited by 64
- 2021BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modelingcited by 56
- 2023Are LLMs All You Need for Task-Oriented Dialogue?cited by 54
- 2019Global-to-local Memory Pointer Networks for Task-Oriented Dialoguecited by 47
- 2023Using In-Context Learning to Improve Dialogue Safetycited by 42
- 2020Dynamic Fusion Network for Multi-Domain End-to-end Task-Oriented Dialogcited by 37
- 2020Learning Knowledge Bases with Parameters for Task-Oriented Dialogue Systemscited by 35
- 2019Entity-Consistent End-to-end Task-Oriented Dialogue System with KB Retrievercited by 21
- 2022DialoKG: Knowledge-Structure Aware Task-Oriented Dialogue Generationcited by 19
- 2018Disentangling Language and Knowledge in Task-Oriented Dialogscited by 17
- 2018Sequence-to-Sequence Learning for Task-oriented Dialogue with Dialogue State Representationcited by 16
- 2021Constraint based Knowledge Base Distillation in End-to-End Task Oriented Dialogscited by 11
- 2022Q-TOD: A Query-driven Task-oriented Dialogue Systemcited by 10
- 2022Autoregressive Entity Generation for End-to-End Task-Oriented Dialogcited by 8
- 2023Multi-Grained Knowledge Retrieval for End-to-End Task-Oriented Dialogcited by 6
- 2023Few-shot Transfer Learning for Knowledge Base Question Answering: Fusing Supervised Models with In-Context Learningcited by 6
- 2023Enhancing Performance on Seen and Unseen Dialogue Scenarios using Retrieval-Augmented End-to-End Task-Oriented Systemcited by 2
Built on by
Citing papers per year: 2025: 4.
4 papers.
- 2025PICACO: Pluralistic In-Context Value Alignment of LLMs via Total Correlation Optimizationcited by 3
- 2025PyTOD: Programmable Task-Oriented Dialogue with Execution Feedbackcited by 1
- 2025Improving Multi-turn Task Completion in Task-Oriented Dialog Systems via Prompt Chaining and Fine-Grained Feedbackcited by 0
- 2025Aligning Large Language Models with Procedural Rules: An Autoregressive State-Tracking Prompting for In-Game Tradingcited by 0
- 2025Aligning Large Language Models with Procedural Rules: An Autoregressive State-Tracking Prompting for In-Game Trading28 Oct 2025
- 2025PyTOD: Programmable Task-Oriented Dialogue with Execution Feedback21 Aug 2025
- 2025PICACO: Pluralistic In-Context Value Alignment of LLMs via Total Correlation Optimization22 Jul 2025
- 2025Improving Multi-turn Task Completion in Task-Oriented Dialog Systems via Prompt Chaining and Fine-Grained Feedback18 Feb 2025