mlsanityData to 14 Oct 2026

Synergizing In-context Learning with Hints for End-to-end Task-oriented Dialog Systems

arXiv 2405.15585 ↗First posted 24 May 2024cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

End-to-end Task-Oriented Dialog (TOD) systems typically require extensive training datasets to perform well. In contrast, large language model (LLM) based TOD systems can excel even with limited data due to their ability to learn tasks through in-context exemplars. However, these models lack alignment with the style of responses in training data and often generate comprehensive responses, making it difficult for users to grasp the information quickly. In response, we propose SyncTOD that synergizes LLMs with task-specific hints to improve alignment in low-data settings. SyncTOD employs small auxiliary models to provide hints and select exemplars for in-context prompts. With ChatGPT, SyncTOD achieves superior performance compared to LLM-based baselines and SoTA models in low-data settings, while retaining competitive performance in full-data settings.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 32 of its 59 references that are in the map. First posted on arXiv 24 May 2024.

Builds on

32 of 59 references.

References · 32

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  3. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
  4. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
  5. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
  6. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
  7. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
  8. 2023In-Context Retrieval-Augmented Language Modelscited by 702
  9. 2019Passage Re-ranking with BERTcited by 645
  10. 2020A Simple Language Model for Task-Oriented Dialoguecited by 332
  11. 2016A Network-based End-to-End Trainable Task-oriented Dialogue Systemcited by 252
  12. 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
20 more
  1. 2017Key-Value Retrieval Networks for Task-Oriented Dialoguecited by 138
  2. 2023Guiding Large Language Models via Directional Stimulus Promptingcited by 95
  3. 2018Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systemscited by 70
  4. 2023A Multi-Task Embedder For Retrieval Augmented LLMscited by 64
  5. 2021BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modelingcited by 56
  6. 2023Are LLMs All You Need for Task-Oriented Dialogue?cited by 54
  7. 2019Global-to-local Memory Pointer Networks for Task-Oriented Dialoguecited by 47
  8. 2023Using In-Context Learning to Improve Dialogue Safetycited by 42
  9. 2020Dynamic Fusion Network for Multi-Domain End-to-end Task-Oriented Dialogcited by 37
  10. 2020Learning Knowledge Bases with Parameters for Task-Oriented Dialogue Systemscited by 35
  11. 2019Entity-Consistent End-to-end Task-Oriented Dialogue System with KB Retrievercited by 21
  12. 2022DialoKG: Knowledge-Structure Aware Task-Oriented Dialogue Generationcited by 19
  13. 2018Disentangling Language and Knowledge in Task-Oriented Dialogscited by 17
  14. 2018Sequence-to-Sequence Learning for Task-oriented Dialogue with Dialogue State Representationcited by 16
  15. 2021Constraint based Knowledge Base Distillation in End-to-End Task Oriented Dialogscited by 11
  16. 2022Q-TOD: A Query-driven Task-oriented Dialogue Systemcited by 10
  17. 2022Autoregressive Entity Generation for End-to-End Task-Oriented Dialogcited by 8
  18. 2023Multi-Grained Knowledge Retrieval for End-to-End Task-Oriented Dialogcited by 6
  19. 2023Few-shot Transfer Learning for Knowledge Base Question Answering: Fusing Supervised Models with In-Context Learningcited by 6
  20. 2023Enhancing Performance on Seen and Unseen Dialogue Scenarios using Retrieval-Augmented End-to-End Task-Oriented Systemcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 4.

4 papers.