mlsanityData to 7 Oct 2026

Semi-Supervised Knowledge-Grounded Pre-training for Task-Oriented Dialog Systems

arXiv 2210.08873 ↗First posted 17 Oct 2022cs.CLcited by 15

Not on the map. Why?

Abstract (arXiv)

Recent advances in neural approaches greatly improve task-oriented dialogue (TOD) systems which assist users to accomplish their goals. However, such systems rely on costly manually labeled dialogs which are not available in practical scenarios. In this paper, we present our models for Track 2 of the SereTOD 2022 challenge, which is the first challenge of building semi-supervised and reinforced TOD systems on a large-scale real-world Chinese TOD dataset MobileCS. We build a knowledge-grounded dialog model to formulate dialog history and local KB as input and predict the system response. And we perform semi-supervised pre-training both on the labeled and unlabeled data. Our system achieves the first place both in the automatic evaluation and human interaction, especially with higher BLEU (+7.64) and Success (+13.6%) than the second place.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 12 of its 23 references that are in the map. First posted on arXiv 17 Oct 2022.

Builds on

12 of 23 references.

References · 12

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  3. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
  4. 2019Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systemscited by 215
  5. 2018Neural Approaches to Conversational AIcited by 164
  6. 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
  7. 2019A Stack-Propagation Framework with Token-Level Intent Detection for Spoken Language Understandingcited by 106
  8. 2020Few-shot Natural Language Generation for Task-Oriented Dialogcited by 89
  9. 2019Dialog State Tracking: A Neural Reading Comprehension Approachcited by 62
  10. 2022A Challenge on Semi-Supervised and Reinforced Task-Oriented Dialog Systemscited by 6
  11. 2022Information Extraction and Human-Robot Dialogue towards Real-life Tasks: A Baseline Study with the MobileCS Datasetcited by 4
  12. 2022Unified Knowledge Prompt Pre-training for Customer Service Dialoguescited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 9; 2024: 4; 2025: 1; 2026: 1.

15 papers.

Sort:

By area:

  1. 2023Revisit Input Perturbation Problems for LLMs: A Unified Robustness Evaluation Framework for Noisy Slot Filling Taskcited by 23
  2. 2023Bridging the KB-Text Gap: Leveraging Structured Knowledge-aware Pre-training for KBQAcited by 17
  3. 2023Large Language Models Meet Open-World Intent Discovery and Recognition: An Evaluation of ChatGPTcited by 16
  4. 2024PreAct: Prediction Enhances Agent's Planning Abilitycited by 11
  5. 2023A Multi-Task Semantic Decomposition Framework with Task-specific Pre-training for Few-Shot NERcited by 9
  6. 2023Knowledge-Retrieval Task-Oriented Dialog Systems with Semi-Supervisioncited by 7
  7. 2023Towards Robust and Generalizable Training: An Empirical Study of Noisy Slot Filling for Input Perturbationscited by 5
  8. 2023Continual Generalized Intent Discovery: Marching Towards Dynamic and Open-world Intent Recognitioncited by 5
  9. 2023Semantic Parsing by Large Language Models for Intricate Updating Strategies of Zero-Shot Dialogue State Trackingcited by 5
  10. 2024DivTOD: Unleashing the Power of LLMs for Diversifying Task-Oriented Dialogue Representationscited by 4
  11. 2023Watch the Speakers: A Hybrid Continuous Attribution Network for Emotion Recognition in Conversation With Emotion Disentanglementcited by 1
  12. 2024Noise-BERT: A Unified Perturbation-Robust Framework with Noise Alignment Pre-training for Noisy Slot Filling Taskcited by 1
3 more
  1. 2024BootTOD: Bootstrap Task-oriented Dialogue Representations by Aligning Diverse Responsescited by 0
  2. 2025Entriever: Energy-based Retriever for Knowledge-Grounded Dialog Systemscited by 0
  3. 2026Extracting Training Dialogue Data from Large Language Model based Task Botscited by 0