Few-shot Natural Language Generation for Task-Oriented Dialog
Not on the map. Why?
Abstract (arXiv)
As a crucial component in task-oriented dialog systems, the Natural Language Generation (NLG) module converts a dialog act represented in a semantic form into a response in natural language. The success of traditional template-based or statistical models typically relies on heavily annotated data, which is infeasible for new domains. Therefore, it is pivotal for an NLG system to generalize well with limited labelled data in real applications. To this end, we present FewShotWoz, the first NLG benchmark to simulate the few-shot learning setting in task-oriented dialog systems. Further, we develop the SC-GPT model. It is pre-trained on a large set of annotated NLG corpus to acquire the controllable generation ability, and fine-tuned with only a few domain-specific labels to adapt to new domains. Experiments on FewShotWoz and the large Multi-Domain-WOZ datasets show that the proposed SC-GPT significantly outperforms existing methods, measured by various automatic metrics and human evaluations.
Key facts. Cited by 89 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 32; 2022: 28; 2023: 13; 2024: 7; 2025: 5; 2026: 4.
89 papers.
Sort:
By area:
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 128
- 2022Pretrained Language Models for Text Generation: A Surveycited by 121
- 2022Language Models with Image Descriptors are Strong Few-Shot Video-Language Learnerscited by 117
- 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102
- 2022State-of-the-art generalisation research in NLP: A taxonomy and reviewcited by 97
- 2021Dialogue State Tracking with a Language Model using Schema-Driven Promptingcited by 94
- 2022MISC: A MIxed Strategy-Aware Model Integrating COMET for Emotional Support Conversationcited by 84
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
- 2021Mitigating Political Bias in Language Models Through Reinforced Calibrationcited by 73
- 2022Description-Driven Task-Oriented Dialog Modelingcited by 50
- 2021Shades of BLEU, Flavours of Success: The Case of MultiWOZcited by 48
38 more
- 2022Neural Approaches to Conversational Information Retrievalcited by 41
- 2022SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generationcited by 34
- 2021Conversational Question Answering: A Surveycited by 31
- 2021CINS: Comprehensive Instruction for Few-shot Learning in Task-oriented Dialog Systemscited by 30
- 2021Continual Mixed-Language Pre-Training for Extremely Low-Resource Neural Machine Translationcited by 29
- 2021Speech-language Pre-training for End-to-end Spoken Language Understandingcited by 27
- 2022Evaluating Mixed-initiative Conversational Search Systems via User Simulationcited by 24
- 2021Pretraining the Noisy Channel Model for Task-Oriented Dialoguecited by 23
- 2021Neural Data-to-Text Generation with LM-based Text Augmentationcited by 22
- 2022GenTUS: Simulating User Behaviour and Language in Task-oriented Dialogues with Generative Transformerscited by 22
- 2022ConvLab-3: A Flexible Dialogue System Toolkit Based on a Unified Data Formatcited by 22
- 2022Generative Transformers for Design Concept Generationcited by 21
- 2021Improving Compositional Generalization with Self-Training for Data-to-Text Generationcited by 19
- 2021TODSum: Task-Oriented Dialogue Summarization with State Trackingcited by 19
- 2022Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropizationcited by 19
- 2021Self-training Improves Pre-training for Few-shot Learning in Task-oriented Dialog Systemscited by 18
- 2021Don't be Contradicted with Anything! CI-ToD: Towards Benchmarking Consistency for Task-oriented Dialogue Systemcited by 18
- 2021AUGNLG: Few-shot Natural Language Generation using Self-trained Data Augmentationcited by 17
- 2021Generative Pre-Trained Transformer for Design Concept Generation: An Explorationcited by 17
- 2022Learning Dialogue Representations from Consecutive Utterancescited by 17
- 2021Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systemscited by 16
- 2021Few-Shot Out-of-Domain Transfer Learning of Natural Language Explanations in a Label-Abundant Setupcited by 16
- 2022A Mixture-of-Expert Approach to RL-based Dialogue Managementcited by 16
- 2022Semi-Supervised Knowledge-Grounded Pre-training for Task-Oriented Dialog Systemscited by 15
- 2022Dynamic Dialogue Policy for Continual Reinforcement Learningcited by 12
- 2025Rethinking Stateful Tool Use in Multi-Turn Dialogues: Benchmarks and Challengescited by 12
- 2021Jointly Improving Language Understanding and Generation with Quality-Weighted Weak Supervision of Automatic Labelingcited by 11
- 2021Generative Conversational Networkscited by 11
- 2021Attention Is Indeed All You Need: Semantically Attention-Guided Decoding for Data-to-Text NLGcited by 11
- 2021Style Control for Schema-Guided Natural Language Generationcited by 10
- 2021Know Thy Strengths: Comprehensive Dialogue State Tracking Diagnosticscited by 9
- 2021Generating Personalized Dialogue via Multi-Task Meta-Learningcited by 8
- 2021Empathetic Dialogue Generation with Pre-trained RoBERTa-GPT2 and External Knowledgecited by 8
- 2022ProtoSound: A Personalized and Scalable Sound Recognition System for Deaf and Hard-of-Hearing Userscited by 8
- 2025ESPnet-SDS: Unified Toolkit and Demo for Spoken Dialogue Systemscited by 7
- 2023PromptAttack: Probing Dialogue State Trackers with Adversarial Promptscited by 6
- 2021Automatically Exposing Problems with Neural Dialog Modelscited by 5
- 2021Integrating Pretrained Language Model for Dialogue Policy Learningcited by 5
50 most cited of 89 All 89 (JSON)
- 2026Intent2Tc: Automated Intent-to-Traffic Control Translation with Language Models25 Sep 2026
- 2026DuIVRS-2: An LLM-based Interactive Voice Response System for Large-scale POI Attribute Acquisition18 May 2026
- 2026Impact of enriched meaning representations for language generation in dialogue tasks: A comprehensive exploration of the relevance of tasks, corpora and metrics31 Mar 2026
- 2026Intent2QoS: Language Model-Driven Automation of Traffic Shaping Configurations26 Jan 2026
- 2025Building a Few-Shot Cross-Domain Multilingual NLU Model for Customer Care4 Jun 2025
- 2025Chain-of-Thought Training for Open E2E Spoken Dialogue Systems31 May 2025
- 2025Rethinking Stateful Tool Use in Multi-Turn Dialogues: Benchmarks and Challenges19 May 2025
- 2025ESPnet-SDS: Unified Toolkit and Demo for Spoken Dialogue Systems11 Mar 2025
- 2025Improving Multi-turn Task Completion in Task-Oriented Dialog Systems via Prompt Chaining and Fine-Grained Feedback18 Feb 2025
- 2024Infusing Emotions into Task-oriented Dialogue Systems: Understanding, Management, and Generation5 Aug 2024
- 2024Training Zero-Shot Generalizable End-to-End Task-Oriented Dialog System Without Turn-level Dialog Annotations21 Jul 2024
- 2024Leveraging Machine-Generated Rationales to Facilitate Social Meaning Detection in Conversations27 Jun 2024
38 more
- 2024DGRC: An Effective Fine-tuning Framework for Distractor Generation in Chinese Multi-choice Reading Comprehension29 May 2024
- 2024Augmenting Textual Generation via Topology Aware Retrieval27 May 2024
- 2024Towards Robustness and Diversity: Continual Learning in Dialog Generation with Text-Mixup and Batch Nuclear-Norm Maximization16 Mar 2024
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems28 Feb 2024
- 2023Compositional Generalization for Data-to-Text Generation5 Dec 2023
- 2023A Graph-to-Text Approach to Knowledge-Grounded Response Generation in Human-Robot Interaction3 Nov 2023
- 2023Towards a Unified Conversational Recommendation System: Multi-task Learning via Contextualized Knowledge Distillation27 Oct 2023
- 2023Improving End-to-End Speech Processing by Efficient Text Data Utilization with Latent Synthesis9 Oct 2023
- 2023A Task-oriented Dialog Model with Task-progressive and Policy-aware Pre-training1 Oct 2023
- 2023Dialog Action-Aware Transformer for Dialog Policy Learning5 Sep 2023
- 2023Controllable Generation of Dialogue Acts for Dialogue Systems via Few-Shot Response Generation and Ranking26 Jul 2023
- 2023PromptAttack: Probing Dialogue State Trackers with Adversarial Prompts7 Jun 2023
- 2023Healing Unsafe Dialogue Responses with Weak Supervision Signals25 May 2023
- 2023OLISIA: a Cascade System for Spoken Dialogue State Tracking20 Apr 2023
- 2023Zero-Shot Generalizable End-to-End Task-Oriented Dialog System using Context Summarization and Domain Schema28 Mar 2023
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?21 Mar 2023
- 2023Who's in Charge? Roles and Responsibilities of Decision-Making Components in Conversational Robots15 Mar 2023
- 2022ConvLab-3: A Flexible Dialogue System Toolkit Based on a Unified Data Format30 Nov 2022
- 2022Reranking Overgenerated Responses for End-to-End Task-Oriented Dialogue Systems7 Nov 2022
- 2022Generative Transformers for Design Concept Generation7 Nov 2022
- 2022Semi-Supervised Knowledge-Grounded Pre-training for Task-Oriented Dialog Systems17 Oct 2022
- 2022State-of-the-art generalisation research in NLP: A taxonomy and review6 Oct 2022
- 2022ConceptNet infused DialoGPT for Underlying Commonsense Understanding and Reasoning in Dialogue Response Generation29 Sep 2022
- 2022Learning Interpretable Latent Dialogue Actions With Less Supervision22 Sep 2022
- 2022Selective Token Generation for Few-shot Natural Language Generation17 Sep 2022
- 2022Adaptive Natural Language Generation for Task-oriented Dialogue via Reinforcement Learning16 Sep 2022
- 2022SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generation14 Sep 2022
- 2022OPAL: Ontology-Aware Pretrained Language Model for End-to-End Task-Oriented Dialogue10 Sep 2022
- 2022GenTUS: Simulating User Behaviour and Language in Task-oriented Dialogues with Generative Transformers23 Aug 2022
- 2022Knowledge-Grounded Conversational Data Augmentation with Generative Conversational Networks22 Jul 2022
- 2022A Mixture-of-Expert Approach to RL-based Dialogue Management31 May 2022
- 2022Learning Dialogue Representations from Consecutive Utterances26 May 2022
- 2022Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners22 May 2022
- 2022Self-training with Two-phase Self-augmentation for Few-shot Dialogue Generation19 May 2022
- 2022Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization15 May 2022
- 2022Evaluating Mixed-initiative Conversational Search Systems via User Simulation17 Apr 2022
- 2022Dynamic Dialogue Policy for Continual Reinforcement Learning12 Apr 2022
- 2022MISC: A MIxed Strategy-Aware Model Integrating COMET for Emotional Support Conversation25 Mar 2022
50 newest of 89 All 89 (JSON)
- 2022A Mixture-of-Expert Approach to RL-based Dialogue Managementcited by 16
- 2022A Mixture-of-Expert Approach to RL-based Dialogue Management31 May 2022
- 2024Augmenting Textual Generation via Topology Aware Retrieval27 May 2024
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 128
- 2022Pretrained Language Models for Text Generation: A Surveycited by 121
- 2022Language Models with Image Descriptors are Strong Few-Shot Video-Language Learnerscited by 117
- 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102
- 2022State-of-the-art generalisation research in NLP: A taxonomy and reviewcited by 97
- 2021Dialogue State Tracking with a Language Model using Schema-Driven Promptingcited by 94
- 2022MISC: A MIxed Strategy-Aware Model Integrating COMET for Emotional Support Conversationcited by 84
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
- 2021Mitigating Political Bias in Language Models Through Reinforced Calibrationcited by 73
- 2022Description-Driven Task-Oriented Dialog Modelingcited by 50
- 2021Shades of BLEU, Flavours of Success: The Case of MultiWOZcited by 48
12 most cited of 83 All 83 (JSON)
- 2026Intent2Tc: Automated Intent-to-Traffic Control Translation with Language Models25 Sep 2026
- 2026DuIVRS-2: An LLM-based Interactive Voice Response System for Large-scale POI Attribute Acquisition18 May 2026
- 2026Impact of enriched meaning representations for language generation in dialogue tasks: A comprehensive exploration of the relevance of tasks, corpora and metrics31 Mar 2026
- 2026Intent2QoS: Language Model-Driven Automation of Traffic Shaping Configurations26 Jan 2026
- 2025Building a Few-Shot Cross-Domain Multilingual NLU Model for Customer Care4 Jun 2025
- 2025ESPnet-SDS: Unified Toolkit and Demo for Spoken Dialogue Systems11 Mar 2025
- 2025Improving Multi-turn Task Completion in Task-Oriented Dialog Systems via Prompt Chaining and Fine-Grained Feedback18 Feb 2025
- 2024Infusing Emotions into Task-oriented Dialogue Systems: Understanding, Management, and Generation5 Aug 2024
- 2024Training Zero-Shot Generalizable End-to-End Task-Oriented Dialog System Without Turn-level Dialog Annotations21 Jul 2024
- 2024Leveraging Machine-Generated Rationales to Facilitate Social Meaning Detection in Conversations27 Jun 2024
- 2024DGRC: An Effective Fine-tuning Framework for Distractor Generation in Chinese Multi-choice Reading Comprehension29 May 2024
- 2024Towards Robustness and Diversity: Continual Learning in Dialog Generation with Text-Mixup and Batch Nuclear-Norm Maximization16 Mar 2024
12 newest of 83 All 83 (JSON)