A Unified Data Augmentation Framework for Low-Resource Multi-Domain Dialogue Generation
Not on the map. Why?
Abstract (arXiv)
Current state-of-the-art dialogue systems heavily rely on extensive training datasets. However, challenges arise in domains where domain-specific training datasets are insufficient or entirely absent. To tackle this challenge, we propose a novel data Augmentation framework for Multi-Domain Dialogue Generation, referred to as AMD2G. The AMD2G framework consists of a data augmentation process and a two-stage training approach: domain-agnostic training and domain adaptation training. We posit that domain corpora are a blend of domain-agnostic and domain-specific features, with certain representation patterns shared among diverse domains. Domain-agnostic training aims to enable models to learn these common expressive patterns. To construct domain-agnostic dialogue corpora, we employ a textitde-domaining data processing technique used to remove domain-specific features. By mitigating the effects of domain-specific features, the model trained on the de-domained corpora can effectively learn common expression patterns in different domains. Subsequently, we adapt the learned domain-agnostic features to the target domain through domain adaptation training. We conduct experiments on Chinese dialogue datasets from five different domains and show that AMD2G achieves superior performance compared to both direct training on the target domain corpus and collective training on all five domain corpora. Our work underscores AMD2G as a viable alternative solution for low-resource multi-domain dialogue generation. Code and data associated with our work are available on GitHub repositorytext 1.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 37 of its 54 references that are in the map. First posted on arXiv 14 Jun 2024.
Builds on
37 of 54 references.
References · 37
- 2017Attention Is All You Needcited by 60,361
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,077
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
- 2020Recipes for building an open-domain chatbotcited by 593
- 2020Towards a Human-like Open-Domain Chatbotcited by 470
- 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
- 2015Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Modelscited by 207
25 more
- 2017Adversarial Learning for Neural Dialogue Generationcited by 103
- 2021CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generationcited by 81
- 2018Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systemscited by 70
- 2018Modeling Multi-turn Conversation with Deep Utterance Aggregationcited by 65
- 2020KdConv: A Chinese Multi-domain Dialogue Dataset Towards Multi-turn Knowledge-driven Conversationcited by 59
- 2021BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modelingcited by 56
- 2019Global-to-local Memory Pointer Networks for Task-Oriented Dialoguecited by 47
- 2018Global-Locally Self-Attentive Dialogue State Trackercited by 45
- 2020MedDG: An Entity-Centric Medical Consultation Dataset for Entity-Aware Medical Dialogue Generationcited by 45
- 2018DP-GAN: Diversity-Promoting Generative Adversarial Network for Generating Informative and Diversified Textcited by 40
- 2018Multinomial Adversarial Networks for Multi-Domain Text Classificationcited by 40
- 2020Dynamic Fusion Network for Multi-Domain End-to-end Task-Oriented Dialogcited by 37
- 2023Task-Optimized Adapters for an End-to-End Task-Oriented Dialogue Systemcited by 30
- 2019Entity-Consistent End-to-end Task-Oriented Dialogue System with KB Retrievercited by 21
- 2018Adaptations of ROUGE and BLEU to Better Evaluate Machine Reading Comprehension Taskcited by 20
- 2022Cross-Lingual Retrieval Augmented Prompt for Low-Resource Languagescited by 17
- 2018Sequence-to-Sequence Learning for Task-oriented Dialogue with Dialogue State Representationcited by 16
- 2021Domain-Adaptive Pretraining Methods for Dialogue Understandingcited by 11
- 2019Teacher-Student Framework Enhanced Multi-domain Dialogue Generationcited by 8
- 2023Bidirectional Domain Mixup for Domain Adaptive Semantic Segmentationcited by 8
- 2022MulZDG: Multilingual Code-Switching Framework for Zero-shot Dialogue Generationcited by 7
- 2022PVGRU: Generating Diverse and Relevant Dialogue Responses via Pseudo-Variational Mechanismcited by 6
- 2023Adaptive Texture Filtering for Single-Domain Generalized Segmentationcited by 3
- 2018TechKG: A Large-Scale Chinese Technology-Oriented Knowledge Graphcited by 1
- 2022Modeling Content-Emotion Duality via Disentanglement for Empathetic Conversationcited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.