Weakly Supervised Data Augmentation Through Prompting for Dialogue Understanding
Not on the map. Why?
Abstract (arXiv)
Dialogue understanding tasks often necessitate abundant annotated data to achieve good performance and that presents challenges in low-resource settings. To alleviate this barrier, we explore few-shot data augmentation for dialogue understanding by prompting large pre-trained language models and present a novel approach that iterates on augmentation quality by applying weakly-supervised filters. We evaluate our methods on the emotion and act classification tasks in DailyDialog and the intent classification task in Facebook Multilingual Task-Oriented Dialogue. Models fine-tuned on our augmented data mixed with few-shot ground truth data are able to approach or surpass existing state-of-the-art performance on both datasets. For DailyDialog specifically, using 10% of the ground truth data we outperform the current state-of-the-art model which uses 100% of the data.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 42 of its 57 references that are in the map. First posted on arXiv 25 Oct 2022.
Builds on
42 of 57 references.
References · 42
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
30 more
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
- 2019Unsupervised Data Augmentation for Consistency Trainingcited by 1,057
- 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
- 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 800
- 2022GPT-NeoX-20B: An Open-Source Autoregressive Language Modelcited by 711
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
- 2021True Few-Shot Learning with Language Modelscited by 343
- 2021Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLPcited by 336
- 2020Data Augmentation using Pre-trained Transformer Modelscited by 168
- 2021Meta-learning via Language Model In-context Tuningcited by 163
- 2021RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Modelscited by 149
- 2018Analyzing Uncertainty in Neural Machine Translationcited by 126
- 2018Cross-Lingual Transfer Learning for Multilingual Task Oriented Dialogcited by 124
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2021Sustainable Modular Debiasing of Language Modelscited by 98
- 2020Toxicity Detection: Does Context Really Matter?cited by 93
- 2018Quantifying Uncertainties in Natural Language Processing Taskscited by 79
- 2021AEDA: An Easier Data Augmentation Technique for Text Classificationcited by 67
- 2022AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Modelcited by 57
- 2022Data Augmentation for Intent Classification with Off-the-shelf Large Language Modelscited by 49
- 2020Paraphrase Augmented Task-Oriented Dialog Generationcited by 43
- 2020GenAug: Data Augmentation for Finetuning Text Generatorscited by 41
- 2021AuGPT: Auxiliary Tasks and Data Augmentation for End-To-End Dialogue with Pre-Trained Language Modelscited by 31
- 2019Improving Neural Conversational Models with Entropy-Based Data Filteringcited by 30
- 2021Graph Based Network with Contextualized Representations of Turns in Dialoguecited by 26
- 2020Strength from Weakness: Fast Learning Using Weak Supervisioncited by 18
- 2021Speaker Turn Modeling for Dialogue Act Classificationcited by 18
- 2022Reward Modeling for Mitigating Toxicity in Transformer-based Language Modelscited by 17
- 2021Generative Conversational Networkscited by 11
- 2021S+PAGE: A Speaker and Position-Aware Graph Neural Network Model for Emotion Recognition in Conversationcited by 9
Built on by
Citing papers per year: 2022: 2; 2023: 11; 2024: 13; 2025: 5; 2026: 1.
32 papers.
Sort:
By area:
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2022SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualizationcited by 166
- 2023Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitationscited by 96
- 2023PLACES: Prompting Language Models for Social Conversation Synthesiscited by 72
- 2024Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometricscited by 56
- 2023Is ChatGPT Equipped with Emotional Dialogue Capabilities?cited by 54
- 2024Learning to Clarify: Multi-turn Conversations with Action-Based Contrastive Self-Trainingcited by 53
- 2024What is the Role of Small Models in the LLM Era: A Surveycited by 41
- 2022In-context Learning Distillation: Transferring Few-shot Learning Ability of Pre-trained Language Modelscited by 36
- 2023Controllable Mixed-Initiative Dialogue Generation through Promptingcited by 32
- 2023Mixture of Soft Prompts for Controllable Data Generationcited by 23
- 2024A Survey on Recent Advances in Conversational Data Generationcited by 23
20 more
- 2024Contextualization Distillation from Large Language Model for Knowledge Graph Completioncited by 18
- 2025nvBench 2.0: Resolving Ambiguity in Text-to-Visualization through Stepwise Reasoningcited by 17
- 2024The Imperative of Conversation Analysis in the Era of LLMs: A Survey of Tasks, Techniques, and Trendscited by 11
- 2023Curriculum-Driven Edubot: A Framework for Developing Language Learning Chatbots Through Synthesizing Conversational Datacited by 9
- 2024Synthetic Data Generation with Large Language Models for Personalized Community Question Answeringcited by 8
- 2024PersonalityChat: Conversation Distillation for Personalized Dialog Modeling with Facts and Traitscited by 6
- 2024Efficient Data Generation for Source-grounded Information-seeking Dialogs: A Use Case for Meeting Transcriptscited by 6
- 2025Bottom-Up Synthesis of Knowledge-Grounded Task-Oriented Dialogues with Iteratively Self-Refined Promptscited by 5
- 2025We Argue to Agree: Towards Personality-Driven Argumentation-Based Negotiation Dialogue Systems for Tourismcited by 5
- 2023Pre-Finetuning for Few-Shot Emotional Speech Recognitioncited by 4
- 2023MixPro: Simple yet Effective Data Augmentation for Prompt-based Learningcited by 4
- 2024Controllable and Diverse Data Augmentation with Large Language Model for Low-Resource Open-Domain Dialogue Generationcited by 4
- 2023Synthetic Data Generation in Low-Resource Settings via Fine-Tuning of Large Language Modelscited by 3
- 2024GeMQuAD : Generating Multilingual Question Answering Datasets from Large Language Models using Few Shot Learningcited by 3
- 2024Data-Centric Improvements for Enhancing Multi-Modal Understanding in Spoken Conversation Modelingcited by 3
- 2023Relation Extraction in underexplored biomedical domains: A diversity-optimised sampling and synthetic data generation approachcited by 1
- 2025SpeechDialogueFactory: Generating High-Quality Speech Dialogue Data to Accelerate Your Speech-LLM Developmentcited by 1
- 2025Exploring Automated Recognition of Instructional Activity and Discourse from Multimodal Classroom Datacited by 1
- 2024CALICO: Conversational Agent Localization via Synthetic Data Generationcited by 0
- 2026Cross-Lingual Stability of LLM Judges Under Controlled Generation: Evidence from Finno-Ugric Languagescited by 0
- 2026Cross-Lingual Stability of LLM Judges Under Controlled Generation: Evidence from Finno-Ugric Languages2 Feb 2026
- 2025Exploring Automated Recognition of Instructional Activity and Discourse from Multimodal Classroom Data26 Nov 2025
- 2025We Argue to Agree: Towards Personality-Driven Argumentation-Based Negotiation Dialogue Systems for Tourism14 Sep 2025
- 2025Bottom-Up Synthesis of Knowledge-Grounded Task-Oriented Dialogues with Iteratively Self-Refined Prompts19 Apr 2025
- 2025SpeechDialogueFactory: Generating High-Quality Speech Dialogue Data to Accelerate Your Speech-LLM Development31 Mar 2025
- 2025nvBench 2.0: Resolving Ambiguity in Text-to-Visualization through Stepwise Reasoning17 Mar 2025
- 2024Data-Centric Improvements for Enhancing Multi-Modal Understanding in Spoken Conversation Modeling20 Dec 2024
- 2024CALICO: Conversational Agent Localization via Synthetic Data Generation6 Dec 2024
- 2024Synthetic Data Generation with Large Language Models for Personalized Community Question Answering29 Oct 2024
- 2024The Imperative of Conversation Analysis in the Era of LLMs: A Survey of Tasks, Techniques, and Trends21 Sep 2024
- 2024What is the Role of Small Models in the LLM Era: A Survey10 Sep 2024
- 2024Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometrics20 Jun 2024
20 more
- 2024Learning to Clarify: Multi-turn Conversations with Action-Based Contrastive Self-Training31 May 2024
- 2024A Survey on Recent Advances in Conversational Data Generation12 May 2024
- 2024Efficient Data Generation for Source-grounded Information-seeking Dialogs: A Use Case for Meeting Transcripts2 May 2024
- 2024GeMQuAD : Generating Multilingual Question Answering Datasets from Large Language Models using Few Shot Learning14 Apr 2024
- 2024Controllable and Diverse Data Augmentation with Large Language Model for Low-Resource Open-Domain Dialogue Generation30 Mar 2024
- 2024Contextualization Distillation from Large Language Model for Knowledge Graph Completion28 Jan 2024
- 2024PersonalityChat: Conversation Distillation for Personalized Dialog Modeling with Facts and Traits14 Jan 2024
- 2023Relation Extraction in underexplored biomedical domains: A diversity-optimised sampling and synthetic data generation approach10 Nov 2023
- 2023Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitations11 Oct 2023
- 2023Synthetic Data Generation in Low-Resource Settings via Fine-Tuning of Large Language Models2 Oct 2023
- 2023Curriculum-Driven Edubot: A Framework for Developing Language Learning Chatbots Through Synthesizing Conversational Data28 Sep 2023
- 2023Controllable Mixed-Initiative Dialogue Generation through Prompting6 May 2023
- 2023Is ChatGPT Equipped with Emotional Dialogue Capabilities?19 Apr 2023
- 2023MixPro: Simple yet Effective Data Augmentation for Prompt-based Learning19 Apr 2023
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar 2023
- 2023Mixture of Soft Prompts for Controllable Data Generation2 Mar 2023
- 2023Pre-Finetuning for Few-Shot Emotional Speech Recognition24 Feb 2023
- 2023PLACES: Prompting Language Models for Social Conversation Synthesis7 Feb 2023
- 2022In-context Learning Distillation: Transferring Few-shot Learning Ability of Pre-trained Language Models20 Dec 2022
- 2022SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualization20 Dec 2022
- 2023Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitationscited by 96
- 2024Synthetic Data Generation with Large Language Models for Personalized Community Question Answeringcited by 8
- 2023Synthetic Data Generation in Low-Resource Settings via Fine-Tuning of Large Language Modelscited by 3
- 2023Relation Extraction in underexplored biomedical domains: A diversity-optimised sampling and synthetic data generation approachcited by 1
- 2024Synthetic Data Generation with Large Language Models for Personalized Community Question Answering29 Oct 2024
- 2023Relation Extraction in underexplored biomedical domains: A diversity-optimised sampling and synthetic data generation approach10 Nov 2023
- 2023Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitations11 Oct 2023
- 2023Synthetic Data Generation in Low-Resource Settings via Fine-Tuning of Large Language Models2 Oct 2023
- 2022SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualizationcited by 166
- 2023PLACES: Prompting Language Models for Social Conversation Synthesiscited by 72
- 2024Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometricscited by 56
- 2023Is ChatGPT Equipped with Emotional Dialogue Capabilities?cited by 54
- 2024What is the Role of Small Models in the LLM Era: A Surveycited by 41
- 2022In-context Learning Distillation: Transferring Few-shot Learning Ability of Pre-trained Language Modelscited by 36
- 2023Controllable Mixed-Initiative Dialogue Generation through Promptingcited by 32
- 2023Mixture of Soft Prompts for Controllable Data Generationcited by 23
- 2024A Survey on Recent Advances in Conversational Data Generationcited by 23
- 2024Contextualization Distillation from Large Language Model for Knowledge Graph Completioncited by 18
- 2024The Imperative of Conversation Analysis in the Era of LLMs: A Survey of Tasks, Techniques, and Trendscited by 11
- 2023Curriculum-Driven Edubot: A Framework for Developing Language Learning Chatbots Through Synthesizing Conversational Datacited by 9
12 most cited of 23 All 23 (JSON)
- 2026Cross-Lingual Stability of LLM Judges Under Controlled Generation: Evidence from Finno-Ugric Languages2 Feb 2026
- 2025We Argue to Agree: Towards Personality-Driven Argumentation-Based Negotiation Dialogue Systems for Tourism14 Sep 2025
- 2025Bottom-Up Synthesis of Knowledge-Grounded Task-Oriented Dialogues with Iteratively Self-Refined Prompts19 Apr 2025
- 2025SpeechDialogueFactory: Generating High-Quality Speech Dialogue Data to Accelerate Your Speech-LLM Development31 Mar 2025
- 2024Data-Centric Improvements for Enhancing Multi-Modal Understanding in Spoken Conversation Modeling20 Dec 2024
- 2024The Imperative of Conversation Analysis in the Era of LLMs: A Survey of Tasks, Techniques, and Trends21 Sep 2024
- 2024What is the Role of Small Models in the LLM Era: A Survey10 Sep 2024
- 2024Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometrics20 Jun 2024
- 2024A Survey on Recent Advances in Conversational Data Generation12 May 2024
- 2024Efficient Data Generation for Source-grounded Information-seeking Dialogs: A Use Case for Meeting Transcripts2 May 2024
- 2024GeMQuAD : Generating Multilingual Question Answering Datasets from Large Language Models using Few Shot Learning14 Apr 2024
- 2024Controllable and Diverse Data Augmentation with Large Language Model for Low-Resource Open-Domain Dialogue Generation30 Mar 2024
12 newest of 23 All 23 (JSON)