A Closer Look At Feature Space Data Augmentation For Few-Shot Intent Classification
Not on the map. Why?
Abstract (arXiv)
New conversation topics and functionalities are constantly being added to conversational AI agents like Amazon Alexa and Apple Siri. As data collection and annotation is not scalable and is often costly, only a handful of examples for the new functionalities are available, which results in poor generalization performance. We formulate it as a Few-Shot Integration (FSI) problem where a few examples are used to introduce a new intent. In this paper, we study six feature space data augmentation methods to improve classification performance in FSI setting in combination with both supervised and unsupervised representation learning methods such as BERT. Through realistic experiments on two public conversational datasets, SNIPS, and the Facebook Dialog corpus, we show that data augmentation in feature space provides an effective way to improve intent classification performance in few-shot setting beyond traditional transfer learning approaches. In particular, we show that (a) upsampling in latent space is a competitive baseline for feature space augmentation (b) adding the difference between two examples to a new example is a simple yet effective data augmentation method.
Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 16; 2023: 10; 2024: 5; 2025: 2; 2026: 1.
45 papers.
Sort:
By area:
- 2021A Survey of Data Augmentation Approaches for NLPcited by 408
- 2023AugGPT: Leveraging ChatGPT for Text Data Augmentationcited by 128
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2021Neural Data Augmentation via Example Extrapolationcited by 54
- 2022Data Augmentation for Intent Classification with Off-the-shelf Large Language Modelscited by 49
- 2021Controllable Semantic Parsing via Retrieval Augmentationcited by 35
- 2022SgVA-CLIP: Semantic-guided Visual Adapting of Vision-Language Models for Few-shot Image Classificationcited by 34
- 2021FlipDA: Effective and Robust Data Augmentation for Few-Shot Learningcited by 32
- 2023Mask-guided BERT for Few Shot Text Classificationcited by 25
- 2023PromptMix: A Class Boundary Augmentation Method for Large Language Model Distillationcited by 25
- 2023Selective In-Context Data Augmentation for Intent Detection using Pointwise V-Informationcited by 24
- 2023Using GPT-4 to Augment Unbalanced Data for Automatic Scoringcited by 20
33 more
- 2022Contrastive Learning for Prompt-Based Few-Shot Language Learnerscited by 17
- 2022Learning Multimodal Data Augmentation in Feature Spacecited by 17
- 2022Data Augmentation with Paraphrase Generation and Entity Extraction for Multimodal Dialogue Systemcited by 16
- 2023Hallucination Improves the Performance of Unsupervised Visual Representation Learningcited by 16
- 2021Coarse2Fine: Fine-grained Text Classification on Coarsely-grained Annotated Datacited by 13
- 2022Opponent Modeling in Negotiation Dialogues by Related Data Adaptationcited by 13
- 2022A Feature-space Multimodal Data Augmentation Technique for Text-video Retrievalcited by 13
- 2024Frozen Feature Augmentation for Few-Shot Image Classificationcited by 13
- 2021ECKPN: Explicit Class Knowledge Propagation Network for Transductive Few-shot Learningcited by 11
- 2023PAC-tuning:Fine-tuning Pretrained Language Models with PAC-driven Perturbed Gradient Descentcited by 10
- 2024mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humanscited by 10
- 2021ProtoDA: Efficient Transfer Learning for Few-Shot Intent Classificationcited by 8
- 2024Exploring Empty Spaces: Human-in-the-Loop Data Augmentationcited by 6
- 2021Good-Enough Example Extrapolationcited by 5
- 2022Embedding Hallucination for Few-Shot Language Fine-tuningcited by 5
- 2022AugCSE: Contrastive Sentence Embedding with Diverse Augmentationscited by 5
- 2022CST5: Data Augmentation for Code-Switched Semantic Parsingcited by 5
- 2023Boosting Few-Shot Text Classification via Distribution Estimationcited by 4
- 2023Improving Few-shot Generalization of Safety Classifiers via Data Augmented Parameter-Efficient Fine-Tuningcited by 4
- 2024What Has Been Overlooked in Contrastive Source-Free Domain Adaptation: Leveraging Source-Informed Latent Augmentation within Neighborhood Contextcited by 4
- 2022UpCycling: Semi-supervised 3D Object Detection without Sharing Raw-level Unlabeled Scenescited by 3
- 2023From Chatter to Matter: Addressing Critical Steps of Emotion Recognition Learning in Task-oriented Dialoguecited by 3
- 2022Multi-Granularity Cross-Modality Representation Learning for Named Entity Recognition on Social Mediacited by 2
- 2021Meta-learning for skin cancer detection using Deep Learning Techniquescited by 1
- 2021ALLWAS: Active Learning on Language models in WASserstein spacecited by 1
- 2022Variational Autoencoder with Disentanglement Priors for Low-Resource Task-Specific Natural Language Generationcited by 1
- 2022Reprint: a randomized extrapolation based on principal components for data augmentationcited by 1
- 2022Multi-features based Semantic Augmentation Networks for Named Entity Recognition in Threat Intelligencecited by 1
- 2025SiameseDuo++: Active Learning from Data Streams with Dual Augmented Siamese Networkscited by 1
- 2022Progressive Feature Upgrade in Semi-supervised Learning on Tabular Domaincited by 0
- 2024Feature Augmentation for Self-supervised Contrastive Learning: A Closer Lookcited by 0
- 2025A Comprehensive Survey of Challenges and Opportunities of Few-Shot Learning Across Multiple Domainscited by 0
- 2026Semantics-Aware Generative Latent Data Augmentation for Learning in Low-Resource Domainscited by 0
- 2026Semantics-Aware Generative Latent Data Augmentation for Learning in Low-Resource Domains2 Feb 2026
- 2025SiameseDuo++: Active Learning from Data Streams with Dual Augmented Siamese Networks6 Apr 2025
- 2025A Comprehensive Survey of Challenges and Opportunities of Few-Shot Learning Across Multiple Domains5 Apr 2025
- 2024What Has Been Overlooked in Contrastive Source-Free Domain Adaptation: Leveraging Source-Informed Latent Augmentation within Neighborhood Context18 Dec 2024
- 2024Feature Augmentation for Self-supervised Contrastive Learning: A Closer Look16 Oct 2024
- 2024Exploring Empty Spaces: Human-in-the-Loop Data Augmentation1 Oct 2024
- 2024mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humans6 Jun 2024
- 2024Frozen Feature Augmentation for Few-Shot Image Classification15 Mar 2024
- 2023PAC-tuning:Fine-tuning Pretrained Language Models with PAC-driven Perturbed Gradient Descent26 Oct 2023
- 2023Using GPT-4 to Augment Unbalanced Data for Automatic Scoring25 Oct 2023
- 2023Improving Few-shot Generalization of Safety Classifiers via Data Augmented Parameter-Efficient Fine-Tuning25 Oct 2023
- 2023PromptMix: A Class Boundary Augmentation Method for Large Language Model Distillation22 Oct 2023
33 more
- 2023From Chatter to Matter: Addressing Critical Steps of Emotion Recognition Learning in Task-oriented Dialogue24 Aug 2023
- 2023Hallucination Improves the Performance of Unsupervised Visual Representation Learning22 Jul 2023
- 2023Boosting Few-Shot Text Classification via Distribution Estimation26 Mar 2023
- 2023AugGPT: Leveraging ChatGPT for Text Data Augmentation25 Feb 2023
- 2023Mask-guided BERT for Few Shot Text Classification21 Feb 2023
- 2023Selective In-Context Data Augmentation for Intent Detection using Pointwise V-Information10 Feb 2023
- 2022Learning Multimodal Data Augmentation in Feature Space29 Dec 2022
- 2022Progressive Feature Upgrade in Semi-supervised Learning on Tabular Domain1 Dec 2022
- 2022SgVA-CLIP: Semantic-guided Visual Adapting of Vision-Language Models for Few-shot Image Classification28 Nov 2022
- 2022UpCycling: Semi-supervised 3D Object Detection without Sharing Raw-level Unlabeled Scenes22 Nov 2022
- 2022CST5: Data Augmentation for Code-Switched Semantic Parsing14 Nov 2022
- 2022AugCSE: Contrastive Sentence Embedding with Diverse Augmentations20 Oct 2022
- 2022Multi-Granularity Cross-Modality Representation Learning for Named Entity Recognition on Social Media19 Oct 2022
- 2022A Feature-space Multimodal Data Augmentation Technique for Text-video Retrieval3 Aug 2022
- 2022Multi-features based Semantic Augmentation Networks for Named Entity Recognition in Threat Intelligence1 Jul 2022
- 2022Data Augmentation with Paraphrase Generation and Entity Extraction for Multimodal Dialogue System9 May 2022
- 2022Contrastive Learning for Prompt-Based Few-Shot Language Learners3 May 2022
- 2022Embedding Hallucination for Few-Shot Language Fine-tuning3 May 2022
- 2022Opponent Modeling in Negotiation Dialogues by Related Data Adaptation30 Apr 2022
- 2022Reprint: a randomized extrapolation based on principal components for data augmentation26 Apr 2022
- 2022Data Augmentation for Intent Classification with Off-the-shelf Large Language Models5 Apr 2022
- 2022Variational Autoencoder with Disentanglement Priors for Low-Resource Task-Specific Natural Language Generation27 Feb 2022
- 2021Controllable Semantic Parsing via Retrieval Augmentation16 Oct 2021
- 2021Coarse2Fine: Fine-grained Text Classification on Coarsely-grained Annotated Data22 Sep 2021
- 2021Good-Enough Example Extrapolation12 Sep 2021
- 2021ALLWAS: Active Learning on Language models in WASserstein space3 Sep 2021
- 2021FlipDA: Effective and Robust Data Augmentation for Few-Shot Learning13 Aug 2021
- 2021A Survey on Data Augmentation for Text Classification7 Jul 2021
- 2021ECKPN: Explicit Class Knowledge Propagation Network for Transductive Few-shot Learning16 Jun 2021
- 2021A Survey of Data Augmentation Approaches for NLP7 May 2021
- 2021Meta-learning for skin cancer detection using Deep Learning Techniques21 Apr 2021
- 2021Neural Data Augmentation via Example Extrapolation2 Feb 2021
- 2021ProtoDA: Efficient Transfer Learning for Few-Shot Intent Classification28 Jan 2021
- 2021A Survey of Data Augmentation Approaches for NLPcited by 408
- 2023AugGPT: Leveraging ChatGPT for Text Data Augmentationcited by 128
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2021Neural Data Augmentation via Example Extrapolationcited by 54
- 2022Data Augmentation for Intent Classification with Off-the-shelf Large Language Modelscited by 49
- 2021Controllable Semantic Parsing via Retrieval Augmentationcited by 35
- 2021FlipDA: Effective and Robust Data Augmentation for Few-Shot Learningcited by 32
- 2023Mask-guided BERT for Few Shot Text Classificationcited by 25
- 2023PromptMix: A Class Boundary Augmentation Method for Large Language Model Distillationcited by 25
- 2023Selective In-Context Data Augmentation for Intent Detection using Pointwise V-Informationcited by 24
- 2023Using GPT-4 to Augment Unbalanced Data for Automatic Scoringcited by 20
- 2022Contrastive Learning for Prompt-Based Few-Shot Language Learnerscited by 17
12 most cited of 42 All 42 (JSON)
- 2026Semantics-Aware Generative Latent Data Augmentation for Learning in Low-Resource Domains2 Feb 2026
- 2025SiameseDuo++: Active Learning from Data Streams with Dual Augmented Siamese Networks6 Apr 2025
- 2025A Comprehensive Survey of Challenges and Opportunities of Few-Shot Learning Across Multiple Domains5 Apr 2025
- 2024What Has Been Overlooked in Contrastive Source-Free Domain Adaptation: Leveraging Source-Informed Latent Augmentation within Neighborhood Context18 Dec 2024
- 2024Feature Augmentation for Self-supervised Contrastive Learning: A Closer Look16 Oct 2024
- 2024Frozen Feature Augmentation for Few-Shot Image Classification15 Mar 2024
- 2023PAC-tuning:Fine-tuning Pretrained Language Models with PAC-driven Perturbed Gradient Descent26 Oct 2023
- 2023Using GPT-4 to Augment Unbalanced Data for Automatic Scoring25 Oct 2023
- 2023Improving Few-shot Generalization of Safety Classifiers via Data Augmented Parameter-Efficient Fine-Tuning25 Oct 2023
- 2023PromptMix: A Class Boundary Augmentation Method for Large Language Model Distillation22 Oct 2023
- 2023From Chatter to Matter: Addressing Critical Steps of Emotion Recognition Learning in Task-oriented Dialogue24 Aug 2023
- 2023Hallucination Improves the Performance of Unsupervised Visual Representation Learning22 Jul 2023
12 newest of 42 All 42 (JSON)