Augmenting Data with Mixup for Sentence Classification: An Empirical Study
Not on the map. Why?
Abstract (arXiv)
Mixup, a recent proposed data augmentation method through linearly interpolating inputs and modeling targets of random samples, has demonstrated its capability of significantly improving the predictive accuracy of the state-of-the-art networks for image classification. However, how this technique can be applied to and what is its effectiveness on natural language processing (NLP) tasks have not been investigated. In this paper, we propose two strategies for the adaption of Mixup on sentence classification: one performs interpolation on word embeddings and another on sentence embeddings. We conduct experiments to evaluate our methods using several benchmark datasets. Our studies show that such interpolation strategies serve as an effective, domain independent data augmentation approach for sentence classification, and can result in significant accuracy improvement for both CNN and LSTM models.
Key facts. Cited by 125 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 32; 2022: 36; 2023: 22; 2024: 23; 2025: 6; 2026: 6.
125 papers.
Sort:
By area:
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 337
- 2022G-Mixup: Graph Data Augmentation for Graph Classificationcited by 145
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2021FedMix: Approximation of Mixup under Mean Augmented Federated Learningcited by 108
- 2021Data Augmentation Approaches in Natural Language Processing: A Surveycited by 82
- 2022MixGen: A New Multi-Modal Data Augmentationcited by 61
- 2022Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Modulecited by 43
- 2021SSMix: Saliency-Based Span Mixup for Text Classificationcited by 39
- 2021MixSpeech: Data Augmentation for Low-resource Automatic Speech Recognitioncited by 38
- 2024A Comprehensive Survey on Data Augmentationcited by 38
- 2022On the Calibration of Pre-trained Language Models using Mixup Guided by Area Under the Margin and Saliencycited by 31
- 2022MixAugment & Mixup: Augmentation Methods for Facial Expression Recognitioncited by 31
38 more
- 2021Graph Transplant: Node Saliency-Guided Graph Mixup with Local Structure Preservationcited by 30
- 2022A Survey of Mix-based Data Augmentation: Taxonomy, Methods, Applications, and Explainabilitycited by 30
- 2025MathFusion: Enhancing Mathematical Problem-solving of LLM through Instruction Fusioncited by 30
- 2021RockNER: A Simple Method to Create Adversarial Examples for Evaluating the Robustness of Named Entity Recognition Modelscited by 28
- 2022A Unified Analysis of Mixed Sample Data Augmentation: A Loss Function Perspectivecited by 27
- 2021Substructure Substitution: Structured Data Augmentation for NLPcited by 25
- 2021Survey: Image Mixing and Deleting for Data Augmentationcited by 25
- 2021Contrastive Vision-Language Pre-training with Limited Resourcescited by 25
- 2022A Model-Agnostic Data Manipulation Method for Persona-based Dialogue Generationcited by 25
- 2022Interpolation-based Contrastive Learning for Few-Label Semi-Supervised Learningcited by 23
- 2021Reweighting Augmented Samples by Minimizing the Maximal Expected Losscited by 21
- 2022Mixed Graph Contrastive Network for Semi-Supervised Node Classificationcited by 21
- 2023Using GPT-4 to Augment Unbalanced Data for Automatic Scoringcited by 20
- 2023The Benefits of Mixup for Feature Learningcited by 19
- 2024A Survey on Mixup Augmentations and Beyondcited by 18
- 2021AUGNLG: Few-shot Natural Language Generation using Self-trained Data Augmentationcited by 17
- 2024Empowering Large Language Models for Textual Data Augmentationcited by 17
- 2021LearnDA: Learnable Knowledge-Guided Data Augmentation for Event Causality Identificationcited by 16
- 2022TreeMix: Compositional Constituency-based Data Augmentation for Natural Language Understandingcited by 15
- 2022GraphMAD: Graph Mixup for Data Augmentation using Data-Driven Convex Clusteringcited by 13
- 2023Over-training with Mixup May Hurt Generalizationcited by 13
- 2021Connecting Language and Vision for Natural Language-Based Vehicle Retrievalcited by 12
- 2021To Augment or Not to Augment? A Comparative Study on Text Augmentation Techniques for Low-Resource NLPcited by 12
- 2021MixUp Training Leads to Reduced Overfitting and Improved Calibration for the Transformer Architecturecited by 11
- 2022GENIUS: Sketch-based Language Model Pre-training via Extreme and Selective Masking for Text Generation and Augmentationcited by 11
- 2021Data Augmentation in a Hybrid Approach for Aspect-Based Sentiment Analysiscited by 10
- 2021Consistency Training with Virtual Adversarial Discrete Perturbationcited by 9
- 2021Transforming Fake News: Robust Generalisable News Classification Using Transformerscited by 8
- 2022Exploring Representation-Level Augmentation for Code Searchcited by 8
- 2024LLM-based Privacy Data Augmentation Guided by Knowledge Distillation with a Distribution Tutor for Medical Text Classificationcited by 8
- 2024ABEX: Data Augmentation for Low-Resource NLU via Expanding Abstract Descriptionscited by 8
- 2024CMamba: Channel Correlation Enhanced State Space Models for Multivariate Time Series Forecastingcited by 8
- 2024A Survey of Data Synthesis Approachescited by 8
- 2021Influence-guided Data Augmentation for Neural Tensor Completioncited by 7
- 2021Distiller: A Systematic Study of Model Distillation Methods in Natural Language Processingcited by 7
- 2021ifMixup: Interpolating Graph Pair to Regularize Graph Classificationcited by 7
- 2022Multilingual Mix: Example Interpolation Improves Multilingual Neural Machine Translationcited by 7
- 2022PromptDA: Label-guided Data Augmentation for Prompt-based Few-shot Learnerscited by 7
50 most cited of 125 All 125 (JSON)
- 2026AIA2: Attribute-Agnostic Imbalance Augmentation for Subgroup Robustness31 Aug 2026
- 2026Quantifying and Optimizing Simplicity via Polynomial Representations28 May 2026
- 2026Imbalanced Data Clustering via Targeted Data Augmentation Using GMM and LLM19 May 2026
- 2026Fidelity, Diversity, and Privacy: A Multi-Dimensional LLM Evaluation for Clinical Data Augmentation29 Apr 2026
- 2026XITE: Cross-lingual Interpolation for Transfer using Embeddings26 Apr 2026
- 2026inversedMixup: Data Augmentation via Inverting Mixed Embeddings29 Jan 2026
- 2025LM-mixup: Text Data Augmentation via Language Model based Mixup23 Oct 2025
- 2025Mitigating Shortcut Learning with InterpoLated Learning7 Jul 2025
- 2025A Study on Mixup-Inspired Augmentation Methods for Software Vulnerability Detection22 Apr 2025
- 2025MathFusion: Enhancing Mathematical Problem-solving of LLM through Instruction Fusion20 Mar 2025
- 2025Mixup Regularization: A Probabilistic Perspective19 Feb 2025
- 2025MixDec Sampling: A Soft Link-based Sampling Method of Graph Neural Network for Recommendation12 Feb 2025
38 more
- 2024LH-Mix: Local Hierarchy Correlation Guided Mixup over Hierarchical Prompt Tuning22 Dec 2024
- 2024Text Classification using Graph Convolutional Networks: A Comprehensive Survey12 Oct 2024
- 2024ALVIN: Active Learning Via INterpolation11 Oct 2024
- 2024Enhancing Romanian Offensive Language Detection through Knowledge Distillation, Multi-Task Learning, and Data Augmentation30 Sep 2024
- 2024Harnessing Shared Relations via Multimodal Mixup Contrastive Learning for Multimodal Classification26 Sep 2024
- 2024Reducing and Exploiting Data Augmentation Noise through Meta Reweighting Contrastive Learning for Text Classification26 Sep 2024
- 2024A Survey on Mixup Augmentations and Beyond8 Sep 2024
- 2024VulScribeR: Exploring RAG-based Vulnerability Augmentation with LLMs7 Aug 2024
- 2024A Survey of Data Synthesis Approaches4 Jul 2024
- 2024Iterative Data Generation with Large Language Models for Aspect-based Sentiment Analysis29 Jun 2024
- 2024Revisiting Interpolation Augmentation for Speech-to-Text Generation22 Jun 2024
- 2024Fighting Randomness with Randomness: Mitigating Optimisation Instability of Fine-Tuning using Delayed Ensemble and Noisy Interpolation18 Jun 2024
- 2024CMamba: Channel Correlation Enhanced State Space Models for Multivariate Time Series Forecasting8 Jun 2024
- 2024ABEX: Data Augmentation for Low-Resource NLU via Expanding Abstract Descriptions6 Jun 2024
- 2024A Comprehensive Survey on Data Augmentation15 May 2024
- 2024Empowering Large Language Models for Textual Data Augmentation26 Apr 2024
- 2024A Comprehensive Study on NLP Data Augmentation for Hate Speech Detection: Legacy Methods, BERT, and LLMs30 Mar 2024
- 2024Improve Cross-domain Mixed Sampling with Guidance Training for Adaptive Segmentation22 Mar 2024
- 2024SynerMix: Synergistic Mixup Solution for Enhanced Intra-Class Cohesion and Inter-Class Separability in Image Classification21 Mar 2024
- 2024LLM-based Privacy Data Augmentation Guided by Knowledge Distillation with a Distribution Tutor for Medical Text Classification26 Feb 2024
- 2024GenCode: A Generic Data Augmentation Framework for Boosting Deep Learning-Based Code Understanding24 Feb 2024
- 2024Privacy-Preserving Language Model Inference with Instance Obfuscation13 Feb 2024
- 2024Learning Label Hierarchy with Supervised Contrastive Learning31 Jan 2024
- 2023TextAug: Test time Text Augmentation for Multimodal Person Re-identification4 Dec 2023
- 2023SCStory: Self-supervised and Continual Online Story Discovery27 Nov 2023
- 2023Using GPT-4 to Augment Unbalanced Data for Automatic Scoring25 Oct 2023
- 2023I2SRM: Intra- and Inter-Sample Relationship Modeling for Multimodal Information Extraction10 Oct 2023
- 2023AMPLIFY:Attention-based Mixup for Performance Improvement and Label Smoothing in Transformer22 Sep 2023
- 2023AttentionMix: Data augmentation method that relies on BERT attention mechanism20 Sep 2023
- 2023Self-Augmentation Improves Zero-Shot Cross-Lingual Transfer19 Sep 2023
- 2023The Effects of Mixed Sample Data Augmentation are Class Dependent18 Jul 2023
- 2023Navigating Noise: A Study of How Noise Influences Generalisation and Calibration of Neural Networks30 Jun 2023
- 2023Investigating Masking-based Data Generation in Language Models16 Jun 2023
- 2023Provable Benefit of Mixup for Finding Optimal Decision Boundaries1 Jun 2023
- 2023Self-Evolution Learning for Mixup: Enhance Data Augmentation on Few-Shot Text Classification Tasks22 May 2023
- 2023MixPro: Simple yet Effective Data Augmentation for Prompt-based Learning19 Apr 2023
- 2023CoSDA: Continual Source-Free Domain Adaptation13 Apr 2023
- 2023Embarrassingly Simple MixUp for Time-series9 Apr 2023
50 newest of 125 All 125 (JSON)
- 2023Sample-efficient Adversarial Imitation Learningcited by 0
- 2023Sample-efficient Adversarial Imitation Learning14 Mar 2023
- 2024A Survey of Data Synthesis Approachescited by 8
- 2024A Survey of Data Synthesis Approaches4 Jul 2024
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 337
- 2022G-Mixup: Graph Data Augmentation for Graph Classificationcited by 145
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2021FedMix: Approximation of Mixup under Mean Augmented Federated Learningcited by 108
- 2021Data Augmentation Approaches in Natural Language Processing: A Surveycited by 82
- 2022MixGen: A New Multi-Modal Data Augmentationcited by 61
- 2022Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Modulecited by 43
- 2021SSMix: Saliency-Based Span Mixup for Text Classificationcited by 39
- 2021MixSpeech: Data Augmentation for Low-resource Automatic Speech Recognitioncited by 38
- 2024A Comprehensive Survey on Data Augmentationcited by 38
- 2022On the Calibration of Pre-trained Language Models using Mixup Guided by Area Under the Margin and Saliencycited by 31
- 2022MixAugment & Mixup: Augmentation Methods for Facial Expression Recognitioncited by 31
12 most cited of 119 All 119 (JSON)
- 2026AIA2: Attribute-Agnostic Imbalance Augmentation for Subgroup Robustness31 Aug 2026
- 2026Quantifying and Optimizing Simplicity via Polynomial Representations28 May 2026
- 2026Imbalanced Data Clustering via Targeted Data Augmentation Using GMM and LLM19 May 2026
- 2026Fidelity, Diversity, and Privacy: A Multi-Dimensional LLM Evaluation for Clinical Data Augmentation29 Apr 2026
- 2026XITE: Cross-lingual Interpolation for Transfer using Embeddings26 Apr 2026
- 2026inversedMixup: Data Augmentation via Inverting Mixed Embeddings29 Jan 2026
- 2025Mitigating Shortcut Learning with InterpoLated Learning7 Jul 2025
- 2025A Study on Mixup-Inspired Augmentation Methods for Software Vulnerability Detection22 Apr 2025
- 2025Mixup Regularization: A Probabilistic Perspective19 Feb 2025
- 2025MixDec Sampling: A Soft Link-based Sampling Method of Graph Neural Network for Recommendation12 Feb 2025
- 2024LH-Mix: Local Hierarchy Correlation Guided Mixup over Hierarchical Prompt Tuning22 Dec 2024
- 2024Text Classification using Graph Convolutional Networks: A Comprehensive Survey12 Oct 2024
12 newest of 119 All 119 (JSON)