MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text Classification
Not on the map. Why?
Abstract (arXiv)
This paper presents MixText, a semi-supervised learning method for text classification, which uses our newly designed data augmentation method called TMix. TMix creates a large amount of augmented training samples by interpolating text in hidden space. Moreover, we leverage recent advances in data augmentation to guess low-entropy labels for unlabeled data, hence making them as easy to use as labeled data.By mixing labeled, unlabeled and augmented data, MixText significantly outperformed current pre-trained and fined-tuned models and other state-of-the-art semi-supervised learning methods on several text classification benchmarks. The improvement is especially prominent when supervision is extremely limited. We have publicly released our code at https://github.com/GT-SALT/MixText.
Key facts. Cited by 187 papers in the map (data through 14 Oct 2026). First posted on arXiv 25 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 42; 2022: 50; 2023: 52; 2024: 23; 2025: 11; 2026: 9.
187 papers.
Sort:
By area:
- 2021True Few-Shot Learning with Language Modelscited by 344
- 2021A Survey on Deep Semi-supervised Learningcited by 251
- 2023Data-centric Artificial Intelligence: A Surveycited by 203
- 2022Generating Training Data with Language Models: Towards Zero-Shot Language Understandingcited by 199
- 2021GPT3Mix: Leveraging Large-scale Language Models for Text Augmentationcited by 187
- 2021Noisy Channel Language Model Prompting for Few-Shot Text Classificationcited by 165
- 2023Increasing Diversity While Maintaining Accuracy: Text Data Generation with Large Language Models and Human Interventionscited by 125
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2021Measure and Improve Robustness in NLP Models: A Surveycited by 107
- 2023Text Classification via Large Language Modelscited by 106
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2023Waffling around for Performance: Visual Classification with Random Words and Broad Conceptscited by 101
38 more
- 2021Improving and Simplifying Pattern Exploiting Trainingcited by 97
- 2022USB: A Unified Semi-supervised Learning Benchmark for Classificationcited by 95
- 2021Continual Learning for Text Classification with Information Disentanglement Based Regularizationcited by 86
- 2022STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translationcited by 57
- 2024Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluationcited by 57
- 2022Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Modulecited by 44
- 2021A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectivescited by 41
- 2021Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-Trainingcited by 41
- 2021SSMix: Saliency-Based Span Mixup for Text Classificationcited by 39
- 2021True Few-Shot Learning with Prompts -- A Real-World Perspectivecited by 38
- 2022Tuning Language Models as Training Data Generators for Augmentation-Enhanced Few-Shot Learningcited by 36
- 2021HiddenCut: Simple Data Augmentation for Natural Language Understanding with Better Generalizationcited by 32
- 2021FlipDA: Effective and Robust Data Augmentation for Few-Shot Learningcited by 32
- 2022On the Calibration of Pre-trained Language Models using Mixup Guided by Area Under the Margin and Saliencycited by 31
- 2022Continual Sequence Generation with Adaptive Compositional Modulescited by 31
- 2022MixAugment & Mixup: Augmentation Methods for Facial Expression Recognitioncited by 31
- 2022A Survey of Mix-based Data Augmentation: Taxonomy, Methods, Applications, and Explainabilitycited by 31
- 2024A Survey on Data Augmentation in Large Model Eracited by 31
- 2022Enhancing Cross-lingual Transfer by Manifold Mixupcited by 30
- 2025Shifting AI Efficiency From Model-Centric to Data-Centric Compressioncited by 29
- 2021Self-supervised Dialogue Learning for Spoken Conversational Question Answeringcited by 28
- 2021Learning with Different Amounts of Annotation: From Zero to Many Labelscited by 28
- 2021The Rich Get Richer: Disparate Impact of Semi-Supervised Learningcited by 28
- 2024Scalable Language Model with Generalized Continual Learningcited by 28
- 2021Pre-train or Annotate? Domain Adaptation with a Constrained Budgetcited by 27
- 2024Heterogeneous Contrastive Learning for Foundation Models and Beyondcited by 27
- 2021Survey: Image Mixing and Deleting for Data Augmentationcited by 26
- 2022Robustness Analysis of Video-Language Models Against Visual and Language Perturbationscited by 23
- 2023Don't Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learnercited by 23
- 2023FedET: A Communication-Efficient Federated Class-Incremental Learning Framework Based on Enhanced Transformercited by 23
- 2023Knowledge-Infused Prompting: Assessing and Advancing Clinical Text Data Generation with Large Language Modelscited by 20
- 2024A Survey on Mixup Augmentations and Beyondcited by 20
- 2021Self-training Improves Pre-training for Few-shot Learning in Task-oriented Dialog Systemscited by 18
- 2021AUGNLG: Few-shot Natural Language Generation using Self-trained Data Augmentationcited by 17
- 2023Rethinking Semi-supervised Learning with Language Modelscited by 17
- 2021Weakly-Supervised Hierarchical Models for Predicting Persuasive Strategies in Good-faith Textual Requestscited by 16
- 2021Cross-SEAN: A Cross-Stitch Semi-Supervised Neural Attention Model for COVID-19 Fake News Detectioncited by 15
- 2022TreeMix: Compositional Constituency-based Data Augmentation for Natural Language Understandingcited by 15
50 most cited of 187 All 187 (JSON)
- 2026SharP: Soft and Hard Prompt-Guided Augmentation with LLM for Low Resource Fake News Detection9 Oct 2026
- 2026The Art of Mixology: Mixup-based Obfuscation for Privacy-Preserving Split Learning in Large Language Models15 Jun 2026
- 2026Do Vision Models Truly Forget? New Findings from Representation-Level Certification of Visual Unlearning in Vertical Federated Learning19 May 2026
- 2026XITE: Cross-lingual Interpolation for Transfer using Embeddings26 Apr 2026
- 2026JEPAMatch: Geometric Representation Shaping for Semi-Supervised Learning22 Apr 2026
- 2026Semi-Supervised Learning with Balanced Deep Representation Distributions22 Mar 2026
- 2026NanoNet: Parameter-Efficient Learning with Label-Scarce Supervision for Lightweight Text Mining Model5 Feb 2026
- 2026BhashaSetu: Cross-Lingual Knowledge Transfer from High-Resource to Extreme Low-Resource Languages5 Feb 2026
- 2026inversedMixup: Data Augmentation via Inverting Mixed Embeddings29 Jan 2026
- 2025CONFIDE: Hallucination Assessment for Reliable Biomolecular Structure Prediction and Design20 Nov 2025
- 2025LM-mixup: Text Data Augmentation via Language Model based Mixup23 Oct 2025
- 2025Backtranslation and paraphrasing in the LLM era? Comparing data augmentation methods for emotion classification19 Jul 2025
38 more
- 2025MultiMatch: Multihead Consistency Regularization Matching for Semi-Supervised Text Classification9 Jun 2025
- 2025Shifting AI Efficiency From Model-Centric to Data-Centric Compression25 May 2025
- 2025SMOTExT: SMOTE meets Large Language Models19 May 2025
- 2025The Efficiency of Pre-training with Objective Masking in Pseudo Labeling for Semi-Supervised Text Classification10 May 2025
- 2025AKD : Adversarial Knowledge Distillation For Large Language Models Alignment on Coding tasks5 May 2025
- 2025CGMatch: A Different Perspective of Semi-supervised Learning4 Mar 2025
- 2025MAGE: Multi-Head Attention Guided Embeddings for Low Resource Sentiment Classification25 Feb 2025
- 2025TCProF: Time-Complexity Prediction SSL Framework10 Feb 2025
- 2024LH-Mix: Local Hierarchy Correlation Guided Mixup over Hierarchical Prompt Tuning22 Dec 2024
- 2024Does VLM Classification Benefit from LLM Description Semantics?16 Dec 2024
- 2024Lightweight Contenders: Navigating Semi-Supervised Text Mining through Peer Collaboration and Self Transcendence1 Dec 2024
- 2024Soft-TransFormers for Continual Learning25 Nov 2024
- 2024Fine-tuning Large Language Models with Limited Data: A Survey and Practical Guide14 Nov 2024
- 2024Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluation17 Oct 2024
- 2024Towards Privacy-Guaranteed Label Unlearning in Vertical Federated Learning: Few-Shot Forgetting without Disclosure14 Oct 2024
- 2024ALVIN: Active Learning Via INterpolation11 Oct 2024
- 2024The Effects of Hallucinations in Synthetic Training Data for Relation Extraction10 Oct 2024
- 2024SFTMix: Elevating Language Model Instruction Tuning with Mixup Recipe7 Oct 2024
- 2024Exploring Empty Spaces: Human-in-the-Loop Data Augmentation1 Oct 2024
- 2024Reducing and Exploiting Data Augmentation Noise through Meta Reweighting Contrastive Learning for Text Classification26 Sep 2024
- 2024FPMT: Enhanced Semi-Supervised Model for Traffic Incident Detection12 Sep 2024
- 2024A Survey on Mixup Augmentations and Beyond8 Sep 2024
- 2024Investigating the Impact of Semi-Supervised Methods with Data Augmentation on Offensive Language Detection in Romanian Language29 Jul 2024
- 2024Scalable Language Model with Generalized Continual Learning11 Apr 2024
- 2024Heterogeneous Contrastive Learning for Foundation Models and Beyond30 Mar 2024
- 2024Towards Robustness and Diversity: Continual Learning in Dialog Generation with Text-Mixup and Batch Nuclear-Norm Maximization16 Mar 2024
- 2024Retrieval-Augmented Data Augmentation for Low-Resource Domain Tasks21 Feb 2024
- 2024Evaluation Metrics for Text Data Augmentation in NLP9 Feb 2024
- 2024Does DetectGPT Fully Utilize Perturbation? Bridging Selective Perturbation to Fine-tuned Contrastive Learning Detector would be Better1 Feb 2024
- 2024A Survey on Data Augmentation in Large Model Era27 Jan 2024
- 2024IndiText Boost: Text Augmentation for Low Resource India Languages23 Jan 2024
- 2023Neural Networks Against (and For) Self-Training: Classification with Small Labeled and Large Unlabeled Sets31 Dec 2023
- 2023A Soft Contrastive Learning-based Prompt Model for Few-shot Sentiment Analysis16 Dec 2023
- 2023Boosting Prompt-Based Self-Training With Mapping-Free Automatic Verbalizer for Multi-Class Classification8 Dec 2023
- 2023Summarization-based Data Augmentation for Document Classification1 Dec 2023
- 2023Text2Tree: Aligning Text Representation to the Label Tree Hierarchy for Imbalanced Medical Classification28 Nov 2023
- 2023SCStory: Self-supervised and Continual Online Story Discovery27 Nov 2023
- 2023SegMix: A Simple Structure-Aware Data Augmentation Method16 Nov 2023
50 newest of 187 All 187 (JSON)
- 2021Self-Training with Differentiable Teachercited by 7
- 2023Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspectivecited by 5
- 2023Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Modelscited by 5
- 2023DisCo: Distilled Student Models Co-training for Semi-supervised Text Miningcited by 4
- 2022A Semi-supervised Learning Approach with Two Teachers to Improve Breakdown Identification in Dialoguescited by 3
- 2022Augmentation with Projection: Towards an Effective and Efficient Data Augmentation Paradigm for Distillationcited by 2
- 2025AKD : Adversarial Knowledge Distillation For Large Language Models Alignment on Coding taskscited by 0
- 2025AKD : Adversarial Knowledge Distillation For Large Language Models Alignment on Coding tasks5 May 2025
- 2023Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Models15 Jun 2023
- 2023DisCo: Distilled Student Models Co-training for Semi-supervised Text Mining20 May 2023
- 2023Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective3 Feb 2023
- 2022Augmentation with Projection: Towards an Effective and Efficient Data Augmentation Paradigm for Distillation21 Oct 2022
- 2022A Semi-supervised Learning Approach with Two Teachers to Improve Breakdown Identification in Dialogues22 Feb 2022
- 2021Self-Training with Differentiable Teacher15 Sep 2021
- 2021Self-training Improves Pre-training for Few-shot Learning in Task-oriented Dialog Systemscited by 18
- 2023Uncertainty-aware Parameter-Efficient Self-training for Semi-supervised Language Understandingcited by 3
- 2023Neural Networks Against (and For) Self-Training: Classification with Small Labeled and Large Unlabeled Setscited by 2
- 2023Boosting Prompt-Based Self-Training With Mapping-Free Automatic Verbalizer for Multi-Class Classificationcited by 0
- 2023Neural Networks Against (and For) Self-Training: Classification with Small Labeled and Large Unlabeled Sets31 Dec 2023
- 2023Boosting Prompt-Based Self-Training With Mapping-Free Automatic Verbalizer for Multi-Class Classification8 Dec 2023
- 2023Uncertainty-aware Parameter-Efficient Self-training for Semi-supervised Language Understanding19 Oct 2023
- 2021Self-training Improves Pre-training for Few-shot Learning in Task-oriented Dialog Systems28 Aug 2021
- 2024Exploring Empty Spaces: Human-in-the-Loop Data Augmentationcited by 6
- 2024Towards Privacy-Guaranteed Label Unlearning in Vertical Federated Learning: Few-Shot Forgetting without Disclosurecited by 5
- 2026Do Vision Models Truly Forget? New Findings from Representation-Level Certification of Visual Unlearning in Vertical Federated Learningcited by 1
- 2026Do Vision Models Truly Forget? New Findings from Representation-Level Certification of Visual Unlearning in Vertical Federated Learning19 May 2026
- 2024Towards Privacy-Guaranteed Label Unlearning in Vertical Federated Learning: Few-Shot Forgetting without Disclosure14 Oct 2024
- 2024Exploring Empty Spaces: Human-in-the-Loop Data Augmentation1 Oct 2024
- 2024A Survey on Data Augmentation in Large Model Eracited by 31
- 2024A Survey on Data Augmentation in Large Model Era27 Jan 2024
- 2023Sample-efficient Adversarial Imitation Learningcited by 0
- 2023Sample-efficient Adversarial Imitation Learning14 Mar 2023
- 2021True Few-Shot Learning with Language Modelscited by 344
- 2021A Survey on Deep Semi-supervised Learningcited by 251
- 2023Data-centric Artificial Intelligence: A Surveycited by 203
- 2022Generating Training Data with Language Models: Towards Zero-Shot Language Understandingcited by 199
- 2021GPT3Mix: Leveraging Large-scale Language Models for Text Augmentationcited by 187
- 2021Noisy Channel Language Model Prompting for Few-Shot Text Classificationcited by 165
- 2023Increasing Diversity While Maintaining Accuracy: Text Data Generation with Large Language Models and Human Interventionscited by 125
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2021Measure and Improve Robustness in NLP Models: A Surveycited by 107
- 2023Text Classification via Large Language Modelscited by 106
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2021Improving and Simplifying Pattern Exploiting Trainingcited by 97
12 most cited of 167 All 167 (JSON)
- 2026SharP: Soft and Hard Prompt-Guided Augmentation with LLM for Low Resource Fake News Detection9 Oct 2026
- 2026The Art of Mixology: Mixup-based Obfuscation for Privacy-Preserving Split Learning in Large Language Models15 Jun 2026
- 2026XITE: Cross-lingual Interpolation for Transfer using Embeddings26 Apr 2026
- 2026JEPAMatch: Geometric Representation Shaping for Semi-Supervised Learning22 Apr 2026
- 2026Semi-Supervised Learning with Balanced Deep Representation Distributions22 Mar 2026
- 2026NanoNet: Parameter-Efficient Learning with Label-Scarce Supervision for Lightweight Text Mining Model5 Feb 2026
- 2026BhashaSetu: Cross-Lingual Knowledge Transfer from High-Resource to Extreme Low-Resource Languages5 Feb 2026
- 2026inversedMixup: Data Augmentation via Inverting Mixed Embeddings29 Jan 2026
- 2025CONFIDE: Hallucination Assessment for Reliable Biomolecular Structure Prediction and Design20 Nov 2025
- 2025Backtranslation and paraphrasing in the LLM era? Comparing data augmentation methods for emotion classification19 Jul 2025
- 2025MultiMatch: Multihead Consistency Regularization Matching for Semi-Supervised Text Classification9 Jun 2025
- 2025SMOTExT: SMOTE meets Large Language Models19 May 2025
12 newest of 167 All 167 (JSON)