ReMixMatch: Semi-Supervised Learning with Distribution Alignment and Augmentation Anchoring
Not on the map. Why?
Abstract (arXiv)
We improve the recently-proposed "MixMatch" semi-supervised learning algorithm by introducing two new techniques: distribution alignment and augmentation anchoring. Distribution alignment encourages the marginal distribution of predictions on unlabeled data to be close to the marginal distribution of ground-truth labels. Augmentation anchoring feeds multiple strongly augmented versions of an input into the model and encourages each output to be close to the prediction for a weakly-augmented version of the same input. To produce strong augmentations, we propose a variant of AutoAugment which learns the augmentation policy while the model is being trained. Our new algorithm, dubbed ReMixMatch, is significantly more data-efficient than prior work, requiring between 5× and 16× less data to reach the same accuracy. For example, on CIFAR-10 with 250 labeled examples we reach 93.73% accuracy (compared to MixMatch's accuracy of 93.58% with 4,000 examples) and a median accuracy of 84.92% with just four labels per class. We make our code and data open-source at https://github.com/google-research/remixmatch.
Key facts. Cited by 349 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 73; 2022: 90; 2023: 75; 2024: 63; 2025: 30; 2026: 18.
349 papers.
Sort:
By area:
- 2021End-to-End Semi-Supervised Object Detection with Soft Teachercited by 315
- 2021Unbiased Teacher for Semi-Supervised Object Detectioncited by 305
- 2021One Million Scenes for Autonomous Driving: ONCE Datasetcited by 218
- 2022Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentationcited by 177
- 2021Open-World Semi-Supervised Learningcited by 165
- 2022SimMatch: Semi-supervised Learning with Similarity Matchingcited by 118
- 2021Humble Teachers Teach Better Students for Semi-Supervised Object Detectioncited by 115
- 2021Semi-Supervised Learning of Visual Features by Non-Parametrically Predicting View Assignments with Support Samplescited by 114
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2022A Comprehensive Survey of Image Augmentation Techniques for Deep Learningcited by 95
- 2022USB: A Unified Semi-supervised Learning Benchmark for Classificationcited by 95
- 2022LaserMix for Semi-Supervised LiDAR Semantic Segmentationcited by 92
38 more
- 2025Describe Anything: Detailed Localized Image and Video Captioningcited by 84
- 2021PixMatch: Unsupervised Domain Adaptation via Pixelwise Consistency Trainingcited by 80
- 2021Re-distributing Biased Pseudo Labels for Semi-supervised Semantic Segmentation: A Baseline Investigationcited by 78
- 2022Debiased Self-Training for Semi-Supervised Learningcited by 62
- 2022Class-Aware Contrastive Semi-Supervised Learningcited by 62
- 2024Multi-Modal Data-Efficient 3D Scene Understanding for Autonomous Drivingcited by 53
- 2024UniMatch V2: Pushing the Limit of Semi-Supervised Semantic Segmentationcited by 53
- 2022Semi-Supervised and Unsupervised Deep Visual Learning: A Surveycited by 52
- 2022Dense Teacher: Dense Pseudo-Labels for Semi-supervised Object Detectioncited by 48
- 2021SemiFL: Semi-Supervised Federated Learning for Unlabeled Clients with Alternate Trainingcited by 45
- 2022Learning to Detect Mobile Objects from LiDAR Scans Without Labelscited by 44
- 2021Universal-Prototype Enhancing for Few-Shot Object Detectioncited by 43
- 2021OpenMatch: Open-set Consistency Regularization for Semi-supervised Learning with Outlierscited by 43
- 2021Local contrastive loss with pseudo-label based self-training for semi-supervised medical image segmentationcited by 43
- 2023Active Teacher for Semi-Supervised Object Detectioncited by 43
- 2023Backdoor Defense via Adaptively Splitting Poisoned Datasetcited by 43
- 2021SECANT: Self-Expert Cloning for Zero-Shot Generalization of Visual Policiescited by 42
- 2022KG-SP: Knowledge Guided Simple Primitives for Open World Compositional Zero-Shot Learningcited by 41
- 2021Learning Fair Classifiers with Partially Annotated Group Labelscited by 40
- 2021A Realistic Evaluation of Semi-Supervised Learning for Fine-Grained Classificationcited by 36
- 2021AutoDropout: Learning Dropout Patterns to Regularize Deep Networkscited by 35
- 2021SelfMatch: Combining Contrastive Self-Supervision and Consistency for Semi-Supervised Learningcited by 35
- 2022ProxyMix: Proxy-based Mixup Training with Label Refinery for Source-Free Domain Adaptationcited by 34
- 2021Reference-guided Pseudo-Label Generation for Medical Semantic Segmentationcited by 33
- 2021Pseudo-labeling for Scalable 3D Object Detectioncited by 32
- 2021MixMo: Mixing Multiple Inputs for Multiple Outputs via Deep Subnetworkscited by 32
- 2021All Labels Are Not Created Equal: Enhancing Semi-supervision via Label Grouping and Co-trainingcited by 32
- 2022ReMix: A General and Efficient Framework for Multiple Instance Learning based Whole Slide Image Classificationcited by 30
- 2022Instance-specific and Model-adaptive Supervision for Semi-supervised Semantic Segmentationcited by 30
- 2022A Survey of Mix-based Data Augmentation: Taxonomy, Methods, Applications, and Explainabilitycited by 30
- 2021Direct Differentiable Augmentation Searchcited by 28
- 2021Semi-Supervised Object Detection with Adaptive Class-Rebalancing Self-Trainingcited by 28
- 2021The Rich Get Richer: Disparate Impact of Semi-Supervised Learningcited by 28
- 2022Duplex Conversation: Towards Human-like Interaction in Spoken Dialogue Systemscited by 28
- 2021Unsupervised Selective Labeling for More Effective Semi-Supervised Learningcited by 27
- 2021Multimodal Knowledge Expansioncited by 26
- 2021Semi-supervised Contrastive Learning with Similarity Co-calibrationcited by 26
- 2023Diverse Cotraining Makes Strong Semi-Supervised Segmentorcited by 26
50 most cited of 349 All 349 (JSON)
- 2026SpecRegMatch: Robust Semi-Supervised Regression for Vehicle Interior Noise Prediction28 Sep 2026
- 2026SomaNet: Weakly Supervised Learning for Instance Soma Segmentation in 3D Electron Microscopy with Partial Annotations19 Sep 2026
- 2026Learning Dynamics of Logits Debiasing for Long-Tailed Semi-Supervised Learning31 Aug 2026
- 2026ReCalMatch:Reliability-Calibrated Semantic Guidance for Semi-Supervised Fine-Grained Recognition30 Aug 2026
- 2026MTSSL: Meta-Thresholding Semi-Supervised Learning17 Jul 2026
- 2026Self-Supervised Visual Representation Learning: Pretrain-Finetuning or Joint Training?14 Jul 2026
- 2026Geometric Gradient Rectification for Safe Open-Set Semi-Supervised Learning25 Jun 2026
- 2026Semi-MedRef: Semi-Supervised Medical Referring Image Segmentation with Cross-Modal Alignment15 May 2026
- 2026Multimodal Deep Generative Model for Semi-Supervised Learning under Class Imbalance7 May 2026
- 2026Uncertainty-Guided Edge Learning for Deep Image Regression in Remote Sensing7 May 2026
- 2026JEPAMatch: Geometric Representation Shaping for Semi-Supervised Learning22 Apr 2026
- 2026Hold-One-Shot-Out (HOSO) for Validation-Free Few-Shot CLIP Adapters4 Mar 2026
38 more
- 2026EgoPoseFormer v2: Accurate Egocentric Human Motion Estimation for AR/VR4 Mar 2026
- 2026Why Self-Rewarding Works: Theoretical Guarantees for Iterative Alignment of Language Models30 Jan 2026
- 2026SemAlign: Language Guided Semi-supervised Domain Generalization16 Jan 2026
- 2026CoVar: Confidence-Variance-Guided Pseudo-Label Selection for Semi-Supervised Learning16 Jan 2026
- 2026Semi-Supervised Facial Expression Recognition based on Dynamic Threshold and Negative Learning9 Jan 2026
- 2026Improving Semi-Supervised Contrastive Learning via Entropy-Weighted Confidence Integration of Anchor-Positive Pairs8 Jan 2026
- 2025CATCHFed: Efficient Unlabeled Data Utilization for Semi-Supervised Federated Learning in Limited Labels Environments14 Nov 2025
- 2025Semi-Supervised Learning under General Causal Models26 Oct 2025
- 2025BARL: Bilateral Alignment in Representation and Label Spaces for Semi-Supervised Volumetric Medical Image Segmentation19 Oct 2025
- 2025SpikeMatch: Semi-Supervised Learning with Temporal Dynamics of Spiking Neural Networks26 Sep 2025
- 2025SADA: Safe and Adaptive Aggregation of Multiple Black-Box Predictions in Semi-Supervised Learning26 Sep 2025
- 2025FLARE-SSM: Deep State Space Models with Influence-Balanced Loss for 72-Hour Solar Flare Prediction12 Sep 2025
- 2025Collaborative Learning of Scattering and Deep Features for SAR Target Recognition with Noisy Labels11 Aug 2025
- 2025Quantitative Estimation of Target Task Performance from Unsupervised Pretext Task in Semi/Self-Supervised Learning10 Aug 2025
- 2025JanusNet: Hierarchical Slice-Block Shuffle and Displacement for Semi-Supervised 3D Multi-Organ Segmentation6 Aug 2025
- 2025CaliMatch: Adaptive Calibration for Improving Safe Semi-supervised Learning30 Jul 2025
- 2025FixCLR: Negative-Class Contrastive Learning for Semi-Supervised Domain Generalization25 Jun 2025
- 2025Domain Adaptation for Image Classification of Defects in Semiconductor Manufacturing18 Jun 2025
- 2025ZeroVO: Visual Odometry with Minimal Assumptions9 Jun 2025
- 2025MultiMatch: Multihead Consistency Regularization Matching for Semi-Supervised Text Classification9 Jun 2025
- 2025Bridging Weakly-Supervised Learning and VLM Distillation: Noisy Partial Label Learning for Efficient Downstream Adaptation3 Jun 2025
- 2025P3Net: Progressive and Periodic Perturbation for Semi-Supervised Medical Image Segmentation21 May 2025
- 2025Unlabeled Data vs. Pre-trained Knowledge: Rethinking SSL in the Era of Large Models19 May 2025
- 2025Pseudo-Label Quality Decoupling and Correction for Semi-Supervised Instance Segmentation16 May 2025
- 2025AnomalyMatch: Discovering Rare Objects of Interest with Semi-supervised and Active Learning6 May 2025
- 2025Describe Anything: Detailed Localized Image and Video Captioning22 Apr 2025
- 20253DResT: A Strong Baseline for Semi-Supervised 3D Referring Expression Segmentation17 Apr 2025
- 2025Domain-Agnostic Feature Modulation for Semi-Supervised Domain Generalization26 Mar 2025
- 2025SIT-FER: Integration of Semantic-, Instance-, Text-level Information for Semi-supervised Facial Expression Recognition24 Mar 2025
- 2025CustomKD: Customizing Large Vision Foundation for Edge Model Improvement via Knowledge Distillation23 Mar 2025
- 2025Knowledge Consultation for Semi-Supervised Semantic Segmentation12 Mar 2025
- 2025Revisiting semi-supervised learning in the era of foundation models12 Mar 2025
- 2025CGMatch: A Different Perspective of Semi-supervised Learning4 Mar 2025
- 2025Semi-Supervised 360 Layout Estimation with Panoramic Collaborative Perturbations3 Mar 2025
- 2025CRTrack: Low-Light Semi-Supervised Multi-object Tracking Based on Consistency Regularization24 Feb 2025
- 2025Glioma Multimodal MRI Analysis System for Tumor Layered Diagnosis via Multi-task Semi-supervised Learning29 Jan 2025
- 2024Probability-density-aware Semi-supervised Learning23 Dec 2024
- 2024Cross-View Consistency Regularisation for Knowledge Distillation21 Dec 2024
50 newest of 349 All 349 (JSON)
- 2025Describe Anything: Detailed Localized Image and Video Captioningcited by 84
- 2023UP-DP: Unsupervised Prompt Learning for Data Pre-Selection with Vision-Language Modelscited by 3
- 2024Pre-Trained Vision-Language Models as Partial Annotatorscited by 0
- 2024CoVLM: Leveraging Consensus from Vision-Language Models for Semi-supervised Multi-modal Fake News Detectioncited by 0
- 2025Describe Anything: Detailed Localized Image and Video Captioning22 Apr 2025
- 2024CoVLM: Leveraging Consensus from Vision-Language Models for Semi-supervised Multi-modal Fake News Detection6 Oct 2024
- 2024Pre-Trained Vision-Language Models as Partial Annotators23 May 2024
- 2023UP-DP: Unsupervised Prompt Learning for Data Pre-Selection with Vision-Language Models20 Jul 2023
- 2021End-to-End Semi-Supervised Object Detection with Soft Teachercited by 315
- 2021Unbiased Teacher for Semi-Supervised Object Detectioncited by 305
- 2021One Million Scenes for Autonomous Driving: ONCE Datasetcited by 218
- 2022Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentationcited by 177
- 2021Open-World Semi-Supervised Learningcited by 165
- 2022SimMatch: Semi-supervised Learning with Similarity Matchingcited by 118
- 2021Humble Teachers Teach Better Students for Semi-Supervised Object Detectioncited by 115
- 2021Semi-Supervised Learning of Visual Features by Non-Parametrically Predicting View Assignments with Support Samplescited by 114
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2022A Comprehensive Survey of Image Augmentation Techniques for Deep Learningcited by 95
- 2022USB: A Unified Semi-supervised Learning Benchmark for Classificationcited by 95
- 2022LaserMix for Semi-Supervised LiDAR Semantic Segmentationcited by 92
12 most cited of 338 All 338 (JSON)
- 2026SpecRegMatch: Robust Semi-Supervised Regression for Vehicle Interior Noise Prediction28 Sep 2026
- 2026SomaNet: Weakly Supervised Learning for Instance Soma Segmentation in 3D Electron Microscopy with Partial Annotations19 Sep 2026
- 2026Learning Dynamics of Logits Debiasing for Long-Tailed Semi-Supervised Learning31 Aug 2026
- 2026ReCalMatch:Reliability-Calibrated Semantic Guidance for Semi-Supervised Fine-Grained Recognition30 Aug 2026
- 2026MTSSL: Meta-Thresholding Semi-Supervised Learning17 Jul 2026
- 2026Self-Supervised Visual Representation Learning: Pretrain-Finetuning or Joint Training?14 Jul 2026
- 2026Geometric Gradient Rectification for Safe Open-Set Semi-Supervised Learning25 Jun 2026
- 2026Semi-MedRef: Semi-Supervised Medical Referring Image Segmentation with Cross-Modal Alignment15 May 2026
- 2026Multimodal Deep Generative Model for Semi-Supervised Learning under Class Imbalance7 May 2026
- 2026Uncertainty-Guided Edge Learning for Deep Image Regression in Remote Sensing7 May 2026
- 2026JEPAMatch: Geometric Representation Shaping for Semi-Supervised Learning22 Apr 2026
- 2026Hold-One-Shot-Out (HOSO) for Validation-Free Few-Shot CLIP Adapters4 Mar 2026
12 newest of 338 All 338 (JSON)