Distribution Aligning Refinery of Pseudo-label for Imbalanced Semi-supervised Learning
Not on the map. Why?
Abstract (arXiv)
While semi-supervised learning (SSL) has proven to be a promising way for leveraging unlabeled data when labeled data is scarce, the existing SSL algorithms typically assume that training class distributions are balanced. However, these SSL algorithms trained under imbalanced class distributions can severely suffer when generalizing to a balanced testing criterion, since they utilize biased pseudo-labels of unlabeled data toward majority classes. To alleviate this issue, we formulate a convex optimization problem to softly refine the pseudo-labels generated from the biased model, and develop a simple algorithm, named Distribution Aligning Refinery of Pseudo-label (DARP) that solves it provably and efficiently. Under various class-imbalanced semi-supervised scenarios, we demonstrate the effectiveness of DARP and its compatibility with state-of-the-art SSL schemes.
Key facts. Cited by 105 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 20; 2023: 33; 2024: 23; 2025: 8; 2026: 7.
105 papers.
Sort:
By area:
- 2021A Survey on Deep Semi-supervised Learningcited by 250
- 2022FreeMatch: Self-adaptive Thresholding for Semi-supervised Learningcited by 232
- 2021CReST: A Class-Rebalancing Self-Training Framework for Imbalanced Semi-Supervised Learningcited by 174
- 2023SoftMatch: Addressing the Quantity-Quality Trade-off in Semi-supervised Learningcited by 133
- 2022USB: A Unified Semi-supervised Learning Benchmark for Classificationcited by 95
- 2022Spread Spurious Attribute: Improving Worst-group Accuracy with Spurious Attribute Estimationcited by 88
- 2021Re-distributing Biased Pseudo Labels for Semi-supervised Semantic Segmentation: A Baseline Investigationcited by 78
- 2021ABC: Auxiliary Balanced Classifier for Class-imbalanced Semi-supervised Learningcited by 65
- 2022Semi-Supervised and Unsupervised Deep Visual Learning: A Surveycited by 52
- 2021DASO: Distribution-Aware Semantics-Oriented Pseudo-label for Imbalanced Semi-Supervised Learningcited by 51
- 2023STUNT: Few-shot Tabular Learning with Self-generated Tasks from Unlabeled Tablescited by 48
- 2021CoSSL: Co-Learning of Representation and Classifier for Imbalanced Semi-Supervised Learningcited by 41
38 more
- 2021Self-supervised driven consistency training for annotation efficient histopathology image analysiscited by 39
- 2021Revisiting Consistency Regularization for Semi-Supervised Learningcited by 34
- 2022Unbiased Subclass Regularization for Semi-Supervised Semantic Segmentationcited by 33
- 2022SoLar: Sinkhorn Label Refinery for Imbalanced Partial-Label Learningcited by 30
- 2023Navigating the Pitfalls of Active Learning Evaluation: A Systematic Framework for Meaningful Performance Assessmentcited by 25
- 2023On the Effectiveness of Out-of-Distribution Data in Self-Supervised Long-Tail Learningcited by 20
- 2024Erasing the Bias: Fine-Tuning Foundation Models for Semi-Supervised Learningcited by 19
- 2022Imbalanced Semi-supervised Learning with Bias Adaptive Classifiercited by 18
- 2022Label-Noise Learning with Intrinsically Long-Tailed Datacited by 17
- 2021Rethinking Re-Sampling in Imbalanced Semi-Supervised Learningcited by 16
- 2023Class-Distribution-Aware Pseudo Labeling for Semi-Supervised Multi-Label Learningcited by 16
- 2023Semi-Supervised Graph Imbalanced Regressioncited by 14
- 2024SimPro: A Simple Probabilistic Framework Towards Realistic Long-Tailed Semi-Supervised Learningcited by 14
- 2023InstanT: Semi-supervised Learning with Instance-dependent Thresholdscited by 13
- 2023Three Heads Are Better Than One: Complementary Experts for Long-Tailed Semi-supervised Learningcited by 13
- 2022An Embarrassingly Simple Baseline for Imbalanced Semi-Supervised Learningcited by 12
- 2023InPL: Pseudo-labeling the Inliers First for Imbalanced Semi-supervised Learningcited by 12
- 2023Towards Semi-supervised Learning with Non-random Missing Labelscited by 12
- 2023Towards Distribution-Agnostic Generalized Category Discoverycited by 12
- 2021ACP++: Action Co-occurrence Priors for Human-Object Interaction Detectioncited by 11
- 2022On Non-Random Missing Labels in Semi-Supervised Learningcited by 11
- 2022Fix-A-Step: Semi-supervised Learning from Uncurated Unlabeled Datacited by 11
- 2023Boosting Semi-Supervised Learning by bridging high and low-confidence predictionscited by 11
- 2022Semi-Supervised Temporal Action Detection with Proposal-Free Maskingcited by 10
- 2023RoPAWS: Robust Semi-supervised Representation Learning from Uncurated Datacited by 10
- 2024Continuous Contrastive Learning for Long-Tailed Semi-Supervised Recognitioncited by 10
- 2022Transfer and Share: Semi-Supervised Learning from Long-Tailed Datacited by 9
- 2022SPADE: Semi-supervised Anomaly Detection under Distribution Mismatchcited by 9
- 2024BaCon: Boosting Imbalanced Semi-supervised Learning via Balanced Feature-Level Contrastive Learningcited by 9
- 2023SequenceMatch: Revisiting the design of weak-strong augmentations for Semi-supervised learningcited by 8
- 2024Robust Semi-Supervised Learning in Open Environmentscited by 8
- 2021A Neural Pre-Conditioning Active Learning Algorithm to Reduce Label Complexitycited by 7
- 2023Out-of-Distributed Semantic Pruning for Robust Semi-Supervised Learningcited by 7
- 2023Flexible Distribution Alignment: Towards Long-tailed Semi-supervised Learning with Proper Calibrationcited by 7
- 2021An Empirical Study and Analysis on Open-Set Semi-Supervised Learningcited by 6
- 2021Single-Modal Entropy based Active Learning for Visual Question Answeringcited by 6
- 2022RDA: Reciprocal Distribution Alignment for Robust Semi-supervised Learningcited by 6
- 2024Class-Imbalanced Semi-Supervised Learning for Large-Scale Point Cloud Semantic Segmentation via Decoupling Optimizationcited by 6
50 most cited of 105 All 105 (JSON)
- 2026Learning Dynamics of Logits Debiasing for Long-Tailed Semi-Supervised Learning31 Aug 2026
- 2026Geometric Regularization for Long-Tailed Semi-Supervised Learning via Gaussian Feature Bridges21 Aug 2026
- 2026Multimodal Deep Generative Model for Semi-Supervised Learning under Class Imbalance7 May 2026
- 2026H-SemiS: Hierarchical Fusion of Semi and Self-Supervised Learning for Knee Osteoarthritis Severity Grading25 Apr 2026
- 2026Label Shift Estimation With Incremental Prior Update2 Apr 2026
- 2026Leveraging Label Proportion Prior for Class-Imbalanced Semi-Supervised Learning3 Mar 2026
- 2026Semi-Supervised Diseased Detection from Speech Dialogues with Multi-Level Data Modeling8 Jan 2026
- 2025Sampling Control for Imbalanced Calibration in Semi-Supervised Learning24 Nov 2025
- 2025FlexICL: A Flexible Visual In-context Learning Framework for Elbow and Wrist Ultrasound Segmentation30 Oct 2025
- 2025MultiMatch: Multihead Consistency Regularization Matching for Semi-Supervised Text Classification9 Jun 2025
- 2025Long-Tailed Learning for Generalized Category Discovery8 Jun 2025
- 2025Debiasing Online Preference Learning via Preference Feature Preservation6 Jun 2025
38 more
- 2025Unlabeled Data vs. Pre-trained Knowledge: Rethinking SSL in the Era of Large Models19 May 2025
- 2025ULFine: Unbiased Lightweight Fine-tuning for Foundation-Model-Assisted Long-Tailed Semi-Supervised Learning8 May 2025
- 2025SeMi: When Imbalanced Semi-Supervised Learning Meets Mining Hard Examples10 Jan 2025
- 2024Robust Semi-Supervised Learning in Open Environments24 Dec 2024
- 2024RankUp: Boosting Semi-Supervised Regression with an Auxiliary Ranking Classifier29 Oct 2024
- 2024Continuous Contrastive Learning for Long-Tailed Semi-Supervised Recognition8 Oct 2024
- 2024Image-Feature Weak-to-Strong Consistency: An Enhanced Paradigm for Semi-Supervised Learning8 Aug 2024
- 2024Large-scale cervical precancerous screening via AI-assisted cytology whole slide image analysis28 Jul 2024
- 2024Is user feedback always informative? Retrieval Latent Defending for Semi-Supervised Domain Adaptation without Source Data22 Jul 2024
- 2024CRMSP: A Semi-supervised Approach for Key Information Extraction with Class-Rebalancing and Merged Semantic Pseudo-Labeling19 Jul 2024
- 2024ProSub: Probabilistic Open-Set Semi-Supervised Learning with Subspace-Based Out-of-Distribution Detection16 Jul 2024
- 2024Imbalanced Semi-Supervised Learning via Label Refinement and Threshold Adjustment7 Jul 2024
- 2024Rethinking Open-World Semi-Supervised Learning: Distribution Mismatch and Inductive Inference31 May 2024
- 2024Towards Realistic Long-tailed Semi-supervised Learning in an Open World23 May 2024
- 2024Smooth Pseudo-Labeling23 May 2024
- 2024Erasing the Bias: Fine-Tuning Foundation Models for Semi-Supervised Learning20 May 2024
- 2024IMWA: Iterative Model Weight Averaging Benefits Class-Imbalanced Learning Tasks25 Apr 2024
- 2024VCC-INFUSE: Towards Accurate and Efficient Selection of Unlabeled Examples in Semi-supervised Learning18 Apr 2024
- 2024Exploring Probabilistic Models for Semi-supervised Learning5 Apr 2024
- 2024Selective Mixup Fine-Tuning for Optimizing Non-Decomposable Objectives27 Mar 2024
- 2024Learning from Reduced Labels for Long-Tailed Data25 Mar 2024
- 2024BaCon: Boosting Imbalanced Semi-supervised Learning via Balanced Feature-Level Contrastive Learning4 Mar 2024
- 2024SimPro: A Simple Probabilistic Framework Towards Realistic Long-Tailed Semi-Supervised Learning21 Feb 2024
- 2024DUEL: Duplicate Elimination on Active Memory for Self-Supervised Class-Imbalanced Learning14 Feb 2024
- 2024Class-Imbalanced Semi-Supervised Learning for Large-Scale Point Cloud Semantic Segmentation via Decoupling Optimization13 Jan 2024
- 2024Uncertainty-aware Sampling for Long-tailed Semi-supervised Learning9 Jan 2024
- 2023Twice Class Bias Correction for Imbalanced Semi-Supervised Learning27 Dec 2023
- 2023Three Heads Are Better Than One: Complementary Experts for Long-Tailed Semi-supervised Learning25 Dec 2023
- 2023CLAF: Contrastive Learning with Augmented Features for Imbalanced Semi-Supervised Learning15 Dec 2023
- 2023ImbaGCD: Imbalanced Generalized Category Discovery4 Dec 2023
- 2023UCE-FID: Using Large Unlabeled, Medium Crowdsourced-Labeled, and Small Expert-Labeled Tweets for Foodborne Illness Detection2 Dec 2023
- 2023DiverseNet: Decision Diversified Semi-supervised Semantic Segmentation Networks for Remote Sensing Imagery22 Nov 2023
- 2023Re-weighting Tokens: A Simple and Effective Active Learning Strategy for Named Entity Recognition2 Nov 2023
- 2023InstanT: Semi-supervised Learning with Instance-dependent Thresholds29 Oct 2023
- 2023DualMatch: Robust Semi-Supervised Learning with Dual-Level Interaction25 Oct 2023
- 2023SequenceMatch: Revisiting the design of weak-strong augmentations for Semi-supervised learning24 Oct 2023
- 2023Cross-head mutual Mean-Teaching for semi-supervised medical image segmentation8 Oct 2023
- 2023Towards Distribution-Agnostic Generalized Category Discovery2 Oct 2023
50 newest of 105 All 105 (JSON)
- 2021A Survey on Deep Semi-supervised Learningcited by 250
- 2022FreeMatch: Self-adaptive Thresholding for Semi-supervised Learningcited by 232
- 2021CReST: A Class-Rebalancing Self-Training Framework for Imbalanced Semi-Supervised Learningcited by 174
- 2023SoftMatch: Addressing the Quantity-Quality Trade-off in Semi-supervised Learningcited by 133
- 2022USB: A Unified Semi-supervised Learning Benchmark for Classificationcited by 95
- 2022Spread Spurious Attribute: Improving Worst-group Accuracy with Spurious Attribute Estimationcited by 88
- 2021Re-distributing Biased Pseudo Labels for Semi-supervised Semantic Segmentation: A Baseline Investigationcited by 78
- 2021ABC: Auxiliary Balanced Classifier for Class-imbalanced Semi-supervised Learningcited by 65
- 2022Semi-Supervised and Unsupervised Deep Visual Learning: A Surveycited by 52
- 2021DASO: Distribution-Aware Semantics-Oriented Pseudo-label for Imbalanced Semi-Supervised Learningcited by 51
- 2023STUNT: Few-shot Tabular Learning with Self-generated Tasks from Unlabeled Tablescited by 48
- 2021CoSSL: Co-Learning of Representation and Classifier for Imbalanced Semi-Supervised Learningcited by 41
12 most cited of 103 All 103 (JSON)
- 2026Learning Dynamics of Logits Debiasing for Long-Tailed Semi-Supervised Learning31 Aug 2026
- 2026Geometric Regularization for Long-Tailed Semi-Supervised Learning via Gaussian Feature Bridges21 Aug 2026
- 2026Multimodal Deep Generative Model for Semi-Supervised Learning under Class Imbalance7 May 2026
- 2026H-SemiS: Hierarchical Fusion of Semi and Self-Supervised Learning for Knee Osteoarthritis Severity Grading25 Apr 2026
- 2026Label Shift Estimation With Incremental Prior Update2 Apr 2026
- 2026Leveraging Label Proportion Prior for Class-Imbalanced Semi-Supervised Learning3 Mar 2026
- 2026Semi-Supervised Diseased Detection from Speech Dialogues with Multi-Level Data Modeling8 Jan 2026
- 2025Sampling Control for Imbalanced Calibration in Semi-Supervised Learning24 Nov 2025
- 2025FlexICL: A Flexible Visual In-context Learning Framework for Elbow and Wrist Ultrasound Segmentation30 Oct 2025
- 2025MultiMatch: Multihead Consistency Regularization Matching for Semi-Supervised Text Classification9 Jun 2025
- 2025Long-Tailed Learning for Generalized Category Discovery8 Jun 2025
- 2025ULFine: Unbiased Lightweight Fine-tuning for Foundation-Model-Assisted Long-Tailed Semi-Supervised Learning8 May 2025
12 newest of 103 All 103 (JSON)