MTSSL: Meta-Thresholding Semi-Supervised Learning
Not on the map. Why?
Abstract (arXiv)
A large body of Semi-supervised Learning~(SSL) algorithms encounter the threshold τ to select pseudo-labels. The value of τ across different SSL algorithms can vary depending on the learning perspective, yet they may achieve similar performance. It motivates us to establish a unified theoretical framework to explain the role of τ in SSL. We statistically explained that the unsupervised loss is affected independently by correct and incorrect pseudo-labels, while τ adjusts their numbers to balance the corresponding error term. This inherent trade-off indicates that SSL can reach the same loss with varying τ, precise optimal values of τ during training may be unnecessary. With this, we treat τ as an updatable parameter and optimize it via differentiation; the new policy is named Meta-Thresholding Semi-Supervised Learning (MTSSL). Extensive experiments demonstrate the superior performance of MTSSL. We observe that the accuracy curves of SSL algorithms can overlap completely even when the values of τ differ significantly, which supports our theoretical framework and indicates that the selection of τ can be relaxed in the future design of SSL algorithms.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 50 references that are in the map. First posted on arXiv 17 Jul 2026.
Builds on
34 of 50 references.
References · 34
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2021Convex optimizationcited by 2,515
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,391
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,380
- 2019Unsupervised Data Augmentation for Consistency Trainingcited by 1,060
- 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 920
- 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 692
- 2021FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labelingcited by 540
- 2019Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learningcited by 510
- 2019ReMixMatch: Semi-Supervised Learning with Distribution Alignment and Augmentation Anchoringcited by 349
- 2019Label Propagation for Deep Semi-supervised Learningcited by 289
22 more
- 2015Semi-Supervised Learning with Ladder Networkscited by 247
- 2022FreeMatch: Self-adaptive Thresholding for Semi-supervised Learningcited by 232
- 2020Rethinking the Value of Labels for Improving Class-Imbalanced Learningcited by 216
- 2020CoMatch: Semi-supervised Learning with Contrastive Graph Regularizationcited by 167
- 2021Dash: Semi-Supervised Learning with Dynamic Thresholdingcited by 148
- 2023SoftMatch: Addressing the Quantity-Quality Trade-off in Semi-supervised Learningcited by 133
- 2022SimMatch: Semi-supervised Learning with Similarity Matchingcited by 118
- 2021AdaMatch: A Unified Approach to Semi-Supervised Learning and Domain Adaptationcited by 104
- 2021Semi-Supervised Domain Generalization with Stochastic StyleMatchcited by 43
- 2021Revisiting Consistency Regularization for Semi-Supervised Learningcited by 34
- 2017Low-shot learning with large-scale diffusioncited by 33
- 2023Boosting Semi-Supervised Learning by Exploiting All Unlabeled Datacited by 26
- 2023Shrinking Class Space for Enhanced Certainty in Semi-Supervised Learningcited by 17
- 2020Density-Aware Graph for Deep Semi-Supervised Visual Recognitioncited by 15
- 2021On Data-Augmentation and Consistency-Based Semi-Supervised Learningcited by 13
- 2023InstanT: Semi-supervised Learning with Instance-dependent Thresholdscited by 13
- 2023Boosting Semi-Supervised Learning by bridging high and low-confidence predictionscited by 11
- 2023MarginMatch: Improving Semi-Supervised Learning with Pseudo-Marginscited by 10
- 2020Semi-Supervised Learning with Meta-Gradientcited by 7
- 2020MLR-SNet: Transferable LR Schedules for Heterogeneous Taskscited by 5
- 2024RegMixMatch: Optimizing Mixup Utilization in Semi-Supervised Learningcited by 5
- 2023Exploration and Exploitation of Unlabeled Data for Open-Set Semi-Supervised Learningcited by 2
Built on by
Not cited yet.