Recent Deep Semi-supervised Learning Approaches and Related Works
Not on the map. Why?
Abstract (arXiv)
This work proposes an overview of the recent semi-supervised learning approaches and related works. Despite the remarkable success of neural networks in various applications, there exist a few formidable constraints, including the need for a large amount of labeled data. Therefore, semi-supervised learning, which is a learning scheme in which scarce labels and a larger amount of unlabeled data are utilized to train models (e.g., deep neural networks), is getting more important. Based on the key assumptions of semi-supervised learning, which are the manifold assumption, cluster assumption, and continuity assumption, the work reviews the recent semi-supervised learning approaches. In particular, the methods in regard to using deep neural networks in a semi-supervised learning setting are primarily discussed. In addition, the existing works are first classified based on the underlying idea and explained, then the holistic approaches that unify the aforementioned ideas are detailed.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 25 of its 39 references that are in the map. First posted on arXiv 22 Jun 2021.
Builds on
25 of 39 references.
References · 25
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,080
- 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,390
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
- 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,054
- 2016Deep Networks with Stochastic Depthcited by 973
- 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 918
- 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 806
13 more
- 2014Deep Learning in Neural Networks: An Overviewcited by 765
- 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 511
- 2017Regularizing Neural Networks by Penalizing Confident Output Distributionscited by 461
- 2016Regularization With Stochastic Transformations and Perturbations for Deep Semi-Supervised Learningcited by 441
- 2019ReMixMatch: Semi-Supervised Learning with Distribution Alignment and Augmentation Anchoringcited by 349
- 2019S4L: Self-Supervised Semi-Supervised Learningcited by 335
- 2019On Mixup Training: Improved Calibration and Predictive Uncertainty for Deep Neural Networkscited by 304
- 2019Interpolation Consistency Training for Semi-Supervised Learningcited by 248
- 2015Semi-Supervised Learning with Ladder Networkscited by 246
- 2014Learning with Pseudo-Ensemblescited by 241
- 2018MixUp as Locally Linear Out-Of-Manifold Regularizationcited by 158
- 2017Shake-Shake regularizationcited by 87
- 2018There Are Many Consistent Explanations of Unlabeled Data: Why You Should Averagecited by 82
Built on by
Citing papers per year: 2021: 1; 2022: 2.
3 papers.
- 2022DDPM-CD: Denoising Diffusion Probabilistic Models as Feature Extractors for Change Detectioncited by 19
- 2022AI can evolve without labels: self-evolving vision transformer for chest X-ray diagnosis through knowledge distillationcited by 17
- 2021Dealing with Distribution Mismatch in Semi-supervised Deep Learning for Covid-19 Detection Using Chest X-ray Images: A Novel Approach Using Feature Densitiescited by 2
- 2022DDPM-CD: Denoising Diffusion Probabilistic Models as Feature Extractors for Change Detection23 Jun 2022
- 2022AI can evolve without labels: self-evolving vision transformer for chest X-ray diagnosis through knowledge distillation13 Feb 2022
- 2021Dealing with Distribution Mismatch in Semi-supervised Deep Learning for Covid-19 Detection Using Chest X-ray Images: A Novel Approach Using Feature Densities17 Aug 2021