mlsanityData to 7 Oct 2026

Recent Deep Semi-supervised Learning Approaches and Related Works

arXiv 2106.11528 ↗First posted 22 Jun 2021cs.LG cs.AI cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

This work proposes an overview of the recent semi-supervised learning approaches and related works. Despite the remarkable success of neural networks in various applications, there exist a few formidable constraints, including the need for a large amount of labeled data. Therefore, semi-supervised learning, which is a learning scheme in which scarce labels and a larger amount of unlabeled data are utilized to train models (e.g., deep neural networks), is getting more important. Based on the key assumptions of semi-supervised learning, which are the manifold assumption, cluster assumption, and continuity assumption, the work reviews the recent semi-supervised learning approaches. In particular, the methods in regard to using deep neural networks in a semi-supervised learning setting are primarily discussed. In addition, the existing works are first classified based on the underlying idea and explained, then the holistic approaches that unify the aforementioned ideas are detailed.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 25 of its 39 references that are in the map. First posted on arXiv 22 Jun 2021.

Builds on

25 of 39 references.

References · 25

  1. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  2. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  3. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  4. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
  5. 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,080
  6. 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,390
  7. 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
  8. 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
  9. 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,054
  10. 2016Deep Networks with Stochastic Depthcited by 973
  11. 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 918
  12. 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 806
13 more
  1. 2014Deep Learning in Neural Networks: An Overviewcited by 765
  2. 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 511
  3. 2017Regularizing Neural Networks by Penalizing Confident Output Distributionscited by 461
  4. 2016Regularization With Stochastic Transformations and Perturbations for Deep Semi-Supervised Learningcited by 441
  5. 2019ReMixMatch: Semi-Supervised Learning with Distribution Alignment and Augmentation Anchoringcited by 349
  6. 2019S4L: Self-Supervised Semi-Supervised Learningcited by 335
  7. 2019On Mixup Training: Improved Calibration and Predictive Uncertainty for Deep Neural Networkscited by 304
  8. 2019Interpolation Consistency Training for Semi-Supervised Learningcited by 248
  9. 2015Semi-Supervised Learning with Ladder Networkscited by 246
  10. 2014Learning with Pseudo-Ensemblescited by 241
  11. 2018MixUp as Locally Linear Out-Of-Manifold Regularizationcited by 158
  12. 2017Shake-Shake regularizationcited by 87
  13. 2018There Are Many Consistent Explanations of Unlabeled Data: Why You Should Averagecited by 82

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 2.

3 papers.