mlsanityData to 7 Oct 2026

Reinforcement Learning-Guided Semi-Supervised Learning

arXiv 2405.01760 ↗First posted 2 May 2024cs.LG cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

In recent years, semi-supervised learning (SSL) has gained significant attention due to its ability to leverage both labeled and unlabeled data to improve model performance, especially when labeled data is scarce. However, most current SSL methods rely on heuristics or predefined rules for generating pseudo-labels and leveraging unlabeled data. They are limited to exploiting loss functions and regularization methods within the standard norm. In this paper, we propose a novel Reinforcement Learning (RL) Guided SSL method, RLGSSL, that formulates SSL as a one-armed bandit problem and deploys an innovative RL loss based on weighted reward to adaptively guide the learning process of the prediction model. RLGSSL incorporates a carefully designed reward function that balances the use of labeled and unlabeled data to enhance generalization performance. A semi-supervised teacher-student framework is further deployed to increase the learning stability. We demonstrate the effectiveness of RLGSSL through extensive experiments on several benchmark datasets and show that our approach achieves consistent superior performance compared to state-of-the-art SSL methods.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 29 of its 47 references that are in the map. First posted on arXiv 2 May 2024.

Builds on

29 of 47 references.

References · 29

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  3. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  4. 2017Deep reinforcement learning from human preferencescited by 3,846
  5. 2020Learning to summarize from human feedbackcited by 2,562
  6. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  7. 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,080
  8. 2016Neural Architecture Search with Reinforcement Learningcited by 1,489
  9. 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,390
  10. 2019Unsupervised Data Augmentation for Consistency Trainingcited by 1,057
  11. 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,054
  12. 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 918
17 more
  1. 2018Learning to Reweight Examples for Robust Deep Learningcited by 670
  2. 2015Sequence Level Training with Recurrent Neural Networkscited by 568
  3. 2021FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labelingcited by 537
  4. 2020Meta Pseudo Labelscited by 372
  5. 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 342
  6. 2019Label Propagation for Deep Semi-supervised Learningcited by 287
  7. 2019Interpolation Consistency Training for Semi-Supervised Learningcited by 248
  8. 2015Semi-Supervised Learning with Ladder Networkscited by 246
  9. 2016An Actor-Critic Algorithm for Sequence Predictioncited by 158
  10. 2021Dash: Semi-Supervised Learning with Dynamic Thresholdingcited by 147
  11. 2019Consistency Regularization for Generative Adversarial Networkscited by 134
  12. 2018There Are Many Consistent Explanations of Unlabeled Data: Why You Should Averagecited by 82
  13. 2017Smooth Neighbors on Teacher Graphs for Semi-supervised Learningcited by 48
  14. 2021Scalable Online Planning via Reinforcement Learning Fine-Tuningcited by 18
  15. 2020Meta-Semi: A Meta-learning Approach for Semi-supervised Learningcited by 11
  16. 2023MarginMatch: Improving Semi-Supervised Learning with Pseudo-Marginscited by 10
  17. 2022Theta-Resonance: A Single-Step Reinforcement Learning Method for Design Space Explorationcited by 4

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.