mlsanityData to 14 Oct 2026

Bandit-Driven Batch Selection for Robust Learning under Label Noise

arXiv 2311.00096 ↗First posted 31 Oct 2023cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

We introduce a novel approach for batch selection in Stochastic Gradient Descent (SGD) training, leveraging combinatorial bandit algorithms. Our methodology focuses on optimizing the learning process in the presence of label noise, a prevalent issue in real-world datasets. Experimental evaluations on the CIFAR-10 dataset reveal that our approach consistently outperforms existing methods across various levels of label corruption. Importantly, we achieve this superior performance without incurring the computational overhead commonly associated with auxiliary neural network models. This work presents a balanced trade-off between computational efficiency and model efficacy, offering a scalable solution for complex machine learning applications.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 34 references that are in the map. First posted on arXiv 31 Oct 2023.

Builds on

23 of 34 references.

References · 23

  1. 2016Densely Connected Convolutional Networkscited by 6,720
  2. 2016Understanding deep learning requires rethinking generalizationcited by 1,674
  3. 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,391
  4. 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,059
  5. 2017A Closer Look at Memorization in Deep Networkscited by 942
  6. 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 692
  7. 2018Learning to Reweight Examples for Robust Deep Learningcited by 675
  8. 2017MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labelscited by 653
  9. 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 582
  10. 2019How does Disagreement Help Generalization against Label Corruption?cited by 390
  11. 2014Training Deep Neural Networks on Noisy Labels with Bootstrappingcited by 322
  12. 2018Joint Optimization Framework for Learning with Noisy Labelscited by 293
11 more
  1. 2017WebVision Database: Visual Learning and Understanding from Web Datacited by 262
  2. 2020Identifying Mislabeled Data using the Area Under the Margin Rankingcited by 261
  3. 2017Automated Curriculum Learning for Neural Networkscited by 257
  4. 2017Teacher-Student Curriculum Learningcited by 210
  5. 2019Probabilistic End-to-end Noise Correction for Learning with Noisy Labelscited by 210
  6. 2017Active Bias: Training More Accurate Neural Networks by Emphasizing High Variance Samplescited by 147
  7. 2015Online Batch Selection for Faster Training of Neural Networkscited by 122
  8. 2019Combating Label Noise in Deep Learning Using Abstentioncited by 86
  9. 2017Boltzmann Exploration Done Rightcited by 69
  10. 2015Importance weighting without importance weights: An efficient algorithm for combinatorial semi-banditscited by 16
  11. 2019Carpe Diem, Seize the Samples Uncertain "At the Moment" for Adaptive Batch Selectioncited by 10

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.