mlsanityData to 14 Oct 2026

Noise-Aware Framework for Correcting Corrupted Labels

arXiv 2606.11695 ↗First posted 10 Jun 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

High-quality labeled data is essential for training reliable ML/DL models. However, real-world datasets often contain a considerable proportion of corrupted labels, which can severely degrade model performance. To address this problem, we propose CANOLA, a novel framework for correcting corrupted labels through noise-aware learning and iterative label refinement. CANOLA explicitly estimates the underlying noise distribution of the dataset and incorporates this information into the training of a noise-aware Deep Neural Network. By incorporating noise characteristics during learning, CANOLA enables the model to down-weight unreliable supervision signals and focus on trustworthy patterns, thereby improving robustness and generalization. Label correction is performed via cautious, iterative soft label refinement, in which model predictions are blended with observed labels to prevent premature or erroneous updates. This progressive refinement allows the dataset to be repaired in a stable and controlled manner. We evaluate CANOLA on six widely used datasets under realistic noisy labeling scenarios. Experimental results show that CANOLA consistently outperforms SOTA label correction methods, achieving relative improvements ranging from 19% to 52% in error reduction. Moreover, models trained on datasets corrected by CANOLA obtain substantial downstream performance gains. Even simple classifiers trained on CANOLA's corrected data can outperform complex model-centric approaches by margins of up to 67%.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 74 references that are in the map. First posted on arXiv 10 Jun 2026.

Builds on

42 of 74 references.

References · 42

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  4. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  5. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  6. 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
  7. 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,059
  8. 2017A Closer Look at Memorization in Deep Networkscited by 942
  9. 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 797
  10. 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 692
  11. 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 690
  12. 2019Symmetric Cross Entropy for Robust Learning with Noisy Labelscited by 500
30 more
  1. 2019Unsupervised Label Noise Modeling and Loss Correctioncited by 328
  2. 2021A Survey on Deep Semi-supervised Learningcited by 251
  3. 2020MedMNIST Classification Decathlon: A Lightweight AutoML Benchmark for Medical Image Analysiscited by 206
  4. 2021Want To Reduce Labeling Cost? GPT-3 Can Helpcited by 196
  5. 2023Is ChatGPT better than Human Annotators? Potential and Limitations of ChatGPT in Explaining Implicit Hate Speechcited by 166
  6. 2017Deep Learning is Robust to Massive Label Noisecited by 165
  7. 2018Learning to Learn from Noisy Labeled Datacited by 160
  8. 2020Learning with Instance-Dependent Label Noise: A Sample Sieve Approachcited by 158
  9. 2017Asymmetric Tri-training for Unsupervised Domain Adaptationcited by 152
  10. 2019Deep Self-Learning From Noisy Labelscited by 122
  11. 2021Understanding and Improving Early Stopping for Learning with Noisy Labelscited by 113
  12. 2022Learning with Limited Annotations: A Survey on Deep Semi-Supervised Learning for Medical Image Segmentationcited by 76
  13. 2021Detecting Corrupted Labels Without Training a Model to Predictcited by 58
  14. 2023Testing the Reliability of ChatGPT for Text Annotation and Classification: A Cautionary Remarkcited by 54
  15. 2022Is one annotation enough? A data-centric image classification benchmark for noisy and ambiguous label estimationcited by 43
  16. 2023Unmasking and Improving Data Credibility: A Study with Datasets for Training Harmless Language Modelscited by 26
  17. 2022SELC: Self-Ensemble Label Correction Improves Learning with Noisy Labelscited by 24
  18. 2020NoiseRank: Unsupervised Label Noise Reduction with Dependence Modelscited by 20
  19. 2024CLIPCleaner: Cleaning Noisy Labels with CLIPcited by 16
  20. 2020Adaptive Rule Discovery for Labeling Text Datacited by 15
  21. 2025Data or Language Supervision: What Makes CLIP Better than DINO?cited by 14
  22. 2023Mitigating Label Noise through Data Ambiguationcited by 10
  23. 2024The ALCHEmist: Automated Labeling 500x CHEaper Than LLM Data Annotatorscited by 10
  24. 2024Learning Discriminative Dynamics with Label Corruption for Noisy Label Detectioncited by 9
  25. 2022Learning to Detect Noisy Labels Using Model-Based Featurescited by 6
  26. 2024APT-Pipe: A Prompt-Tuning Tool for Social Data Annotation using ChatGPTcited by 5
  27. 2020KNN-enhanced Deep Learning Against Noisy Labelscited by 4
  28. 2025Calibrating Pre-trained Language Classifiers on LLM-generated Noisy Labels via Iterative Refinementcited by 4
  29. 2025Efficient Adaptive Label Refinement for Label Noise Learningcited by 2
  30. 2023Asymmetric Co-teaching with Multi-view Consensus for Noisy Label Learningcited by 1

Built on by

Not cited yet.