Noise-Aware Framework for Correcting Corrupted Labels
Not on the map. Why?
Abstract (arXiv)
High-quality labeled data is essential for training reliable ML/DL models. However, real-world datasets often contain a considerable proportion of corrupted labels, which can severely degrade model performance. To address this problem, we propose CANOLA, a novel framework for correcting corrupted labels through noise-aware learning and iterative label refinement. CANOLA explicitly estimates the underlying noise distribution of the dataset and incorporates this information into the training of a noise-aware Deep Neural Network. By incorporating noise characteristics during learning, CANOLA enables the model to down-weight unreliable supervision signals and focus on trustworthy patterns, thereby improving robustness and generalization. Label correction is performed via cautious, iterative soft label refinement, in which model predictions are blended with observed labels to prevent premature or erroneous updates. This progressive refinement allows the dataset to be repaired in a stable and controlled manner. We evaluate CANOLA on six widely used datasets under realistic noisy labeling scenarios. Experimental results show that CANOLA consistently outperforms SOTA label correction methods, achieving relative improvements ranging from 19% to 52% in error reduction. Moreover, models trained on datasets corrected by CANOLA obtain substantial downstream performance gains. Even simple classifiers trained on CANOLA's corrected data can outperform complex model-centric approaches by margins of up to 67%.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 74 references that are in the map. First posted on arXiv 10 Jun 2026.
Builds on
42 of 74 references.
References · 42
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
- 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,059
- 2017A Closer Look at Memorization in Deep Networkscited by 942
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 797
- 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 692
- 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 690
- 2019Symmetric Cross Entropy for Robust Learning with Noisy Labelscited by 500
30 more
- 2019Unsupervised Label Noise Modeling and Loss Correctioncited by 328
- 2021A Survey on Deep Semi-supervised Learningcited by 251
- 2020MedMNIST Classification Decathlon: A Lightweight AutoML Benchmark for Medical Image Analysiscited by 206
- 2021Want To Reduce Labeling Cost? GPT-3 Can Helpcited by 196
- 2023Is ChatGPT better than Human Annotators? Potential and Limitations of ChatGPT in Explaining Implicit Hate Speechcited by 166
- 2017Deep Learning is Robust to Massive Label Noisecited by 165
- 2018Learning to Learn from Noisy Labeled Datacited by 160
- 2020Learning with Instance-Dependent Label Noise: A Sample Sieve Approachcited by 158
- 2017Asymmetric Tri-training for Unsupervised Domain Adaptationcited by 152
- 2019Deep Self-Learning From Noisy Labelscited by 122
- 2021Understanding and Improving Early Stopping for Learning with Noisy Labelscited by 113
- 2022Learning with Limited Annotations: A Survey on Deep Semi-Supervised Learning for Medical Image Segmentationcited by 76
- 2021Detecting Corrupted Labels Without Training a Model to Predictcited by 58
- 2023Testing the Reliability of ChatGPT for Text Annotation and Classification: A Cautionary Remarkcited by 54
- 2022Is one annotation enough? A data-centric image classification benchmark for noisy and ambiguous label estimationcited by 43
- 2023Unmasking and Improving Data Credibility: A Study with Datasets for Training Harmless Language Modelscited by 26
- 2022SELC: Self-Ensemble Label Correction Improves Learning with Noisy Labelscited by 24
- 2020NoiseRank: Unsupervised Label Noise Reduction with Dependence Modelscited by 20
- 2024CLIPCleaner: Cleaning Noisy Labels with CLIPcited by 16
- 2020Adaptive Rule Discovery for Labeling Text Datacited by 15
- 2025Data or Language Supervision: What Makes CLIP Better than DINO?cited by 14
- 2023Mitigating Label Noise through Data Ambiguationcited by 10
- 2024The ALCHEmist: Automated Labeling 500x CHEaper Than LLM Data Annotatorscited by 10
- 2024Learning Discriminative Dynamics with Label Corruption for Noisy Label Detectioncited by 9
- 2022Learning to Detect Noisy Labels Using Model-Based Featurescited by 6
- 2024APT-Pipe: A Prompt-Tuning Tool for Social Data Annotation using ChatGPTcited by 5
- 2020KNN-enhanced Deep Learning Against Noisy Labelscited by 4
- 2025Calibrating Pre-trained Language Classifiers on LLM-generated Noisy Labels via Iterative Refinementcited by 4
- 2025Efficient Adaptive Label Refinement for Label Noise Learningcited by 2
- 2023Asymmetric Co-teaching with Multi-view Consensus for Noisy Label Learningcited by 1
Built on by
Not cited yet.