A Survey on Deep Learning with Noisy Labels: How to train your model when you cannot trust on the annotations?
Not on the map. Why?
Abstract (arXiv)
Noisy Labels are commonly present in data sets automatically collected from the internet, mislabeled by non-specialist annotators, or even specialists in a challenging task, such as in the medical field. Although deep learning models have shown significant improvements in different domains, an open issue is their ability to memorize noisy labels during training, reducing their generalization potential. As deep learning models depend on correctly labeled data sets and label correctness is difficult to guarantee, it is crucial to consider the presence of noisy labels for deep learning training. Several approaches have been proposed in the literature to improve the training of deep learning models in the presence of noisy labels. This paper presents a survey on the main techniques in literature, in which we classify the algorithm in the following groups: robust losses, sample weighting, sample selection, meta-learning, and combined approaches. We also present the commonly used experimental setup, data sets, and results of the state-of-the-art models.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 9; 2023: 4; 2024: 4; 2025: 5; 2026: 1.
25 papers.
Sort:
- 2021Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarkscited by 388
- 2023A Survey on the Robustness of Computer Vision Models against Common Corruptionscited by 20
- 2023Mesogeos: A multi-purpose dataset for data-driven wildfire modeling in the Mediterraneancited by 18
- 2022Transfer and Marginalize: Explaining Away Label Noise with Privileged Informationcited by 15
- 2024Exploring the Robustness of In-Context Learning with Noisy Labelscited by 13
- 2024Noisy Label Processing for Classification: A Surveycited by 8
- 2022Compressing Features for Learning with Noisy Labelscited by 7
- 2022Optical Remote Sensing Image Understanding with Weak Supervision: Concepts, Methods, and Perspectivescited by 6
- 2025Probabilistic Machine Learning for Noisy Labels in Earth Observationcited by 6
- 2022A Survey of Dataset Refinement for Problems in Computer Vision Datasetscited by 5
- 2023Deep Active Learning in the Presence of Label Noise: A Surveycited by 5
- 2024Semi-Supervised Dialogue Abstractive Summarization via High-Quality Pseudolabel Selectioncited by 5
13 more
- 2023Differences Between Hard and Noisy-labeled Samples: An Empirical Studycited by 4
- 2024Improving Label Error Detection and Elimination with Uncertainty Quantificationcited by 4
- 2022A Study on the Impact of Data Augmentation for Training Convolutional Neural Networks in the Presence of Noisy Labelscited by 3
- 2022Pseudo-Label Noise Suppression Techniques for Semi-Supervised Semantic Segmentationcited by 3
- 2025Benchmarking Real-World Medical Image Classification with Noisy Labels: Challenges, Practice, and Outlookcited by 3
- 2021AI Total: Analyzing Security ML Models with Imperfect Data in Productioncited by 1
- 2022How to Find Actionable Static Analysis Warnings: A Case Study with FindBugscited by 1
- 2022Unsupervised Frequent Pattern Mining for CEPcited by 0
- 2022Active Learning Framework to Automate NetworkTraffic Classificationcited by 0
- 2025Balancing Accuracy, Calibration, and Efficiency in Active Learning with Vision Transformers Under Label Noisecited by 0
- 2025Ordinal Adaptive Correction: A Data-Centric Approach to Ordinal Image Classification with Noisy Labelscited by 0
- 2025A deep multiple instance learning approach based on coarse labels for high-resolution land-cover mappingcited by 0
- 2026The Gold in Bias: Maturing the AI Design Process through Verificationcited by 0
- 2026The Gold in Bias: Maturing the AI Design Process through Verification24 Sep 2026
- 2025Benchmarking Real-World Medical Image Classification with Noisy Labels: Challenges, Practice, and Outlook10 Dec 2025
- 2025A deep multiple instance learning approach based on coarse labels for high-resolution land-cover mapping8 Oct 2025
- 2025Ordinal Adaptive Correction: A Data-Centric Approach to Ordinal Image Classification with Noisy Labels2 Sep 2025
- 2025Balancing Accuracy, Calibration, and Efficiency in Active Learning with Vision Transformers Under Label Noise7 May 2025
- 2025Probabilistic Machine Learning for Noisy Labels in Earth Observation4 Apr 2025
- 2024Improving Label Error Detection and Elimination with Uncertainty Quantification15 May 2024
- 2024Exploring the Robustness of In-Context Learning with Noisy Labels28 Apr 2024
- 2024Noisy Label Processing for Classification: A Survey5 Apr 2024
- 2024Semi-Supervised Dialogue Abstractive Summarization via High-Quality Pseudolabel Selection6 Mar 2024
- 2023Differences Between Hard and Noisy-labeled Samples: An Empirical Study20 Jul 2023
- 2023Mesogeos: A multi-purpose dataset for data-driven wildfire modeling in the Mediterranean8 Jun 2023
13 more
- 2023A Survey on the Robustness of Computer Vision Models against Common Corruptions10 May 2023
- 2023Deep Active Learning in the Presence of Label Noise: A Survey22 Feb 2023
- 2022Active Learning Framework to Automate NetworkTraffic Classification26 Oct 2022
- 2022A Survey of Dataset Refinement for Problems in Computer Vision Datasets21 Oct 2022
- 2022Pseudo-Label Noise Suppression Techniques for Semi-Supervised Semantic Segmentation19 Oct 2022
- 2022A Study on the Impact of Data Augmentation for Training Convolutional Neural Networks in the Presence of Noisy Labels23 Aug 2022
- 2022Unsupervised Frequent Pattern Mining for CEP28 Jul 2022
- 2022Compressing Features for Learning with Noisy Labels27 Jun 2022
- 2022How to Find Actionable Static Analysis Warnings: A Case Study with FindBugs21 May 2022
- 2022Optical Remote Sensing Image Understanding with Weak Supervision: Concepts, Methods, and Perspectives18 Apr 2022
- 2022Transfer and Marginalize: Explaining Away Label Noise with Privileged Information18 Feb 2022
- 2021AI Total: Analyzing Security ML Models with Imperfect Data in Production13 Oct 2021
- 2021Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks26 Mar 2021
- 2021Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarkscited by 388
- 2023A Survey on the Robustness of Computer Vision Models against Common Corruptionscited by 20
- 2023Mesogeos: A multi-purpose dataset for data-driven wildfire modeling in the Mediterraneancited by 18
- 2022Transfer and Marginalize: Explaining Away Label Noise with Privileged Informationcited by 15
- 2024Exploring the Robustness of In-Context Learning with Noisy Labelscited by 13
- 2024Noisy Label Processing for Classification: A Surveycited by 8
- 2022Compressing Features for Learning with Noisy Labelscited by 7
- 2022Optical Remote Sensing Image Understanding with Weak Supervision: Concepts, Methods, and Perspectivescited by 6
- 2025Probabilistic Machine Learning for Noisy Labels in Earth Observationcited by 6
- 2022A Survey of Dataset Refinement for Problems in Computer Vision Datasetscited by 5
- 2023Deep Active Learning in the Presence of Label Noise: A Surveycited by 5
- 2024Semi-Supervised Dialogue Abstractive Summarization via High-Quality Pseudolabel Selectioncited by 5
12 most cited of 25 All 25 (JSON)
- 2026The Gold in Bias: Maturing the AI Design Process through Verification24 Sep 2026
- 2025Benchmarking Real-World Medical Image Classification with Noisy Labels: Challenges, Practice, and Outlook10 Dec 2025
- 2025A deep multiple instance learning approach based on coarse labels for high-resolution land-cover mapping8 Oct 2025
- 2025Ordinal Adaptive Correction: A Data-Centric Approach to Ordinal Image Classification with Noisy Labels2 Sep 2025
- 2025Balancing Accuracy, Calibration, and Efficiency in Active Learning with Vision Transformers Under Label Noise7 May 2025
- 2025Probabilistic Machine Learning for Noisy Labels in Earth Observation4 Apr 2025
- 2024Improving Label Error Detection and Elimination with Uncertainty Quantification15 May 2024
- 2024Exploring the Robustness of In-Context Learning with Noisy Labels28 Apr 2024
- 2024Noisy Label Processing for Classification: A Survey5 Apr 2024
- 2024Semi-Supervised Dialogue Abstractive Summarization via High-Quality Pseudolabel Selection6 Mar 2024
- 2023Differences Between Hard and Noisy-labeled Samples: An Empirical Study20 Jul 2023
- 2023Mesogeos: A multi-purpose dataset for data-driven wildfire modeling in the Mediterranean8 Jun 2023
12 newest of 25 All 25 (JSON)