Tackling the Noisy Elephant in the Room: Label Noise-robust Out-of-Distribution Detection via Loss Correction and Low-rank Decomposition
Not on the map. Why?
Abstract (arXiv)
Robust out-of-distribution (OOD) detection is an indispensable component of modern artificial intelligence (AI) systems, especially in safety-critical applications where models must identify inputs from unfamiliar classes not seen during training. While OOD detection has been extensively studied in the machine learning literature--with both post hoc and training-based approaches--its effectiveness under noisy training labels remains underexplored. Recent studies suggest that label noise can significantly degrade OOD performance, yet principled solutions to this issue are lacking. In this work, we demonstrate that directly combining existing label noise-robust methods with OOD detection strategies is insufficient to address this critical challenge. To overcome this, we propose a robust OOD detection framework that integrates loss correction techniques from the noisy label learning literature with low-rank and sparse decomposition methods from signal processing. Extensive experiments on both synthetic and real-world datasets demonstrate that our method significantly outperforms the state-of-the-art OOD detection techniques, particularly under severe noisy label settings.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 52 references that are in the map. First posted on arXiv 8 Sep 2025.
Builds on
40 of 52 references.
References · 40
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2020Supervised Contrastive Learningcited by 2,829
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2013Describing Textures in the Wildcited by 2,125
- 2016Understanding deep learning requires rethinking generalizationcited by 1,674
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
- 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,059
28 more
- 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 997
- 2017A Closer Look at Memorization in Deep Networkscited by 942
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
- 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 692
- 2016Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approachcited by 665
- 2017MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labelscited by 653
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 600
- 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 582
- 2017Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discoverycited by 566
- 2019Symmetric Cross Entropy for Robust Learning with Noisy Labelscited by 500
- 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
- 2019Scaling Out-of-Distribution Detection for Real-World Settingscited by 465
- 2019How does Disagreement Help Generalization against Label Corruption?cited by 390
- 2021SSD: A Unified Framework for Self-Supervised Outlier Detectioncited by 264
- 2021Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotationscited by 256
- 2021DICE: Leveraging Sparsification for Out-of-Distribution Detectioncited by 166
- 2019SELF: Learning to Filter Noisy Labels with Self-Ensemblingcited by 164
- 2019Learning From Noisy Labels By Regularized Estimation Of Annotator Confusioncited by 127
- 2021Provably End-to-end Label-Noise Learning without Anchor Pointscited by 97
- 2019Curriculum Loss: Robust Learning and Generalization against Label Corruptioncited by 88
- 2016Places: An Image Database for Deep Scene Understandingcited by 76
- 2017Learning with Bounded Instance- and Label-dependent Label Noisecited by 57
- 2021Neural Mean Discrepancy for Efficient Out-of-Distribution Detectioncited by 42
- 2021Estimating Instance-dependent Bayes-label Transition Matrix using a Deep Neural Networkcited by 30
- 2023How to Overcome Curse-of-Dimensionality for Out-of-Distribution Detection?cited by 15
- 2024A noisy elephant in the room: Is your out-of-distribution detector robust to label noise?cited by 13
- 2023Deep Learning From Crowdsourced Labels: Coupled Cross-entropy Minimization, Identifiability, and Regularizationcited by 12
- 2015End-to-end Convolutional Network for Saliency Predictioncited by 5
Built on by
Not cited yet.