mlsanityData to 14 Oct 2026

Tackling the Noisy Elephant in the Room: Label Noise-robust Out-of-Distribution Detection via Loss Correction and Low-rank Decomposition

arXiv 2509.06918 ↗First posted 8 Sep 2025cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Robust out-of-distribution (OOD) detection is an indispensable component of modern artificial intelligence (AI) systems, especially in safety-critical applications where models must identify inputs from unfamiliar classes not seen during training. While OOD detection has been extensively studied in the machine learning literature--with both post hoc and training-based approaches--its effectiveness under noisy training labels remains underexplored. Recent studies suggest that label noise can significantly degrade OOD performance, yet principled solutions to this issue are lacking. In this work, we demonstrate that directly combining existing label noise-robust methods with OOD detection strategies is insufficient to address this critical challenge. To overcome this, we propose a robust OOD detection framework that integrates loss correction techniques from the noisy label learning literature with low-rank and sparse decomposition methods from signal processing. Extensive experiments on both synthetic and real-world datasets demonstrate that our method significantly outperforms the state-of-the-art OOD detection techniques, particularly under severe noisy label settings.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 52 references that are in the map. First posted on arXiv 8 Sep 2025.

Builds on

40 of 52 references.

References · 40

  1. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  2. 2016Densely Connected Convolutional Networkscited by 6,720
  3. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  4. 2020Supervised Contrastive Learningcited by 2,829
  5. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  6. 2013Describing Textures in the Wildcited by 2,125
  7. 2016Understanding deep learning requires rethinking generalizationcited by 1,674
  8. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
  9. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
  10. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
  11. 2020Energy-based Out-of-distribution Detectioncited by 1,299
  12. 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,059
28 more
  1. 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 997
  2. 2017A Closer Look at Memorization in Deep Networkscited by 942
  3. 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
  4. 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 692
  5. 2016Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approachcited by 665
  6. 2017MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labelscited by 653
  7. 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 600
  8. 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 582
  9. 2017Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discoverycited by 566
  10. 2019Symmetric Cross Entropy for Robust Learning with Noisy Labelscited by 500
  11. 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
  12. 2019Scaling Out-of-Distribution Detection for Real-World Settingscited by 465
  13. 2019How does Disagreement Help Generalization against Label Corruption?cited by 390
  14. 2021SSD: A Unified Framework for Self-Supervised Outlier Detectioncited by 264
  15. 2021Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotationscited by 256
  16. 2021DICE: Leveraging Sparsification for Out-of-Distribution Detectioncited by 166
  17. 2019SELF: Learning to Filter Noisy Labels with Self-Ensemblingcited by 164
  18. 2019Learning From Noisy Labels By Regularized Estimation Of Annotator Confusioncited by 127
  19. 2021Provably End-to-end Label-Noise Learning without Anchor Pointscited by 97
  20. 2019Curriculum Loss: Robust Learning and Generalization against Label Corruptioncited by 88
  21. 2016Places: An Image Database for Deep Scene Understandingcited by 76
  22. 2017Learning with Bounded Instance- and Label-dependent Label Noisecited by 57
  23. 2021Neural Mean Discrepancy for Efficient Out-of-Distribution Detectioncited by 42
  24. 2021Estimating Instance-dependent Bayes-label Transition Matrix using a Deep Neural Networkcited by 30
  25. 2023How to Overcome Curse-of-Dimensionality for Out-of-Distribution Detection?cited by 15
  26. 2024A noisy elephant in the room: Is your out-of-distribution detector robust to label noise?cited by 13
  27. 2023Deep Learning From Crowdsourced Labels: Coupled Cross-entropy Minimization, Identifiability, and Regularizationcited by 12
  28. 2015End-to-end Convolutional Network for Saliency Predictioncited by 5

Built on by

Not cited yet.