mlsanityData to 7 Oct 2026

When Accuracy Is Not Enough: Uncertainty Collapse between Noisy Label Learning and Out-of-Distribution Detection

arXiv 2605.17795 ↗First posted 18 May 2026cs.LG cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Learning with noisy labels (LNL) is typically benchmarked by closed-set classification accuracy, yet deployment often requires classifiers to reject out-of-distribution (OOD) inputs. We present a learner-agnostic ACC-OOD benchmark that freezes LNL checkpoints and evaluates them with standardized near-/far-OOD routing and post-hoc scores across synthetic and real label noise. The benchmark reveals a recurring failure mode: high closed-set accuracy does not ensure OOD reliability, because low-confidence, misclassified in-distribution samples can overlap the score and feature regions occupied by OOD inputs under noisy training. We term this pathology uncertainty collapse. This structural overlap can make high-accuracy LNL methods lose separability at the ID-error/OOD interface under standard OOD scores. As an intervention, we study Virtual Margin Regularization (VMR), a lightweight repair probe demonstrated mainly with PSSCL that synthesizes boundary virtual outliers on trusted ID batches and widens the energy margin. VMR partially reduces the collapse-induced far-OOD failure without replacing the host objective or sacrificing closed-set accuracy in the tested settings. These results support LNL benchmarks that co-report closed-set generalization, open-world reliability, and structural overlap diagnostics.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 23 references that are in the map. First posted on arXiv 18 May 2026.

Builds on

21 of 23 references.

References · 21

  1. 2017On Calibration of Modern Neural Networkscited by 4,860
  2. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
  3. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
  4. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
  5. 2020Energy-based Out-of-distribution Detectioncited by 1,296
  6. 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,053
  7. 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 994
  8. 2017Selective Classification for Deep Neural Networkscited by 799
  9. 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 691
  10. 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 596
  11. 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 580
  12. 2015Towards Open Set Deep Networkscited by 533
9 more
  1. 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
  2. 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 404
  3. 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
  4. 2021Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotationscited by 253
  5. 2017CleanNet: Transfer Learning for Scalable Image Classifier Training with Label Noisecited by 181
  6. 2022UNICON: Combating Label Noise Through Uniform Selection and Contrastive Learningcited by 77
  7. 2024A noisy elephant in the room: Is your out-of-distribution detector robust to label noise?cited by 13
  8. 2024Accuracy on the wrong line: On the pitfalls of noisy data for out-of-distribution generalisationcited by 9
  9. 2023Unlocking the Power of Open Set : A New Perspective for Open-Set Noisy Label Learningcited by 8

Built on by

Not cited yet.