When Accuracy Is Not Enough: Uncertainty Collapse between Noisy Label Learning and Out-of-Distribution Detection
Not on the map. Why?
Abstract (arXiv)
Learning with noisy labels (LNL) is typically benchmarked by closed-set classification accuracy, yet deployment often requires classifiers to reject out-of-distribution (OOD) inputs. We present a learner-agnostic ACC-OOD benchmark that freezes LNL checkpoints and evaluates them with standardized near-/far-OOD routing and post-hoc scores across synthetic and real label noise. The benchmark reveals a recurring failure mode: high closed-set accuracy does not ensure OOD reliability, because low-confidence, misclassified in-distribution samples can overlap the score and feature regions occupied by OOD inputs under noisy training. We term this pathology uncertainty collapse. This structural overlap can make high-accuracy LNL methods lose separability at the ID-error/OOD interface under standard OOD scores. As an intervention, we study Virtual Margin Regularization (VMR), a lightweight repair probe demonstrated mainly with PSSCL that synthesizes boundary virtual outliers on trusted ID batches and widens the energy margin. VMR partially reduces the collapse-induced far-OOD failure without replacing the host objective or sacrificing closed-set accuracy in the tested settings. These results support LNL benchmarks that co-report closed-set generalization, open-world reliability, and structural overlap diagnostics.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 23 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
21 of 23 references.
References · 21
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,053
- 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 994
- 2017Selective Classification for Deep Neural Networkscited by 799
- 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 691
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 596
- 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 580
- 2015Towards Open Set Deep Networkscited by 533
9 more
- 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
- 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 404
- 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
- 2021Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotationscited by 253
- 2017CleanNet: Transfer Learning for Scalable Image Classifier Training with Label Noisecited by 181
- 2022UNICON: Combating Label Noise Through Uniform Selection and Contrastive Learningcited by 77
- 2024A noisy elephant in the room: Is your out-of-distribution detector robust to label noise?cited by 13
- 2024Accuracy on the wrong line: On the pitfalls of noisy data for out-of-distribution generalisationcited by 9
- 2023Unlocking the Power of Open Set : A New Perspective for Open-Set Noisy Label Learningcited by 8
Built on by
Not cited yet.