mlsanityData to 14 Oct 2026

Verdict Instability of OOD Scores under Reference Resampling

arXiv 2609.00691 ↗First posted 1 Sep 2026cs.LG stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Post-hoc out-of-distribution detectors are fitted on a finite reference set, so every score they produce is an estimate. If we had chosen a different set, some verdicts would have moved. We measure that movement by resampling the reference set and recording the bootstrap standard deviation of the score, which we call verdict instability. It admits a closed form with no fitted parameters. The instability of a verdict is the within-class dispersion of the assigned class along the query's direction, divided by the square root of that class's reference count. That count is what separates verdict instability from the geometry of the score distribution, and it is identifiable only under class imbalance. Instability grows with the local dispersion. Far-OOD queries lie along the low-variance directions of an anisotropic embedding, so every distance-based score we test assigns its highest values to the verdicts that are most reproducible. Only estimators of local dispersion carry the sign a practitioner expects. We give a rule that predicts this sign for any score from a single label-free correlation, and abstention driven by a wrong-signed score turns out worse than abstention at random on every dataset we test.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 40 references that are in the map. First posted on arXiv 1 Sep 2026.

Builds on

29 of 40 references.

References · 29

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  4. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  5. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  6. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  7. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  8. 2013Describing Textures in the Wildcited by 2,125
  9. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
  10. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
  11. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
  12. 2020Energy-based Out-of-distribution Detectioncited by 1,299
17 more
  1. 2017Selective Classification for Deep Neural Networkscited by 852
  2. 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
  3. 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 600
  4. 2019Scaling Out-of-Distribution Detection for Real-World Settingscited by 465
  5. 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 405
  6. 2021Exploring the Limits of Out-of-Distribution Detectioncited by 283
  7. 2018Characterizing Adversarial Subspaces Using Local Intrinsic Dimensionalitycited by 282
  8. 2022OpenOOD: Benchmarking Generalized Out-of-Distribution Detectioncited by 268
  9. 2021A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detectioncited by 207
  10. 2021Deep Deterministic Uncertainty: A Simple Baselinecited by 200
  11. 2015TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Trackingcited by 165
  12. 2023In or Out? Fixing ImageNet Out-of-Distribution Detection Evaluationcited by 134
  13. 2018Bias-Reduced Uncertainty Estimation for Deep Neural Classifierscited by 113
  14. 2022Is Out-of-Distribution Detection Learnable?cited by 109
  15. 2025Mahalanobis++: Improving OOD Detection via Feature Normalizationcited by 32
  16. 2020Know Your Limits: Uncertainty Estimation with ReLU Classifiers Fails at Reliable OOD Detectioncited by 26
  17. 2025A Geometry-Based View of Mahalanobis OOD Detectioncited by 4

Built on by

Not cited yet.