MahaVar: OOD Detection via Class-wise Mahalanobis Distance Variance under Neural Collapse
Not on the map. Why?
Abstract (arXiv)
Out-of-distribution (OOD) detection is a critical component for ensuring the reliability of deep neural networks in safety-critical applications. In this work, we present a key empirical observation: for in-distribution (ID) samples, class-wise Mahalanobis distances exhibit a pronounced sharp minimum structure, where the distance to the nearest class is small while distances to all other classes remain large, resulting in high variance across classes. In contrast, OOD samples tend to exhibit a less pronounced sharp minimum structure, producing comparatively lower variance across classes. We further provide a theoretical analysis grounding this observation in Neural Collapse geometry: under relaxed Neural Collapse assumptions on within-class compactness and inter-class separation, ID samples are shown to structurally exhibit high class-wise distance variance, offering a theoretical basis for its use as an OOD score. Motivated by this observation and its theoretical backing, we propose MahaVar, a simple and effective post-hoc OOD detector that augments the Mahalanobis distance with a class-wise distance variance term. Following the OpenOOD v1.5 benchmark protocol, MahaVar achieves state-of-the-art performance on CIFAR-100 and ImageNet, with consistent improvements in both AUROC and FPR@95 over existing Mahalanobis-based methods across all benchmarks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 30 of its 40 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
30 of 40 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2013Describing Textures in the Wildcited by 2,110
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
- 2020Prevalence of Neural Collapse during the terminal phase of deep learning trainingcited by 713
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 596
- 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
18 more
- 2019Scaling Out-of-Distribution Detection for Real-World Settingscited by 465
- 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 404
- 2021Open-Set Recognition: a Good Closed-Set Classifier is All You Need?cited by 351
- 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
- 2022Extremely Simple Activation Shaping for Out-of-Distribution Detectioncited by 212
- 2021A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detectioncited by 206
- 2023OpenOOD v1.5: Enhanced Benchmark for Out-of-Distribution Detectioncited by 178
- 2023In or Out? Fixing ImageNet Out-of-Distribution Detection Evaluationcited by 132
- 2023Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancementcited by 77
- 2023Nearest Neighbor Guidance for Out-of-Distribution Detectioncited by 64
- 2023Fast Decision Boundary based Out-of-Distribution Detectorcited by 48
- 2023NECO: NEural Collapse Based Out-of-distribution detectioncited by 41
- 2023Diversified Outlier Exposure for Out-of-Distribution Detection via Informative Extrapolationcited by 38
- 2023Detecting Out-of-Distribution Through the Lens of Neural Collapsecited by 33
- 2025Mahalanobis++: Improving OOD Detection via Feature Normalizationcited by 30
- 2024Out-of-distribution Detection in Medical Image Analysis: A surveycited by 22
- 2023VRA: Variational Rectified Activation for Out-of-distribution Detectioncited by 15
- 2025Out-of-Distribution Segmentation in Autonomous Driving: Problems and State of the Artcited by 13
Built on by
Citing papers per year: 2026: 1.
1 paper.