mlsanityData to 7 Oct 2026

Breaking Semantic Hegemony: Decoupling Principal and Residual Subspaces for Generalized OOD Detection

arXiv 2602.05360 ↗First posted 5 Feb 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

While feature-based post-hoc methods have made significant strides in Out-of-Distribution (OOD) detection, we uncover a counter-intuitive Simplicity Paradox in existing state-of-the-art (SOTA) models: these models exhibit keen sensitivity in distinguishing semantically subtle OOD samples but suffer from severe Geometric Blindness when confronting structurally distinct yet semantically simple samples or high-frequency sensor noise. We attribute this phenomenon to Semantic Hegemony within the deep feature space and reveal its mathematical essence through the lens of Neural Collapse. Theoretical analysis demonstrates that the spectral concentration bias, induced by the high variance of the principal subspace, numerically masks the structural distribution shift signals that should be significant in the residual subspace. To address this issue, we propose D-KNN, a training-free, plug-and-play geometric decoupling framework. This method utilizes orthogonal decomposition to explicitly separate semantic components from structural residuals and introduces a dual-space calibration mechanism to reactivate the model's sensitivity to weak residual signals. Extensive experiments demonstrate that D-KNN effectively breaks Semantic Hegemony, establishing new SOTA performance on both CIFAR and ImageNet benchmarks. Notably, in resolving the Simplicity Paradox, it reduces the FPR95 from 31.3% to 2.3%; when addressing sensor failures such as Gaussian noise, it boosts the detection performance (AUROC) from a baseline of 79.7% to 94.9%.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 40 references that are in the map. First posted on arXiv 5 Feb 2026.

Builds on

28 of 40 references.

References · 28

  1. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
  2. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
  3. 2013Describing Textures in the Wildcited by 2,110
  4. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
  5. 2019Natural Adversarial Examplescited by 1,401
  6. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  7. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
  8. 2020Energy-based Out-of-distribution Detectioncited by 1,296
  9. 2018Deep Anomaly Detection with Outlier Exposurecited by 939
  10. 2020Prevalence of Neural Collapse during the terminal phase of deep learning trainingcited by 713
  11. 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 596
  12. 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
16 more
  1. 2018Do Deep Generative Models Know What They Don't Know?cited by 443
  2. 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 404
  3. 2022OpenOOD: Benchmarking Generalized Out-of-Distribution Detectioncited by 267
  4. 2023On the Importance of Noise Scheduling for Diffusion Modelscited by 193
  5. 2020Contrastive Training for Improved Out-of-Distribution Detectioncited by 186
  6. 2015TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Trackingcited by 165
  7. 2021Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central Pathcited by 156
  8. 2023In or Out? Fixing ImageNet Out-of-Distribution Detection Evaluationcited by 132
  9. 2023Neural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class Incremental Learningcited by 112
  10. 2025A Survey of World Models for Autonomous Drivingcited by 60
  11. 2024A Comprehensive Survey of Foundation Models in Medicinecited by 56
  12. 2023Fast Decision Boundary based Out-of-Distribution Detectorcited by 48
  13. 2023LINe: Out-of-Distribution Detection by Leveraging Important Neuronscited by 34
  14. 2024Large Language Models for Anomaly and Out-of-Distribution Detection: A Surveycited by 24
  15. 2023WDiscOOD: Out-of-Distribution Detection via Whitened Linear Discriminant Analysiscited by 9
  16. 2025A Multi-dimensional Semantic Surprise Framework Based on Low-Entropy Semantic Manifolds for Fine-Grained Out-of-Distribution Detectioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.