Unified Multi-Layer Subspace Modeling for Cross-Domain OOD Detection
Not on the map. Why?
Abstract (arXiv)
Out-of-Distribution (OOD) detection remains a fundamental challenge for neural networks, whose predictions can be overconfident on inputs that deviate from the training distribution. Most post-hoc OOD detection methods derive scores from a single representation level (eg., logits or penultimate features) or combine multiple layers via depth selection or OOD-calibrated weighting. However, because OOD shifts are diverse, the most informative representation level can vary strongly across OOD types and domains, making fixed-layer choices and OOD-calibrated aggregation brittle. In this paper, we propose PRISM (Projected Representation with Intermediate-layer Subspace Modeling), a model-agnostic post-hoc OOD detection method that models a unified multi-layer feature representation rather than aggregating independently scored layers. PRISM fuses intermediate and deep features into a single hierarchical embedding, estimates an in-distribution (ID) principal subspace, and then combines two complementary signals: (i) a class-conditional Mahalanobis distance in the projected subspace and (ii) the residual energy orthogonal to the learned manifold. This simple design avoids OOD-tuned layer weighting while capturing both in-subspace semantic deviations and off-subspace anomalies. Across diverse benchmarks spanning natural images, medical imaging, and industrial visual inspection, PRISM achieves consistent state-of-the-art cross-domain OOD detection performance with a single default configuration across all evaluated domains and architectures. We further show that PRISM incurs minimal inference overhead, making it practical for real-world deployment.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 54 of its 82 references that are in the map. First posted on arXiv 6 Sep 2026.
Builds on
54 of 82 references.
References · 54
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2022A ConvNet for the 2020scited by 3,579
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2013Describing Textures in the Wildcited by 2,125
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
38 more
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
- 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
- 2016Universal adversarial perturbationscited by 784
- 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 776
- 2021The Medical Segmentation Decathloncited by 628
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 600
- 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 589
- 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 518
- 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
- 2019Scaling Out-of-Distribution Detection for Real-World Settingscited by 465
- 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 405
- 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 373
- 2016EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videoscited by 367
- 2021Open-Set Recognition: a Good Closed-Set Classifier is All You Need?cited by 353
- 2018Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problemcited by 323
- 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 309
- 2021Unsolved Problems in ML Safetycited by 292
- 2022OpenOOD: Benchmarking Generalized Out-of-Distribution Detectioncited by 268
- 2021Escaping the Big Data Paradigm with Compact Transformerscited by 264
- 2022Extremely Simple Activation Shaping for Out-of-Distribution Detectioncited by 212
- 2021A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detectioncited by 207
- 2023OpenOOD v1.5: Enhanced Benchmark for Out-of-Distribution Detectioncited by 179
- 2021DICE: Leveraging Sparsification for Out-of-Distribution Detectioncited by 166
- 2019Automated brain extraction of multi-sequence MRI using artificial neural networkscited by 134
- 2023In or Out? Fixing ImageNet Out-of-Distribution Detection Evaluationcited by 134
- 2023Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancementcited by 77
- 2022X-Risk Analysis for AI Researchcited by 60
- 2023Fast Decision Boundary based Out-of-Distribution Detectorcited by 49
- 2021Neural Mean Discrepancy for Efficient Out-of-Distribution Detectioncited by 42
- 2018Comparative evaluation of instrument segmentation and tracking methods in minimally invasive surgerycited by 37
- 2023Detecting Out-of-Distribution Through the Lens of Neural Collapsecited by 34
- 2025Mahalanobis++: Improving OOD Detection via Feature Normalizationcited by 32
- 2022Block Selection Method for Using Feature Norm in Out-of-distribution Detectioncited by 30
- 2021A statistical framework for efficient out of distribution detection in deep neural networkscited by 28
- 2024Kernel PCA for Out-of-Distribution Detectioncited by 24
- 2022Detection of out-of-distribution samples using binary neuron activation patternscited by 15
- 2023On the use of Mahalanobis distance for out-of-distribution detection with neural networks for medical imagingcited by 15
50 most cited of 54 All 54 (JSON)
Built on by
Not cited yet.