mlsanityData to 14 Oct 2026

Unified Multi-Layer Subspace Modeling for Cross-Domain OOD Detection

arXiv 2609.06785 ↗First posted 6 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Out-of-Distribution (OOD) detection remains a fundamental challenge for neural networks, whose predictions can be overconfident on inputs that deviate from the training distribution. Most post-hoc OOD detection methods derive scores from a single representation level (eg., logits or penultimate features) or combine multiple layers via depth selection or OOD-calibrated weighting. However, because OOD shifts are diverse, the most informative representation level can vary strongly across OOD types and domains, making fixed-layer choices and OOD-calibrated aggregation brittle. In this paper, we propose PRISM (Projected Representation with Intermediate-layer Subspace Modeling), a model-agnostic post-hoc OOD detection method that models a unified multi-layer feature representation rather than aggregating independently scored layers. PRISM fuses intermediate and deep features into a single hierarchical embedding, estimates an in-distribution (ID) principal subspace, and then combines two complementary signals: (i) a class-conditional Mahalanobis distance in the projected subspace and (ii) the residual energy orthogonal to the learned manifold. This simple design avoids OOD-tuned layer weighting while capturing both in-subspace semantic deviations and off-subspace anomalies. Across diverse benchmarks spanning natural images, medical imaging, and industrial visual inspection, PRISM achieves consistent state-of-the-art cross-domain OOD detection performance with a single default configuration across all evaluated domains and architectures. We further show that PRISM incurs minimal inference overhead, making it practical for real-world deployment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 54 of its 82 references that are in the map. First posted on arXiv 6 Sep 2026.

Builds on

54 of 82 references.

References · 54

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  6. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  7. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  8. 2022A ConvNet for the 2020scited by 3,579
  9. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  10. 2013Describing Textures in the Wildcited by 2,125
  11. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
  12. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
38 more
  1. 2020Energy-based Out-of-distribution Detectioncited by 1,299
  2. 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
  3. 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
  4. 2016Universal adversarial perturbationscited by 784
  5. 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 776
  6. 2021The Medical Segmentation Decathloncited by 628
  7. 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 600
  8. 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 589
  9. 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 518
  10. 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
  11. 2019Scaling Out-of-Distribution Detection for Real-World Settingscited by 465
  12. 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 405
  13. 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 373
  14. 2016EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videoscited by 367
  15. 2021Open-Set Recognition: a Good Closed-Set Classifier is All You Need?cited by 353
  16. 2018Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problemcited by 323
  17. 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 309
  18. 2021Unsolved Problems in ML Safetycited by 292
  19. 2022OpenOOD: Benchmarking Generalized Out-of-Distribution Detectioncited by 268
  20. 2021Escaping the Big Data Paradigm with Compact Transformerscited by 264
  21. 2022Extremely Simple Activation Shaping for Out-of-Distribution Detectioncited by 212
  22. 2021A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detectioncited by 207
  23. 2023OpenOOD v1.5: Enhanced Benchmark for Out-of-Distribution Detectioncited by 179
  24. 2021DICE: Leveraging Sparsification for Out-of-Distribution Detectioncited by 166
  25. 2019Automated brain extraction of multi-sequence MRI using artificial neural networkscited by 134
  26. 2023In or Out? Fixing ImageNet Out-of-Distribution Detection Evaluationcited by 134
  27. 2023Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancementcited by 77
  28. 2022X-Risk Analysis for AI Researchcited by 60
  29. 2023Fast Decision Boundary based Out-of-Distribution Detectorcited by 49
  30. 2021Neural Mean Discrepancy for Efficient Out-of-Distribution Detectioncited by 42
  31. 2018Comparative evaluation of instrument segmentation and tracking methods in minimally invasive surgerycited by 37
  32. 2023Detecting Out-of-Distribution Through the Lens of Neural Collapsecited by 34
  33. 2025Mahalanobis++: Improving OOD Detection via Feature Normalizationcited by 32
  34. 2022Block Selection Method for Using Feature Norm in Out-of-distribution Detectioncited by 30
  35. 2021A statistical framework for efficient out of distribution detection in deep neural networkscited by 28
  36. 2024Kernel PCA for Out-of-Distribution Detectioncited by 24
  37. 2022Detection of out-of-distribution samples using binary neuron activation patternscited by 15
  38. 2023On the use of Mahalanobis distance for out-of-distribution detection with neural networks for medical imagingcited by 15

50 most cited of 54 All 54 (JSON)

Built on by

Not cited yet.