General OOD Detection via Model-aware and Subspace-aware Variable Priority
Not on the map. Why?
Abstract (arXiv)
Out-of-distribution (OOD) detection is essential for determining when a supervised model encounters inputs that differ meaningfully from its training distribution. While widely studied in classification, OOD detection for regression and survival analysis remains limited due to the absence of discrete labels and the challenge of quantifying predictive uncertainty. We introduce a framework for OOD detection that is simultaneously model aware and subspace aware, and that embeds variable prioritization directly into the detection step. The method uses the fitted predictor to construct localized neighborhoods around each test case that emphasize the features driving the model's learned relationship and downweight directions that are less relevant to prediction. It produces OOD scores without relying on global distance metrics or estimating the full feature density. The framework is applicable across outcome types, and in our implementation we use random forests, where the rule structure yields transparent neighborhoods and effective scoring. Experiments on synthetic and real data benchmarks designed to isolate functional shifts show consistent improvements over existing methods. We further demonstrate the approach in an esophageal cancer survival study, where distribution shifts related to lymphadenectomy identify patterns relevant to surgical guidelines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 102 references that are in the map. First posted on arXiv 15 Dec 2025.
Builds on
42 of 102 references.
References · 42
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 596
- 2018Predictive Uncertainty Estimation via Prior Networkscited by 555
- 2015Deep Kernel Learningcited by 440
- 2019Deep Evidential Regressioncited by 354
30 more
- 2018Failing Loudly: An Empirical Study of Methods for Detecting Dataset Shiftcited by 240
- 2021A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challengescited by 154
- 2017PMLB: A Large Benchmark Suite for Machine Learning Evaluation and Comparisoncited by 139
- 2021Testing for Outliers with Conformal p-valuescited by 133
- 2021Causal Attention for Interpretable and Generalizable Graph Classificationcited by 108
- 2022POEM: Out-of-Distribution Detection with Posterior Samplingcited by 108
- 2022Out-Of-Distribution Generalization on Graphs: A Surveycited by 97
- 2021On Feature Collapse and Deep Kernel Learning for Single Forward Pass Uncertaintycited by 87
- 2021OOD-GNN: Out-of-Distribution Generalized Graph Neural Networkcited by 78
- 2023Understanding the Feature Norm for Out-of-Distribution Detectioncited by 25
- 2024Kernel PCA for Out-of-Distribution Detectioncited by 24
- 2024Out-of-Distribution Detection: A Task-Oriented Survey of Recent Advancescited by 24
- 2022Integrative conformal p-values for powerful out-of-distribution testing with labeled outlierscited by 19
- 2024A Survey of Deep Graph Learning under Distribution Shifts: from Graph Out-of-Distribution Generalization to Adaptationcited by 16
- 2021Out-of-Distribution Detection for Medical Applications: Guidelines for Practical Evaluationcited by 15
- 2023Individual and Structural Graph Information Bottlenecks for Out-of-Distribution Generalizationcited by 15
- 2025Out-of-Distribution Generalization in Time Series: A Surveycited by 15
- 2025Handling Out-of-Distribution Data: A Surveycited by 14
- 2023OOD-CV-v2: An extended Benchmark for Robustness to Out-of-Distribution Shifts of Individual Nuisances in Natural Imagescited by 12
- 2023Unmasking the Chameleons: A Benchmark for Out-of-Distribution Detection in Medical Tabular Datacited by 8
- 2024Out-of-Distribution Detection Should Use Conformal Prediction (and Vice-versa?)cited by 7
- 2023Low-Dimensional Gradient Helps Out-of-Distribution Detectioncited by 6
- 2024Margin-bounded Confidence Scores for Out-of-Distribution Detectioncited by 4
- 2023Out of Distribution Detection via Domain-Informed Gaussian Process State Space Modelscited by 3
- 2024Model-independent variable selection via the rule-based variable prioritycited by 2
- 2025Activation Subspaces for Out-of-Distribution Detectioncited by 2
- 2020Out-of-distribution detection for regression tasks: parameter versus predictor entropycited by 1
- 2022Distributional Gaussian Processes Layers for Out-of-Distribution Detectioncited by 1
- 2024Out-of-distribution detection based on subspace projection of high-dimensional features output by the last convolutional layercited by 1
- 2024Out-of-distribution Reject Option Method for Dataset Shift Problem in Early Disease Onset Predictioncited by 1
Built on by
Not cited yet.