Ranked Activation Shift for Post-Hoc Out-of-Distribution Detection
Not on the map. Why?
Abstract (arXiv)
State-of-the-art post-hoc out-of-distribution detection methods rely on intermediate layer activation editing. However, they exhibit inconsistent performance across datasets and models. We show that this instability is driven by differences in the activation distributions, and identify a failure mode of scaling-based methods that arises when penultimate layer activations are not rectified. Motivated by this analysis, we propose RAS, a hyperparameter-free post-hoc method that replaces sorted activation magnitudes with a fixed in-distribution reference profile. Our simple plug-and-play method shows strong and consistent performance across datasets and architectures without assumptions on the penultimate layer activation function, and without requiring any hyperparameter tuning, while empirically preserving in-distribution classification accuracy. We further analyze what drives the improvement, showing that both inhibiting and exciting activation shifts independently contribute to better out-of-distribution discrimination.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 52 references that are in the map. First posted on arXiv 27 Mar 2026.
Builds on
39 of 52 references.
References · 39
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2022A ConvNet for the 2020scited by 3,579
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2013Describing Textures in the Wildcited by 2,125
- 2016Concrete Problems in AI Safetycited by 1,642
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
27 more
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
- 2020Designing Network Design Spacescited by 960
- 2021CvT: Introducing Convolutions to Vision Transformerscited by 947
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 600
- 2015Towards Open Set Deep Networkscited by 538
- 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
- 2019Scaling Out-of-Distribution Detection for Real-World Settingscited by 465
- 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 405
- 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 339
- 2022Extremely Simple Activation Shaping for Out-of-Distribution Detectioncited by 212
- 2021A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detectioncited by 207
- 2023OpenOOD v1.5: Enhanced Benchmark for Out-of-Distribution Detectioncited by 179
- 2021DICE: Leveraging Sparsification for Out-of-Distribution Detectioncited by 166
- 2023In or Out? Fixing ImageNet Out-of-Distribution Detection Evaluationcited by 134
- 2023Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancementcited by 77
- 2022Full-Spectrum Out-of-Distribution Detectioncited by 63
- 2022RankFeat: Rank-1 Feature Removal for Out-of-distribution Detectioncited by 52
- 2024Generalized Out-of-Distribution Detection and Beyond in Vision Language Model Era: A Surveycited by 36
- 2025Mahalanobis++: Improving OOD Detection via Feature Normalizationcited by 32
- 2024Out-of-distribution Detection in Medical Image Analysis: A surveycited by 22
- 2024What Variables Affect Out-of-Distribution Generalization in Pretrained Models?cited by 13
- 2023Gaussian Latent Representations for Uncertainty Estimation using Mahalanobis Distance in Deep Classifierscited by 10
- 2025AdaSCALE: Adaptive Scaling for OOD Detectioncited by 7
- 2025Mysteries of the Deep: Role of Intermediate Representations in Out of Distribution Detectioncited by 7
- 2025Leveraging Intermediate Representations for Better Out-of-Distribution Detectioncited by 5
- 2023Comparative Evaluation of Anomaly Detection Methods for Fraud Detection in Online Credit Card Paymentscited by 4
Built on by
Not cited yet.