mlsanityData to 14 Oct 2026

Ranked Activation Shift for Post-Hoc Out-of-Distribution Detection

arXiv 2604.08572 ↗First posted 27 Mar 2026cs.LG cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

State-of-the-art post-hoc out-of-distribution detection methods rely on intermediate layer activation editing. However, they exhibit inconsistent performance across datasets and models. We show that this instability is driven by differences in the activation distributions, and identify a failure mode of scaling-based methods that arises when penultimate layer activations are not rectified. Motivated by this analysis, we propose RAS, a hyperparameter-free post-hoc method that replaces sorted activation magnitudes with a fixed in-distribution reference profile. Our simple plug-and-play method shows strong and consistent performance across datasets and architectures without assumptions on the penultimate layer activation function, and without requiring any hyperparameter tuning, while empirically preserving in-distribution classification accuracy. We further analyze what drives the improvement, showing that both inhibiting and exciting activation shifts independently contribute to better out-of-distribution discrimination.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 52 references that are in the map. First posted on arXiv 27 Mar 2026.

Builds on

39 of 52 references.

References · 39

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  5. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  6. 2022A ConvNet for the 2020scited by 3,579
  7. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
  8. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  9. 2013Describing Textures in the Wildcited by 2,125
  10. 2016Concrete Problems in AI Safetycited by 1,642
  11. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
  12. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
27 more
  1. 2020Energy-based Out-of-distribution Detectioncited by 1,299
  2. 2020Designing Network Design Spacescited by 960
  3. 2021CvT: Introducing Convolutions to Vision Transformerscited by 947
  4. 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
  5. 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 600
  6. 2015Towards Open Set Deep Networkscited by 538
  7. 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
  8. 2019Scaling Out-of-Distribution Detection for Real-World Settingscited by 465
  9. 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 405
  10. 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 339
  11. 2022Extremely Simple Activation Shaping for Out-of-Distribution Detectioncited by 212
  12. 2021A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detectioncited by 207
  13. 2023OpenOOD v1.5: Enhanced Benchmark for Out-of-Distribution Detectioncited by 179
  14. 2021DICE: Leveraging Sparsification for Out-of-Distribution Detectioncited by 166
  15. 2023In or Out? Fixing ImageNet Out-of-Distribution Detection Evaluationcited by 134
  16. 2023Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancementcited by 77
  17. 2022Full-Spectrum Out-of-Distribution Detectioncited by 63
  18. 2022RankFeat: Rank-1 Feature Removal for Out-of-distribution Detectioncited by 52
  19. 2024Generalized Out-of-Distribution Detection and Beyond in Vision Language Model Era: A Surveycited by 36
  20. 2025Mahalanobis++: Improving OOD Detection via Feature Normalizationcited by 32
  21. 2024Out-of-distribution Detection in Medical Image Analysis: A surveycited by 22
  22. 2024What Variables Affect Out-of-Distribution Generalization in Pretrained Models?cited by 13
  23. 2023Gaussian Latent Representations for Uncertainty Estimation using Mahalanobis Distance in Deep Classifierscited by 10
  24. 2025AdaSCALE: Adaptive Scaling for OOD Detectioncited by 7
  25. 2025Mysteries of the Deep: Role of Intermediate Representations in Out of Distribution Detectioncited by 7
  26. 2025Leveraging Intermediate Representations for Better Out-of-Distribution Detectioncited by 5
  27. 2023Comparative Evaluation of Anomaly Detection Methods for Fraud Detection in Online Credit Card Paymentscited by 4

Built on by

Not cited yet.