Catalyst: Out-of-Distribution Detection via Elastic Scaling
Not on the map. Why?
Abstract (arXiv)
Out-of-distribution (OOD) detection is critical for the safe deployment of deep neural networks. State-of-the-art post-hoc methods typically derive OOD scores from the output logits or penultimate feature vector obtained via global average pooling (GAP). We contend that this exclusive reliance on the logit or feature vector discards a rich, complementary signal: the raw channel-wise statistics of the pre-pooling feature map lost in GAP. In this paper, we introduce Catalyst, a post-hoc framework that exploits these under-explored signals. Catalyst computes an input-dependent scaling factor (γ) on-the-fly from these raw statistics (e.g., mean, standard deviation, and maximum activation). This γ is then fused with the existing baseline score, multiplicatively modulating it -- an textitelastic scaling -- to push the ID and OOD distributions further apart. We demonstrate Catalyst is a generalizable framework: it seamlessly integrates with logit-based methods (e.g., Energy, ReAct, SCALE) and also provides a significant boost to distance-based detectors like KNN. As a result, Catalyst achieves substantial and consistent performance gains, reducing the average False Positive Rate by 32.87 on CIFAR-10 (ResNet-18), 27.94% on CIFAR-100 (ResNet-18), and 22.25% on ImageNet (ResNet-50). Our results highlight the untapped potential of pre-pooling statistics and demonstrate that Catalyst is complementary to existing OOD detection approaches. Our code is available here: https://github.com/bingabid/Catalyst
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 61 of its 75 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
61 of 75 references.
References · 61
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2022A ConvNet for the 2020scited by 3,545
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2013Describing Textures in the Wildcited by 2,110
- 2016Density estimation using Real NVPcited by 2,029
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
38 more
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2016Pruning Filters for Efficient ConvNetscited by 1,129
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
- 2018Deep Anomaly Detection with Outlier Exposurecited by 939
- 2016Conditional Image Generation with PixelCNN Decoderscited by 859
- 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 774
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 703
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 596
- 2018Predictive Uncertainty Estimation via Prior Networkscited by 555
- 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 555
- 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
- 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 404
- 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
- 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 338
- 2018Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problemcited by 323
- 2021SSD: A Unified Framework for Self-Supervised Outlier Detectioncited by 264
- 2022Mitigating Neural Network Overconfidence with Logit Normalizationcited by 251
- 2021MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Spacecited by 233
- 2022Extremely Simple Activation Shaping for Out-of-Distribution Detectioncited by 212
- 2023OpenOOD v1.5: Enhanced Benchmark for Out-of-Distribution Detectioncited by 178
- 2021DICE: Leveraging Sparsification for Out-of-Distribution Detectioncited by 166
- 2020Can Autonomous Vehicles Identify, Recover From, and Adapt to Distribution Shifts?cited by 139
- 2022How to Exploit Hyperspherical Embeddings for Out-of-Distribution Detection?cited by 128
- 2022POEM: Out-of-Distribution Detection with Posterior Samplingcited by 108
- 2021Semantically Coherent Out-of-Distribution Detectioncited by 107
- 2019Reverse KL-Divergence Training of Prior Networks: Improved Uncertainty and Adversarial Robustnesscited by 104
- 2021Can multi-label classification networks know what they don't know?cited by 100
- 2021MOOD: Multi-level Out-of-distribution Detectioncited by 94
- 2022Training OOD Detectors in their Natural Habitatscited by 86
- 2021Provable Guarantees for Understanding Out-of-distribution Detectioncited by 78
- 2023Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancementcited by 77
- 2023Battle of the Backbones: A Large-Scale Comparison of Pretrained Models across Computer Vision Taskscited by 72
- 2022Unknown-Aware Object Detection: Learning What You Don't Know from Videos in the Wildcited by 70
- 2019Towards neural networks that provably know when they don't knowcited by 69
50 most cited of 61 All 61 (JSON)
Built on by
Not cited yet.