GROOD: GRadient-Aware Out-of-Distribution Detection
Not on the map. Why?
Abstract (arXiv)
Out-of-distribution (OOD) detection is crucial for ensuring the reliability of deep learning models in real-world applications. Existing methods typically focus on feature representations or output-space analysis, often assuming a distribution over these spaces or leveraging gradient norms with respect to model parameters. However, these approaches struggle to distinguish near-OOD samples and often require extensive hyper-parameter tuning, limiting their practicality.In this work, we propose GRadient-aware Out-Of-Distribution detection (GROOD), a method that derives an OOD prototype from synthetic samples and computes class prototypes directly from In-distribution (ID) training data. By analyzing the gradients of a nearest-class-prototype loss function concerning an artificial OOD prototype, our approach achieves a clear separation between in-distribution and OOD samples. Experimental evaluations demonstrate that gradients computed from the OOD prototype enhance the distinction between ID and OOD data, surpassing established baselines in robustness, particularly on ImageNet-1k. These findings highlight the potential of gradient-based methods and prototype-driven approaches in advancing OOD detection within deep neural networks.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 44 of its 61 references that are in the map. First posted on arXiv 22 Dec 2023.
Builds on
44 of 61 references.
References · 44
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,321
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,111
- 2017On Calibration of Modern Neural Networkscited by 4,902
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,430
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,360
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,862
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,371
- 2019Invariant Risk Minimizationcited by 1,842
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,475
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,327
- 2020Energy-based Out-of-distribution Detectioncited by 1,297
32 more
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,183
- 2016End to End Learning for Self-Driving Carscited by 1,002
- 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 774
- 2020Prevalence of Neural Collapse during the terminal phase of deep learning trainingcited by 716
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 598
- 2015Towards Open Set Deep Networkscited by 535
- 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
- 2019Scaling Out-of-Distribution Detection for Real-World Settingscited by 465
- 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
- 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 405
- 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 339
- 2018Learning Models with Uniform Performance via Distributionally Robust Optimizationcited by 335
- 2022OpenOOD: Benchmarking Generalized Out-of-Distribution Detectioncited by 268
- 2022Extremely Simple Activation Shaping for Out-of-Distribution Detectioncited by 212
- 2021A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detectioncited by 207
- 2023OpenOOD v1.5: Enhanced Benchmark for Out-of-Distribution Detectioncited by 179
- 2021DICE: Leveraging Sparsification for Out-of-Distribution Detectioncited by 166
- 2021OpenGAN: Open-Set Recognition via Open Data Generationcited by 135
- 2022Neural Collapse: A Review on Modelling Principles and Generalizationcited by 95
- 2021Heterogeneous Risk Minimizationcited by 90
- 2019Stable Learning via Sample Reweightingcited by 70
- 2020Gradients as a Measure of Uncertainty in Neural Networkscited by 55
- 2022RankFeat: Rank-1 Feature Removal for Out-of-distribution Detectioncited by 52
- 2020Feature Space Singularity for Out-of-Distribution Detectioncited by 49
- 2023Fast Decision Boundary based Out-of-Distribution Detectorcited by 48
- 2020A Boundary Based Out-of-Distribution Classifier for Generalized Zero-Shot Learningcited by 34
- 2023Detecting Out-of-Distribution Through the Lens of Neural Collapsecited by 33
- 2019P-ODN: Prototype based Open Deep Network for Open Set Recognitioncited by 28
- 2022How Useful are Gradients for OOD Detection Really?cited by 20
- 2022Gradient-Based Adversarial and Out-of-Distribution Detectioncited by 14
- 2023GAIA: Delving into Gradient-based Attribution Abnormality for Out-of-distribution Detectioncited by 12
- 2021Gradient-based Novelty Detection Boosted by Self-supervised Binary Classificationcited by 10
Built on by
Not cited yet.