Out-of-Distribution Detection with Relative Angles
Not on the map. Why?
Abstract (arXiv)
Deep learning systems deployed in real-world applications often encounter data that is different from their in-distribution (ID). A reliable model should ideally abstain from making decisions in this out-of-distribution (OOD) setting. Existing state-of-the-art methods primarily focus on feature distances, such as k-th nearest neighbors and distances to decision boundaries, either overlooking or ineffectively using in-distribution statistics. In this work, we propose a novel angle-based metric for OOD detection that is computed relative to the in-distribution structure. We demonstrate that the angles between feature representations and decision boundaries, viewed from the mean of in-distribution features, serve as an effective discriminative factor between ID and OOD data. We evaluate our method on nine ImageNet-pretrained models. Our approach achieves the lowest FPR in 5 out of 9 ImageNet models, obtains the best average FPR overall, and consistently ranking among the top 3 across all evaluated models. Furthermore, we highlight the benefits of contrastive representations by showing strong performance with ResNet SCL and CLIP architectures. Finally, we demonstrate that the scale-invariant nature of our score enables an ensemble strategy via simple score summation. Code is available at https://github.com/berkerdemirel/ORA-OOD-Detection-with-Relative-Angles.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 49 of its 64 references that are in the map. First posted on arXiv 6 Oct 2024.
Builds on
49 of 64 references.
References · 49
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2022A ConvNet for the 2020scited by 3,545
- 2020Supervised Contrastive Learningcited by 2,803
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
37 more
- 2013Describing Textures in the Wildcited by 2,110
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2018Deep Anomaly Detection with Outlier Exposurecited by 939
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
- 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 685
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 596
- 2018Predictive Uncertainty Estimation via Prior Networkscited by 555
- 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
- 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
- 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
- 2021Revisiting the Calibration of Modern Neural Networkscited by 387
- 2021Open-Set Recognition: a Good Closed-Set Classifier is All You Need?cited by 351
- 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 333
- 2021SSD: A Unified Framework for Self-Supervised Outlier Detectioncited by 264
- 2022Mitigating Neural Network Overconfidence with Logit Normalizationcited by 251
- 2021MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Spacecited by 233
- 2022Extremely Simple Activation Shaping for Out-of-Distribution Detectioncited by 212
- 2021A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detectioncited by 206
- 2022Relative representations enable zero-shot latent space communicationcited by 175
- 2015TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Trackingcited by 165
- 2023In or Out? Fixing ImageNet Out-of-Distribution Detection Evaluationcited by 132
- 2020Deep Learning for Medical Anomaly Detection -- A Surveycited by 127
- 2022POEM: Out-of-Distribution Detection with Posterior Samplingcited by 108
- 2022Anomaly Detection in Autonomous Driving: A Surveycited by 87
- 2023Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancementcited by 77
- 2019Towards neural networks that provably know when they don't knowcited by 69
- 2023Nearest Neighbor Guidance for Out-of-Distribution Detectioncited by 64
- 2023Fast Decision Boundary based Out-of-Distribution Detectorcited by 48
- 2018Discriminative out-of-distribution detection for semantic segmentationcited by 47
- 2023NECO: NEural Collapse Based Out-of-distribution detectioncited by 41
- 2023Detecting Out-of-Distribution Through the Lens of Neural Collapsecited by 33
- 2023A framework for benchmarking class-out-of-distribution detection and its application to ImageNetcited by 31
- 2024ConjNorm: Tractable Density Estimation for Out-of-Distribution Detectioncited by 22
- 2024Data-Efficient Contrastive Language-Image Pretraining: Prioritizing Data Quality over Quantitycited by 19
- 2023Data Distillation Can Be Like Vodka: Distilling More Times For Better Qualitycited by 17
- 2024Out-of-Distribution Detection via Deep Multi-Comprehension Ensemblecited by 8
Built on by
Citing papers per year: 2026: 2.
2 papers.