mlsanityData to 7 Oct 2026

Out-of-Distribution Detection with Relative Angles

arXiv 2410.04525 ↗First posted 6 Oct 2024cs.LG cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Deep learning systems deployed in real-world applications often encounter data that is different from their in-distribution (ID). A reliable model should ideally abstain from making decisions in this out-of-distribution (OOD) setting. Existing state-of-the-art methods primarily focus on feature distances, such as k-th nearest neighbors and distances to decision boundaries, either overlooking or ineffectively using in-distribution statistics. In this work, we propose a novel angle-based metric for OOD detection that is computed relative to the in-distribution structure. We demonstrate that the angles between feature representations and decision boundaries, viewed from the mean of in-distribution features, serve as an effective discriminative factor between ID and OOD data. We evaluate our method on nine ImageNet-pretrained models. Our approach achieves the lowest FPR in 5 out of 9 ImageNet models, obtains the best average FPR overall, and consistently ranking among the top 3 across all evaluated models. Furthermore, we highlight the benefits of contrastive representations by showing strong performance with ResNet SCL and CLIP architectures. Finally, we demonstrate that the scale-invariant nature of our score enables an ensemble strategy via simple score summation. Code is available at https://github.com/berkerdemirel/ORA-OOD-Detection-with-Relative-Angles.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 49 of its 64 references that are in the map. First posted on arXiv 6 Oct 2024.

Builds on

49 of 64 references.

References · 49

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2017On Calibration of Modern Neural Networkscited by 4,860
  7. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  8. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  9. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  10. 2022A ConvNet for the 2020scited by 3,545
  11. 2020Supervised Contrastive Learningcited by 2,803
  12. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
37 more
  1. 2013Describing Textures in the Wildcited by 2,110
  2. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
  3. 2020Energy-based Out-of-distribution Detectioncited by 1,296
  4. 2018Deep Anomaly Detection with Outlier Exposurecited by 939
  5. 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
  6. 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 685
  7. 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 596
  8. 2018Predictive Uncertainty Estimation via Prior Networkscited by 555
  9. 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
  10. 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
  11. 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
  12. 2021Revisiting the Calibration of Modern Neural Networkscited by 387
  13. 2021Open-Set Recognition: a Good Closed-Set Classifier is All You Need?cited by 351
  14. 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 333
  15. 2021SSD: A Unified Framework for Self-Supervised Outlier Detectioncited by 264
  16. 2022Mitigating Neural Network Overconfidence with Logit Normalizationcited by 251
  17. 2021MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Spacecited by 233
  18. 2022Extremely Simple Activation Shaping for Out-of-Distribution Detectioncited by 212
  19. 2021A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detectioncited by 206
  20. 2022Relative representations enable zero-shot latent space communicationcited by 175
  21. 2015TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Trackingcited by 165
  22. 2023In or Out? Fixing ImageNet Out-of-Distribution Detection Evaluationcited by 132
  23. 2020Deep Learning for Medical Anomaly Detection -- A Surveycited by 127
  24. 2022POEM: Out-of-Distribution Detection with Posterior Samplingcited by 108
  25. 2022Anomaly Detection in Autonomous Driving: A Surveycited by 87
  26. 2023Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancementcited by 77
  27. 2019Towards neural networks that provably know when they don't knowcited by 69
  28. 2023Nearest Neighbor Guidance for Out-of-Distribution Detectioncited by 64
  29. 2023Fast Decision Boundary based Out-of-Distribution Detectorcited by 48
  30. 2018Discriminative out-of-distribution detection for semantic segmentationcited by 47
  31. 2023NECO: NEural Collapse Based Out-of-distribution detectioncited by 41
  32. 2023Detecting Out-of-Distribution Through the Lens of Neural Collapsecited by 33
  33. 2023A framework for benchmarking class-out-of-distribution detection and its application to ImageNetcited by 31
  34. 2024ConjNorm: Tractable Density Estimation for Out-of-Distribution Detectioncited by 22
  35. 2024Data-Efficient Contrastive Language-Image Pretraining: Prioritizing Data Quality over Quantitycited by 19
  36. 2023Data Distillation Can Be Like Vodka: Distilling More Times For Better Qualitycited by 17
  37. 2024Out-of-Distribution Detection via Deep Multi-Comprehension Ensemblecited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.