SAFE: Sensitivity-Aware Features for Out-of-Distribution Object Detection
Not on the map. Why?
Abstract (arXiv)
We address the problem of out-of-distribution (OOD) detection for the task of object detection. We show that residual convolutional layers with batch normalisation produce Sensitivity-Aware FEatures (SAFE) that are consistently powerful for distinguishing in-distribution from out-of-distribution detections. We extract SAFE vectors for every detected object, and train a multilayer perceptron on the surrogate task of distinguishing adversarially perturbed from clean in-distribution examples. This circumvents the need for realistic OOD training data, computationally expensive generative models, or retraining of the base object detector. SAFE outperforms the state-of-the-art OOD object detectors on multiple benchmarks by large margins, e.g. reducing the FPR95 by an absolute 30.6% from 48.3% to 17.7% on the OpenImages dataset.
Key facts. Cited by 33 papers in the map (data through 14 Oct 2026). Builds on 59 of its 78 references that are in the map. First posted on arXiv 29 Aug 2022.
Builds on
59 of 78 references.
References · 59
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Mask R-CNNcited by 7,277
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
38 more
- 2016Concrete Problems in AI Safetycited by 1,642
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2020Designing Network Design Spacescited by 960
- 2018Deep Anomaly Detection with Outlier Exposurecited by 942
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 600
- 2015Towards Open Set Deep Networkscited by 538
- 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
- 2019Scaling Out-of-Distribution Detection for Real-World Settingscited by 465
- 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 453
- 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
- 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
- 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 405
- 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
- 2020Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awarenesscited by 389
- 2021Open-Set Recognition: a Good Closed-Set Classifier is All You Need?cited by 353
- 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 339
- 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
- 2021Towards Open World Object Detectioncited by 297
- 2021A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detectioncited by 207
- 2018Adversarially Learned One-Class Classifier for Novelty Detectioncited by 202
- 2019Understanding Adversarial Attacks on Deep Learning Based Medical Image Analysis Systemscited by 153
- 2021OW-DETR: Open-world Detection Transformercited by 129
- 2017Dropout Sampling for Robust Object Detection in Open-Set Conditionscited by 112
- 2019Unsupervised Out-of-Distribution Detection by Maximum Classifier Discrepancycited by 112
- 2018The Limits and Potentials of Deep Learning for Roboticscited by 104
- 2022Unknown-Aware Object Detection: Learning What You Don't Know from Videos in the Wildcited by 70
- 2021Improved OOD Generalization via Adversarial Training and Pre-trainingcited by 66
- 2019Simultaneous Semantic Segmentation and Outlier Detection in Presence of Domain Shiftcited by 54
- 2019Out-of-distribution Detection in Classifiers via Generationcited by 49
- 2020Feature Space Singularity for Out-of-Distribution Detectioncited by 49
- 2021Neural Mean Discrepancy for Efficient Out-of-Distribution Detectioncited by 42
- 2021Estimating and Evaluating Regression Predictive Uncertainty in Deep Object Detectorscited by 37
- 2020Multiscale Score Matching for Out-of-Distribution Detectioncited by 36
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2023: 3; 2024: 16; 2025: 8; 2026: 6.
33 papers.
Sort:
By area:
- 2023BatchNorm-based Weakly Supervised Video Anomaly Detectioncited by 22
- 2024Interpreting Object-level Foundation Models via Visual Precision Searchcited by 20
- 2024Revisiting Out-of-Distribution Detection in LiDAR-based 3D Object Detectioncited by 11
- 2024DiPEx: Dispersing Prompt Expansion for Class-Agnostic Object Detectioncited by 11
- 2024Can OOD Object Detectors Learn from Foundation Models?cited by 10
- 2024OoDIS: Anomaly Instance Segmentation and Detection Benchmarkcited by 8
- 2024On the Potential of Open-Vocabulary Models for Object Detection in Unusual Street Scenescited by 5
- 2024Towards Open-World Object-based Anomaly Detection via Self-Supervised Outlier Synthesiscited by 4
- 2024Proto-OOD: Enhancing OOD Object Detection with Prototype Feature Similaritycited by 4
- 2023Neuron Sensitivity Guided Test Case Selection for Deep Learning Testingcited by 3
- 2024Situation Monitor: Diversity-Driven Zero-Shot Out-of-Distribution Detection using Budding Ensemble Architecture for Object Detectioncited by 2
- 2024Large-Scale Evaluation of Open-Set Image Classification Techniquescited by 2
21 more
- 2024Deciphering the Definition of Adversarial Robustness for post-hoc OOD Detectorscited by 2
- 2024Edge Case Detection in Automated Driving: Methods, Challenges, and Future Directionscited by 2
- 2024Uncertainty Quantification in Detection Transformers: Object-Level Calibration and Image-Level Reliabilitycited by 2
- 2025Benchmarking Vision Foundation Models for Input Monitoring in Autonomous Drivingcited by 2
- 2025Revisiting Out-of-Distribution Detection in Real-time Object Detection: From Benchmark Pitfalls to a New Mitigation Paradigmcited by 2
- 2025Out-of-Distribution Detection for Safety Assurance of AI and Autonomous Systemscited by 2
- 2023Advancing Perception in Artificial Intelligence through Principles of Cognitive Sciencecited by 1
- 2024Detecting Out-of-Distribution Objects through Class-Conditioned Inpaintingcited by 1
- 2025Can We Challenge Open-Vocabulary Object Detectors with Generated Content in Street Scenes?cited by 1
- 2026PhaseWin: An Efficient Search Algorithm for Faithful Visual Attributioncited by 1
- 2024Resilience and Security of Deep Neural Networks Against Intentional and Unintentional Perturbations: Survey and Research Challengescited by 0
- 2024On the Inherent Robustness of One-Stage Object Detection against Out-of-Distribution Datacited by 0
- 2025VisTa: Visual-contextual and Text-augmented Zero-shot Object-level OOD Detectioncited by 0
- 2025FindMeIfYouCan: Bringing Open Set metrics to textitnear , textitfar and textitfarther Out-of-Distribution Object Detectioncited by 0
- 2025Detecting What Matters: A Novel Approach for Out-of-Distribution 3D Object Detection in Autonomous Vehiclescited by 0
- 2025Three-Way Open-Set Detection for Robust Autonomous Navigationcited by 0
- 2026ALOOD: Exploiting Language Representations for LiDAR-based Out-of-Distribution Object Detectioncited by 0
- 2026Out-of-Distribution Object Detection in Street Scenes via Synthetic Outlier Exposure and Transfer Learningcited by 0
- 2026Unifying Runtime Monitoring Approaches for Safety-Critical Machine Learning: Application to Vision-Based Landingcited by 0
- 2026NegAS: Negative Label Guided Attention and Scoring for Out-of-Distribution Object Detection with Vision-Language Modelscited by 0
- 2026SAM3-O2D2: Zero-Shot Object Out-of-Distribution Detection by Object Class Prompting of the SAM3-Image Modelcited by 0
- 2026SAM3-O2D2: Zero-Shot Object Out-of-Distribution Detection by Object Class Prompting of the SAM3-Image Model8 Sep 2026
- 2026NegAS: Negative Label Guided Attention and Scoring for Out-of-Distribution Object Detection with Vision-Language Models21 Jun 2026
- 2026PhaseWin: An Efficient Search Algorithm for Faithful Visual Attribution16 Jun 2026
- 2026Unifying Runtime Monitoring Approaches for Safety-Critical Machine Learning: Application to Vision-Based Landing29 Apr 2026
- 2026Out-of-Distribution Object Detection in Street Scenes via Synthetic Outlier Exposure and Transfer Learning17 Mar 2026
- 2026ALOOD: Exploiting Language Representations for LiDAR-based Out-of-Distribution Object Detection9 Mar 2026
- 2025Three-Way Open-Set Detection for Robust Autonomous Navigation19 Nov 2025
- 2025Out-of-Distribution Detection for Safety Assurance of AI and Autonomous Systems24 Oct 2025
- 2025Can We Challenge Open-Vocabulary Object Detectors with Generated Content in Street Scenes?30 Jun 2025
- 2025Detecting What Matters: A Novel Approach for Out-of-Distribution 3D Object Detection in Autonomous Vehicles29 Jun 2025
- 2025FindMeIfYouCan: Bringing Open Set metrics to textitnear , textitfar and textitfarther Out-of-Distribution Object Detection16 Jun 2025
- 2025VisTa: Visual-contextual and Text-augmented Zero-shot Object-level OOD Detection28 Mar 2025
21 more
- 2025Revisiting Out-of-Distribution Detection in Real-time Object Detection: From Benchmark Pitfalls to a New Mitigation Paradigm10 Mar 2025
- 2025Benchmarking Vision Foundation Models for Input Monitoring in Autonomous Driving14 Jan 2025
- 2024Uncertainty Quantification in Detection Transformers: Object-Level Calibration and Image-Level Reliability2 Dec 2024
- 2024Interpreting Object-level Foundation Models via Visual Precision Search25 Nov 2024
- 2024On the Inherent Robustness of One-Stage Object Detection against Out-of-Distribution Data7 Nov 2024
- 2024Edge Case Detection in Automated Driving: Methods, Challenges, and Future Directions11 Oct 2024
- 2024Proto-OOD: Enhancing OOD Object Detection with Prototype Feature Similarity9 Sep 2024
- 2024Can OOD Object Detectors Learn from Foundation Models?8 Sep 2024
- 2024On the Potential of Open-Vocabulary Models for Object Detection in Unusual Street Scenes20 Aug 2024
- 2024Resilience and Security of Deep Neural Networks Against Intentional and Unintentional Perturbations: Survey and Research Challenges31 Jul 2024
- 2024Towards Open-World Object-based Anomaly Detection via Self-Supervised Outlier Synthesis22 Jul 2024
- 2024Deciphering the Definition of Adversarial Robustness for post-hoc OOD Detectors21 Jun 2024
- 2024DiPEx: Dispersing Prompt Expansion for Class-Agnostic Object Detection21 Jun 2024
- 2024OoDIS: Anomaly Instance Segmentation and Detection Benchmark17 Jun 2024
- 2024Large-Scale Evaluation of Open-Set Image Classification Techniques13 Jun 2024
- 2024Situation Monitor: Diversity-Driven Zero-Shot Out-of-Distribution Detection using Budding Ensemble Architecture for Object Detection5 Jun 2024
- 2024Revisiting Out-of-Distribution Detection in LiDAR-based 3D Object Detection24 Apr 2024
- 2024Detecting Out-of-Distribution Objects through Class-Conditioned Inpainting5 Feb 2024
- 2023BatchNorm-based Weakly Supervised Video Anomaly Detection26 Nov 2023
- 2023Advancing Perception in Artificial Intelligence through Principles of Cognitive Science13 Oct 2023
- 2023Neuron Sensitivity Guided Test Case Selection for Deep Learning Testing20 Jul 2023
- 2023BatchNorm-based Weakly Supervised Video Anomaly Detectioncited by 22
- 2024Interpreting Object-level Foundation Models via Visual Precision Searchcited by 20
- 2024Revisiting Out-of-Distribution Detection in LiDAR-based 3D Object Detectioncited by 11
- 2024DiPEx: Dispersing Prompt Expansion for Class-Agnostic Object Detectioncited by 11
- 2024Can OOD Object Detectors Learn from Foundation Models?cited by 10
- 2024OoDIS: Anomaly Instance Segmentation and Detection Benchmarkcited by 8
- 2024On the Potential of Open-Vocabulary Models for Object Detection in Unusual Street Scenescited by 5
- 2024Towards Open-World Object-based Anomaly Detection via Self-Supervised Outlier Synthesiscited by 4
- 2024Proto-OOD: Enhancing OOD Object Detection with Prototype Feature Similaritycited by 4
- 2023Neuron Sensitivity Guided Test Case Selection for Deep Learning Testingcited by 3
- 2024Situation Monitor: Diversity-Driven Zero-Shot Out-of-Distribution Detection using Budding Ensemble Architecture for Object Detectioncited by 2
- 2024Large-Scale Evaluation of Open-Set Image Classification Techniquescited by 2
12 most cited of 31 All 31 (JSON)
- 2026SAM3-O2D2: Zero-Shot Object Out-of-Distribution Detection by Object Class Prompting of the SAM3-Image Model8 Sep 2026
- 2026Unifying Runtime Monitoring Approaches for Safety-Critical Machine Learning: Application to Vision-Based Landing29 Apr 2026
- 2026Out-of-Distribution Object Detection in Street Scenes via Synthetic Outlier Exposure and Transfer Learning17 Mar 2026
- 2026ALOOD: Exploiting Language Representations for LiDAR-based Out-of-Distribution Object Detection9 Mar 2026
- 2025Three-Way Open-Set Detection for Robust Autonomous Navigation19 Nov 2025
- 2025Out-of-Distribution Detection for Safety Assurance of AI and Autonomous Systems24 Oct 2025
- 2025Can We Challenge Open-Vocabulary Object Detectors with Generated Content in Street Scenes?30 Jun 2025
- 2025Detecting What Matters: A Novel Approach for Out-of-Distribution 3D Object Detection in Autonomous Vehicles29 Jun 2025
- 2025FindMeIfYouCan: Bringing Open Set metrics to textitnear , textitfar and textitfarther Out-of-Distribution Object Detection16 Jun 2025
- 2025VisTa: Visual-contextual and Text-augmented Zero-shot Object-level OOD Detection28 Mar 2025
- 2025Revisiting Out-of-Distribution Detection in Real-time Object Detection: From Benchmark Pitfalls to a New Mitigation Paradigm10 Mar 2025
- 2025Benchmarking Vision Foundation Models for Input Monitoring in Autonomous Driving14 Jan 2025
12 newest of 31 All 31 (JSON)