On the Inherent Robustness of One-Stage Object Detection against Out-of-Distribution Data
Not on the map. Why?
Abstract (arXiv)
Robustness is a fundamental aspect for developing safe and trustworthy models, particularly when they are deployed in the open world. In this work we analyze the inherent capability of one-stage object detectors to robustly operate in the presence of out-of-distribution (OoD) data. Specifically, we propose a novel detection algorithm for detecting unknown objects in image data, which leverages the features extracted by the model from each sample. Differently from other recent approaches in the literature, our proposal does not require retraining the object detector, thereby allowing for the use of pretrained models. Our proposed OoD detector exploits the application of supervised dimensionality reduction techniques to mitigate the effects of the curse of dimensionality on the features extracted by the model. Furthermore, it utilizes high-resolution feature maps to identify potential unknown objects in an unsupervised fashion. Our experiments analyze the Pareto trade-off between the performance detecting known and unknown objects resulting from different algorithmic configurations and inference confidence thresholds. We also compare the performance of our proposed algorithm to that of logits-based post-hoc OoD methods, as well as possible fusion strategies. Finally, we discuss on the competitiveness of all tested methods against state-of-the-art OoD approaches for object detection models over the recently published Unknown Object Detection benchmark. The obtained results verify that the performance of avant-garde post-hoc OoD detectors can be further improved when combined with our proposed algorithm.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 54 references that are in the map. First posted on arXiv 7 Nov 2024.
Builds on
39 of 54 references.
References · 39
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2017Mask R-CNNcited by 7,259
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
27 more
- 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,018
- 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 613
- 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 612
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
- 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
- 2024YOLOv9: Learning What You Want to Learn Using Programmable Gradient Informationcited by 422
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
- 2018Dynamic Few-Shot Visual Learning without Forgettingcited by 385
- 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 338
- 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
- 2021Towards Open World Object Detectioncited by 297
- 2023Towards Open Vocabulary Learning: A Surveycited by 165
- 2018IDD: A Dataset for Exploring Problems of Autonomous Navigation in Unconstrained Environmentscited by 163
- 2021OW-DETR: Open-world Detection Transformercited by 129
- 2017Dropout Sampling for Robust Object Detection in Open-Set Conditionscited by 112
- 2023V3Det: Vast Vocabulary Visual Detection Datasetcited by 81
- 2022Unknown-Aware Object Detection: Learning What You Don't Know from Videos in the Wildcited by 70
- 2023Connecting the Dots in Trustworthy Artificial Intelligence: From AI Principles, Ethics, and Key Requirements to Responsible AI Systems and Regulationcited by 60
- 2022UC-OWOD: Unknown-Classified Open World Object Detectioncited by 40
- 2022SAFE: Sensitivity-Aware Features for Out-of-Distribution Object Detectioncited by 33
- 2022Revisiting Open World Object Detectioncited by 30
- 2024A Systematic Review on Long-Tailed Learningcited by 27
- 2023Random Boxes Are Open-world Object Detectorscited by 24
- 2023Unknown Sniffer for Object Detection: Don't Turn a Blind Eye to Unknown Objectscited by 23
- 2023Learning from Rich Semantics and Coarse Locations for Long-tailed Object Detectioncited by 11
- 2022YolOOD: Utilizing Object Detection Concepts for Multi-Label Out-of-Distribution Detectioncited by 7
Built on by
Not cited yet.