mlsanityData to 7 Oct 2026

On the Inherent Robustness of One-Stage Object Detection against Out-of-Distribution Data

arXiv 2411.04586 ↗First posted 7 Nov 2024cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Robustness is a fundamental aspect for developing safe and trustworthy models, particularly when they are deployed in the open world. In this work we analyze the inherent capability of one-stage object detectors to robustly operate in the presence of out-of-distribution (OoD) data. Specifically, we propose a novel detection algorithm for detecting unknown objects in image data, which leverages the features extracted by the model from each sample. Differently from other recent approaches in the literature, our proposal does not require retraining the object detector, thereby allowing for the use of pretrained models. Our proposed OoD detector exploits the application of supervised dimensionality reduction techniques to mitigate the effects of the curse of dimensionality on the features extracted by the model. Furthermore, it utilizes high-resolution feature maps to identify potential unknown objects in an unsupervised fashion. Our experiments analyze the Pareto trade-off between the performance detecting known and unknown objects resulting from different algorithmic configurations and inference confidence thresholds. We also compare the performance of our proposed algorithm to that of logits-based post-hoc OoD methods, as well as possible fusion strategies. Finally, we discuss on the competitiveness of all tested methods against state-of-the-art OoD approaches for object detection models over the recently published Unknown Object Detection benchmark. The obtained results verify that the performance of avant-garde post-hoc OoD detectors can be further improved when combined with our proposed algorithm.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 54 references that are in the map. First posted on arXiv 7 Nov 2024.

Builds on

39 of 54 references.

References · 39

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2020End-to-End Object Detection with Transformerscited by 7,384
  3. 2017Mask R-CNNcited by 7,259
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  5. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  6. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  7. 2015SSD: Single Shot MultiBox Detectorcited by 3,125
  8. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
  9. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
  10. 2020Energy-based Out-of-distribution Detectioncited by 1,296
  11. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
  12. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
27 more
  1. 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,018
  2. 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 613
  3. 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 612
  4. 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
  5. 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
  6. 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
  7. 2024YOLOv9: Learning What You Want to Learn Using Programmable Gradient Informationcited by 422
  8. 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
  9. 2018Dynamic Few-Shot Visual Learning without Forgettingcited by 385
  10. 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 338
  11. 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
  12. 2021Towards Open World Object Detectioncited by 297
  13. 2023Towards Open Vocabulary Learning: A Surveycited by 165
  14. 2018IDD: A Dataset for Exploring Problems of Autonomous Navigation in Unconstrained Environmentscited by 163
  15. 2021OW-DETR: Open-world Detection Transformercited by 129
  16. 2017Dropout Sampling for Robust Object Detection in Open-Set Conditionscited by 112
  17. 2023V3Det: Vast Vocabulary Visual Detection Datasetcited by 81
  18. 2022Unknown-Aware Object Detection: Learning What You Don't Know from Videos in the Wildcited by 70
  19. 2023Connecting the Dots in Trustworthy Artificial Intelligence: From AI Principles, Ethics, and Key Requirements to Responsible AI Systems and Regulationcited by 60
  20. 2022UC-OWOD: Unknown-Classified Open World Object Detectioncited by 40
  21. 2022SAFE: Sensitivity-Aware Features for Out-of-Distribution Object Detectioncited by 33
  22. 2022Revisiting Open World Object Detectioncited by 30
  23. 2024A Systematic Review on Long-Tailed Learningcited by 27
  24. 2023Random Boxes Are Open-world Object Detectorscited by 24
  25. 2023Unknown Sniffer for Object Detection: Don't Turn a Blind Eye to Unknown Objectscited by 23
  26. 2023Learning from Rich Semantics and Coarse Locations for Long-tailed Object Detectioncited by 11
  27. 2022YolOOD: Utilizing Object Detection Concepts for Multi-Label Out-of-Distribution Detectioncited by 7

Built on by

Not cited yet.