Out-of-Distribution Object Detection in Street Scenes via Synthetic Outlier Exposure and Transfer Learning
Not on the map. Why?
Abstract (arXiv)
Out-of-distribution (OOD) objects are often silently overlooked by object detectors, which produce no detection for them, leaving downstream modules with nothing to act on and no indication that anything was missed. A reliable object detector must detect OOD objects by localizing and correctly classifying them as OOD. Existing approaches primarily focus on OOD detection for image classification or rely on auxiliary branches, and typically do not treat in-distribution (ID) and OOD objects in a unified manner. We present SynOE-OD, a Synthetic Outlier-Exposure-based Object Detection method, which uses text-guided inpainting and an open-vocabulary object detector to generate and verify synthetic outliers offline. These are then used to fine-tune an object detector of choice with an added OOD class, which requires no auxiliary branch at inference time. On the OoDIS benchmark, SynOE-OD outperforms the strongest open-vocabulary baseline, reaching AP_50:95 of 57.6%, 29.4% and 39.2% on RoadObstacle, RoadAnomaly and Fishyscapes, against 48.5%, 22.7% and 22.7%. This state-of-the-art performance holds for both fine-tuned closed-set and open-vocabulary detectors while maintaining competitive ID performance in street scenes.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 58 of its 71 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
58 of 71 references.
References · 58
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
38 more
- 2018Deep Anomaly Detection with Outlier Exposurecited by 942
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 600
- 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 453
- 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
- 2021Towards Open World Object Detectioncited by 297
- 2022Delving into Out-of-Distribution Detection with Vision-Language Representationscited by 216
- 2021Zero-Shot Out-of-Distribution Detection Based on the Pre-trained Model CLIPcited by 152
- 2021SegmentMeIfYouCan: A Benchmark for Anomaly Segmentationcited by 150
- 2020Entropy Maximization and Meta Classification for Out-Of-Distribution Detection in Semantic Segmentationcited by 133
- 2023CLIPN for Zero-Shot OOD Detection: Teaching CLIP to Say Nocited by 130
- 2021OW-DETR: Open-world Detection Transformercited by 129
- 2023Non-Parametric Outlier Synthesiscited by 129
- 2016Lost and Found: Detecting Small Road Hazards for Self-Driving Vehiclescited by 117
- 2021Pixel-wise Anomaly Detection in Complex Driving Scenescited by 109
- 2022Anomaly Detection in Autonomous Driving: A Surveycited by 87
- 2023Dream the Impossible: Outlier Imagination with Diffusion Modelscited by 77
- 2022Unknown-Aware Object Detection: Learning What You Don't Know from Videos in the Wildcited by 70
- 2021Mixture Outlier Exposure: Towards Out-of-Distribution Detection in Fine-grained Environmentscited by 66
- 2024Negative Label Guided OOD Detection with Pretrained Vision-Language Modelscited by 66
- 2022PROB: Probabilistic Objectness for Open World Object Detectioncited by 57
- 2022Residual Pattern Learning for Pixel-wise Out-of-Distribution Detection in Semantic Segmentationcited by 55
- 2019Simultaneous Semantic Segmentation and Outlier Detection in Presence of Domain Shiftcited by 54
- 2019Out-of-distribution Detection in Classifiers via Generationcited by 49
- 2023Unmasking Anomalies in Road-Scene Segmentationcited by 45
- 2022Domain Adaptive Object Detection for Autonomous Driving under Foggy Weathercited by 41
- 2024Generalized Out-of-Distribution Detection and Beyond in Vision Language Model Era: A Surveycited by 36
- 2022SAFE: Sensitivity-Aware Features for Out-of-Distribution Object Detectioncited by 33
- 2024Out-of-Distribution Detection: A Task-Oriented Survey of Recent Advancescited by 26
- 2023Reliability in Semantic Segmentation: Can We Use Synthetic Data?cited by 24
- 2023Unknown Sniffer for Object Detection: Don't Turn a Blind Eye to Unknown Objectscited by 23
- 2023Segment Every Out-of-Distribution Objectcited by 21
- 2020Detection and Retrieval of Out-of-Distribution Objects in Semantic Segmentationcited by 20
- 2023Strong but simple: A Baseline for Domain Generalized Dense Perception by CLIP-based Transfer Learningcited by 20
- 2022UQGAN: A Unified Model for Uncertainty Quantification of Deep Classifiers trained via Conditional GANscited by 16
- 2023UGainS: Uncertainty Guided Anomaly Instance Segmentationcited by 15
- 2024Self-Calibrated Tuning of Vision-Language Models for Out-of-Distribution Detectioncited by 15
- 2025Out-of-Distribution Segmentation in Autonomous Driving: Problems and State of the Artcited by 13
50 most cited of 58 All 58 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Detecting Out-of-Distribution Objects through Class-Conditioned Inpainting
- 2024Diffusion for Out-of-Distribution Detection on Road Scenes and Beyond
- 2025Recent Advances in Out-of-Distribution Detection with CLIP-Like Models: A Survey
- 2025Dream-Box: Object-wise Outlier Generation for Out-of-Distribution Detection
- 2025A Benchmark and Evaluation for Real-World Out-of-Distribution Detection Using Vision-Language Models
- 2026PWLR: Pairwise Witness Local Rejection for Boundary-Aware Out-of-Distribution Detection
- 2024Non-Linear Outlier Synthesis for Out-of-Distribution Detection
- 2024Exploiting Diffusion Prior for Out-of-Distribution Detection