Segment-Level Road Obstacle Detection Using Visual Foundation Model Priors and Likelihood Ratios
Not on the map. Why?
Abstract (arXiv)
Detecting road obstacles is essential for autonomous vehicles to navigate dynamic and complex traffic environments safely. Current road obstacle detection methods typically assign a score to each pixel and apply a threshold to generate final predictions. However, selecting an appropriate threshold is challenging, and the per-pixel classification approach often leads to fragmented predictions with numerous false positives. In this work, we propose a novel method that leverages segment-level features from visual foundation models and likelihood ratios to predict road obstacles directly. By focusing on segments rather than individual pixels, our approach enhances detection accuracy, reduces false positives, and offers increased robustness to scene variability. We benchmark our approach against existing methods on the RoadObstacle and LostAndFound datasets, achieving state-of-the-art performance without needing a predefined threshold.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 42 of its 52 references that are in the map. First posted on arXiv 7 Dec 2024.
Builds on
42 of 52 references.
References · 42
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Segment Anythingcited by 8,234
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2018Deep Anomaly Detection with Outlier Exposurecited by 942
- 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 776
- 2021Towards Total Recall in Industrial Anomaly Detectioncited by 776
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 600
- 2019Neural Spline Flowscited by 596
30 more
- 2023Segment Everything Everywhere All at Oncecited by 548
- 2021DenseCLIP: Language-Guided Dense Prediction with Context-Aware Promptingcited by 532
- 2022GroupViT: Semantic Segmentation Emerges from Text Supervisioncited by 531
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentationcited by 400
- 2021Revisiting the Calibration of Modern Neural Networkscited by 390
- 2018To Trust Or Not To Trust A Classifiercited by 207
- 2020PANDA: Adapting Pretrained Features for Anomaly Detection and Segmentationcited by 175
- 2021SegmentMeIfYouCan: A Benchmark for Anomaly Segmentationcited by 150
- 2018Evaluating Bayesian Deep Learning Methods for Semantic Segmentationcited by 143
- 2022Open-Vocabulary Universal Image Segmentation with MaskCLIPcited by 132
- 2016Lost and Found: Detecting Small Road Hazards for Self-Driving Vehiclescited by 117
- 2021Pixel-wise Anomaly Detection in Complex Driving Scenescited by 109
- 2021Pixel-wise Energy-biased Abstention Learning for Anomaly Segmentation on Complex Urban Driving Scenescited by 83
- 2022RbA: Segmenting Unknown Regions Rejected by Allcited by 67
- 2023Unmasking Anomalies in Road-Scene Segmentationcited by 45
- 2023On Advantages of Mask-level Recognition for Outlier-aware Segmentationcited by 42
- 2023Maskomaly:Zero-Shot Mask Anomaly Segmentationcited by 34
- 2024Outlier detection by ensembling uncertainty with negative objectnesscited by 34
- 2019Emerging Convolutions for Generative Normalizing Flowscited by 31
- 2020Detecting Road Obstacles by Erasing Themcited by 29
- 2024PixOOD: Pixel-Level Out-of-Distribution Detectioncited by 20
- 2022Two Video Data Sets for Tracking and Retrieval of Out of Distribution Objectscited by 19
- 2022Far Away in the Deep Space: Dense Nearest-Neighbor-Based Out-of-Distribution Detectioncited by 15
- 2023UGainS: Uncertainty Guided Anomaly Instance Segmentationcited by 15
- 2022NVRadarNet: Real-Time Radar Obstacle and Free Space Detection for Autonomous Drivingcited by 13
- 2024A Likelihood Ratio-Based Approach to Segmenting Unknown Objectscited by 12
- 2021Dense Out-of-Distribution Detection by Robust Learning on Synthetic Negative Datacited by 10
- 2023Have We Ever Encountered This Before? Retrieving Out-of-Distribution Road Obstacles from Driving Scenescited by 9
- 2022Falsehoods that ML researchers believe about OOD detectioncited by 8
Built on by
Citing papers per year: 2025: 3.
3 papers.