Corner Cases for Visual Perception in Automated Driving: Some Guidance on Detection Approaches
Not on the map. Why?
Abstract (arXiv)
Automated driving has become a major topic of interest not only in the active research community but also in mainstream media reports. Visual perception of such intelligent vehicles has experienced large progress in the last decade thanks to advances in deep learning techniques but some challenges still remain. One such challenge is the detection of corner cases. They are unexpected and unknown situations that occur while driving. Conventional visual perception methods are often not able to detect them because corner cases have not been witnessed during training. Hence, their detection is highly safety-critical, and detection methods can be applied to vast amounts of collected data to select suitable training data. A reliable detection of corner cases will not only further automate the data selection procedure and increase safety in autonomous driving but can thereby also affect the public acceptance of the new technology in a positive manner. In this work, we continue a previous systematization of corner cases on different levels by an extended set of examples for each level. Moreover, we group detection approaches into different categories and link them with the corner case levels. Hence, we give directions to showcase specific corner cases and basic guidelines on how to technically detect them.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 33 of its 44 references that are in the map. First posted on arXiv 11 Feb 2021.
Builds on
33 of 44 references.
References · 33
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Mask R-CNNcited by 7,259
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
- 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 560
- 2015Towards Open Set Deep Networkscited by 533
21 more
- 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
- 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
- 2018Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problemcited by 323
- 2018Deep Anomaly Detection Using Geometric Transformationscited by 269
- 2016Learning Temporal Regularity in Video Sequencescited by 254
- 2018Learning Confidence for Out-of-Distribution Detection in Neural Networkscited by 245
- 2015Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understandingcited by 218
- 2018DF-Net: Unsupervised Joint Learning of Depth and Flow using Cross-Task Consistencycited by 148
- 2018Classification-Reconstruction Learning for Open-Set Recognitioncited by 146
- 2019C2AE: Class Conditioned Auto-Encoder for Open-set Recognitioncited by 142
- 2019Detecting the Unexpected via Image Resynthesiscited by 137
- 2016Lost and Found: Detecting Small Road Hazards for Self-Driving Vehiclescited by 117
- 2018Efficient Uncertainty Estimation for Semantic Segmentation in Videoscited by 46
- 2019Towards Corner Case Detection for Autonomous Drivingcited by 39
- 2020Uncertainty Estimation Using a Single Deep Deterministic Neural Networkcited by 37
- 2016Detecting Unexpected Obstacles for Self-Driving Cars: Fusing Deep Learning and Geometric Modelingcited by 28
- 2019Distance-Based Learning from Errors for Confidence Calibrationcited by 23
- 2018Detecting Regions of Maximal Divergence for Spatio-Temporal Anomaly Detectioncited by 18
- 2018Bayesian Semantic Instance Segmentation in Open Set Worldcited by 14
- 2018Group Anomaly Detection using Deep Generative Modelscited by 9
- 2020Self-Supervised Domain Mismatch Estimation for Autonomous Perceptioncited by 7
Built on by
Citing papers per year: 2021: 2; 2022: 2; 2023: 10; 2024: 4; 2025: 6; 2026: 3.
27 papers.
Sort:
By area:
- 2023Street-View Image Generation from a Bird's-Eye View Layoutcited by 102
- 2022CODA: A Real-World Road Corner Case Dataset for Object Detection in Autonomous Drivingcited by 100
- 2024Automated Evaluation of Large Vision-Language Models on Self-driving Corner Casescited by 75
- 2021An Application-Driven Conceptualization of Corner Cases for Perception in Highly Automated Drivingcited by 33
- 2023Milestones in Autonomous Driving and Intelligent Vehicles Part I: Control, Computing System Design, Communication, HD Map, Testing, and Human Behaviorscited by 25
- 2024AnoVox: A Benchmark for Multimodal Anomaly Detection in Autonomous Drivingcited by 14
- 2025SafeDriveRAG: Towards Safe Autonomous Driving with Knowledge Graph-based Retrieval-Augmented Generationcited by 14
- 20233D Data Augmentation for Driving Scenes on Cameracited by 12
- 2025HiBug2: Efficient and Interpretable Error Slice Discovery for Comprehensive Model Debuggingcited by 11
- 2023Survey on video anomaly detection in dynamic scenes with moving camerascited by 10
- 2023Deep Learning Safety Concerns in Automated Driving Perceptioncited by 10
- 2023Exploring the Potential of World Models for Anomaly Detection in Autonomous Drivingcited by 7
15 more
- 2022A-Eye: Driving with the Eyes of AI for Corner Case Generationcited by 5
- 2025ECCV 2024 W-CODA: 1st Workshop on Multimodal Perception and Comprehension of Corner Cases in Autonomous Drivingcited by 5
- 2021Does Redundancy in AI Perception Systems Help to Test for Super-Human Automated Driving Performance?cited by 4
- 2023CC-SGG: Corner Case Scenario Generation using Learned Scene Graphscited by 4
- 2025RALAD: Bridging the Real-to-Sim Domain Gap in Autonomous Driving with Retrieval-Augmented Learningcited by 2
- 2025Stereo-based 3D Anomaly Object Detection for Autonomous Driving: A New Dataset and Baselinecited by 2
- 2023Conditioning Latent-Space Clusters for Real-World Anomaly Classificationcited by 1
- 2024Outline of an Independent Systematic Blackbox Test for ML-based Systemscited by 1
- 2024Label-Free Model Failure Detection for Lidar-based Point Cloud Segmentationcited by 1
- 2023A Semi-Automated Corner Case Detection and Evaluation Pipelinecited by 0
- 2023survAIval: Survival Analysis with the Eyes of AIcited by 0
- 2025A Machine Learning Perspective on Automated Driving Corner Casescited by 0
- 2026NSF-HRPT: Neural Semantic Field meets Hierarchical Risk Perception Tree for Safety-Critical Scenario Assessmentcited by 0
- 2026Leveraging Visual and Geometric Priors for Metric-scale and Complete Vehicle Gaussian Reconstruction from Limited Viewscited by 0
- 2026Probabilistic Modelling of Operational Design Domains, A New Approach for Testing AI Systemscited by 0
- 2026Probabilistic Modelling of Operational Design Domains, A New Approach for Testing AI Systems21 Sep 2026
- 2026Leveraging Visual and Geometric Priors for Metric-scale and Complete Vehicle Gaussian Reconstruction from Limited Views8 Sep 2026
- 2026NSF-HRPT: Neural Semantic Field meets Hierarchical Risk Perception Tree for Safety-Critical Scenario Assessment5 Aug 2026
- 2025A Machine Learning Perspective on Automated Driving Corner Cases12 Oct 2025
- 2025SafeDriveRAG: Towards Safe Autonomous Driving with Knowledge Graph-based Retrieval-Augmented Generation29 Jul 2025
- 2025Stereo-based 3D Anomaly Object Detection for Autonomous Driving: A New Dataset and Baseline12 Jul 2025
- 2025ECCV 2024 W-CODA: 1st Workshop on Multimodal Perception and Comprehension of Corner Cases in Autonomous Driving2 Jul 2025
- 2025HiBug2: Efficient and Interpretable Error Slice Discovery for Comprehensive Model Debugging28 Jan 2025
- 2025RALAD: Bridging the Real-to-Sim Domain Gap in Autonomous Driving with Retrieval-Augmented Learning21 Jan 2025
- 2024Label-Free Model Failure Detection for Lidar-based Point Cloud Segmentation19 Jul 2024
- 2024AnoVox: A Benchmark for Multimodal Anomaly Detection in Autonomous Driving13 May 2024
- 2024Automated Evaluation of Large Vision-Language Models on Self-driving Corner Cases16 Apr 2024
15 more
- 2024Outline of an Independent Systematic Blackbox Test for ML-based Systems30 Jan 2024
- 2023CC-SGG: Corner Case Scenario Generation using Learned Scene Graphs18 Sep 2023
- 2023Conditioning Latent-Space Clusters for Real-World Anomaly Classification18 Sep 2023
- 2023Deep Learning Safety Concerns in Automated Driving Perception7 Sep 2023
- 2023Survey on video anomaly detection in dynamic scenes with moving cameras14 Aug 2023
- 2023Exploring the Potential of World Models for Anomaly Detection in Autonomous Driving10 Aug 2023
- 2023A Semi-Automated Corner Case Detection and Evaluation Pipeline25 May 2023
- 2023survAIval: Survival Analysis with the Eyes of AI23 May 2023
- 2023Milestones in Autonomous Driving and Intelligent Vehicles Part I: Control, Computing System Design, Communication, HD Map, Testing, and Human Behaviors12 May 2023
- 20233D Data Augmentation for Driving Scenes on Camera18 Mar 2023
- 2023Street-View Image Generation from a Bird's-Eye View Layout11 Jan 2023
- 2022CODA: A Real-World Road Corner Case Dataset for Object Detection in Autonomous Driving15 Mar 2022
- 2022A-Eye: Driving with the Eyes of AI for Corner Case Generation22 Feb 2022
- 2021Does Redundancy in AI Perception Systems Help to Test for Super-Human Automated Driving Performance?9 Dec 2021
- 2021An Application-Driven Conceptualization of Corner Cases for Perception in Highly Automated Driving5 Mar 2021
- 2023Street-View Image Generation from a Bird's-Eye View Layoutcited by 102
- 2022CODA: A Real-World Road Corner Case Dataset for Object Detection in Autonomous Drivingcited by 100
- 2021An Application-Driven Conceptualization of Corner Cases for Perception in Highly Automated Drivingcited by 33
- 2023Milestones in Autonomous Driving and Intelligent Vehicles Part I: Control, Computing System Design, Communication, HD Map, Testing, and Human Behaviorscited by 25
- 2024AnoVox: A Benchmark for Multimodal Anomaly Detection in Autonomous Drivingcited by 14
- 20233D Data Augmentation for Driving Scenes on Cameracited by 12
- 2025HiBug2: Efficient and Interpretable Error Slice Discovery for Comprehensive Model Debuggingcited by 11
- 2023Survey on video anomaly detection in dynamic scenes with moving camerascited by 10
- 2023Deep Learning Safety Concerns in Automated Driving Perceptioncited by 10
- 2022A-Eye: Driving with the Eyes of AI for Corner Case Generationcited by 5
- 2025ECCV 2024 W-CODA: 1st Workshop on Multimodal Perception and Comprehension of Corner Cases in Autonomous Drivingcited by 5
- 2021Does Redundancy in AI Perception Systems Help to Test for Super-Human Automated Driving Performance?cited by 4
12 most cited of 24 All 24 (JSON)
- 2026Probabilistic Modelling of Operational Design Domains, A New Approach for Testing AI Systems21 Sep 2026
- 2026Leveraging Visual and Geometric Priors for Metric-scale and Complete Vehicle Gaussian Reconstruction from Limited Views8 Sep 2026
- 2026NSF-HRPT: Neural Semantic Field meets Hierarchical Risk Perception Tree for Safety-Critical Scenario Assessment5 Aug 2026
- 2025A Machine Learning Perspective on Automated Driving Corner Cases12 Oct 2025
- 2025Stereo-based 3D Anomaly Object Detection for Autonomous Driving: A New Dataset and Baseline12 Jul 2025
- 2025ECCV 2024 W-CODA: 1st Workshop on Multimodal Perception and Comprehension of Corner Cases in Autonomous Driving2 Jul 2025
- 2025HiBug2: Efficient and Interpretable Error Slice Discovery for Comprehensive Model Debugging28 Jan 2025
- 2025RALAD: Bridging the Real-to-Sim Domain Gap in Autonomous Driving with Retrieval-Augmented Learning21 Jan 2025
- 2024Label-Free Model Failure Detection for Lidar-based Point Cloud Segmentation19 Jul 2024
- 2024AnoVox: A Benchmark for Multimodal Anomaly Detection in Autonomous Driving13 May 2024
- 2024Outline of an Independent Systematic Blackbox Test for ML-based Systems30 Jan 2024
- 2023CC-SGG: Corner Case Scenario Generation using Learned Scene Graphs18 Sep 2023
12 newest of 24 All 24 (JSON)