OCCUQ: Exploring Efficient Uncertainty Quantification for 3D Occupancy Prediction
Not on the map. Why?
Abstract (arXiv)
Autonomous driving has the potential to significantly enhance productivity and provide numerous societal benefits. Ensuring robustness in these safety-critical systems is essential, particularly when vehicles must navigate adverse weather conditions and sensor corruptions that may not have been encountered during training. Current methods often overlook uncertainties arising from adversarial conditions or distributional shifts, limiting their real-world applicability. We propose an efficient adaptation of an uncertainty estimation technique for 3D occupancy prediction. Our method dynamically calibrates model confidence using epistemic uncertainty estimates. Our evaluation under various camera corruption scenarios, such as fog or missing cameras, demonstrates that our approach effectively quantifies epistemic uncertainty by assigning higher uncertainty values to unseen data. We introduce region-specific corruptions to simulate defects affecting only a single camera and validate our findings through both scene-level and region-level assessments. Our results show superior performance in Out-of-Distribution (OoD) detection and confidence calibration compared to common baselines such as Deep Ensembles and MC-Dropout. Our approach consistently demonstrates reliable uncertainty measures, indicating its potential for enhancing the robustness of autonomous driving systems in real-world scenarios. Code and dataset are available at https://github.com/ika-rwth-aachen/OCCUQ .
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 34 of its 42 references that are in the map. First posted on arXiv 13 Mar 2025.
Builds on
34 of 42 references.
References · 34
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2017Deformable Convolutional Networkscited by 1,488
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
- 2020Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awarenesscited by 389
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
- 2017Snapshot Ensembles: Train 1, get M for freecited by 350
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
22 more
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
- 2022OpenOOD: Benchmarking Generalized Out-of-Distribution Detectioncited by 268
- 2020SalsaNext: Fast, Uncertainty-aware Semantic Segmentation of LiDAR Point Clouds for Autonomous Drivingcited by 226
- 2023OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perceptioncited by 221
- 2021Deep Deterministic Uncertainty: A Simple Baselinecited by 200
- 2020Training independent subnetworks for robust predictioncited by 177
- 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 165
- 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptionscited by 129
- 2020A Review and Comparative Study on Probabilistic Object Detection in Autonomous Drivingcited by 115
- 2021Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Taskscited by 101
- 2020Masksembles for Uncertainty Estimationcited by 88
- 2021On Feature Collapse and Deep Kernel Learning for Single Forward Pass Uncertaintycited by 87
- 2022Anomaly Detection in Autonomous Driving: A Surveycited by 87
- 2022Packed-Ensembles for Efficient Uncertainty Estimationcited by 49
- 2023PaSCo: Urban 3D Panoptic Scene Completion with Uncertainty Awarenesscited by 42
- 2020Uncertainty Estimation Using a Single Deep Deterministic Neural Networkcited by 37
- 2019Deep Sub-Ensembles for Fast Uncertainty Estimation in Image Classificationcited by 36
- 2024Vision-based 3D occupancy prediction in autonomous driving: a review and outlookcited by 29
- 2024Uncertainty Estimation by Density Aware Evidential Deep Learningcited by 22
- 2024MultiCorrupt: A Multi-Modal Robustness Dataset and Benchmark of LiDAR-Camera Fusion for 3D Object Detectioncited by 17
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2025Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectivescited by 5
- 2025TGSFormer: Scalable Temporal Gaussian Splatting for Embodied Semantic Scene Completioncited by 2
- 2026Can we Trust Unreliable Voxels? Exploring 3D Semantic Occupancy Prediction under Label Noisecited by 1
- 2026Query2Uncertainty: Robust Uncertainty Quantification and Calibration for 3D Object Detection under Distribution Shiftcited by 1
- 2026ProOOD: Prototype-Guided Out-of-Distribution 3D Occupancy Predictioncited by 0
- 2026Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deploymentcited by 0
- 2026Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deployment15 May 2026
- 2026Query2Uncertainty: Robust Uncertainty Quantification and Calibration for 3D Object Detection under Distribution Shift6 May 2026
- 2026ProOOD: Prototype-Guided Out-of-Distribution 3D Occupancy Prediction1 Apr 2026
- 2026Can we Trust Unreliable Voxels? Exploring 3D Semantic Occupancy Prediction under Label Noise6 Mar 2026
- 2025TGSFormer: Scalable Temporal Gaussian Splatting for Embodied Semantic Scene Completion29 Nov 2025
- 2025Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectives14 May 2025