Query2Uncertainty: Robust Uncertainty Quantification and Calibration for 3D Object Detection under Distribution Shift
Not on the map. Why?
Abstract (arXiv)
Reliable uncertainty estimation for 3D object detection is critical for deploying safe autonomous systems, yet modern detectors remain poorly calibrated, especially under distribution shifts. Although post-hoc calibration methods address this issue and provide improved calibration for in-distribution tests, they fail to adapt in distribution-shifted scenarios. In this work, we address this issue and introduce a density-aware calibration method that couples post-hoc calibrators with the feature density of latent object queries from DETR-style 3D object detectors. These queries form a compact, location and class-aware feature, ideal for density estimation, allowing our approach to adjust model confidences in distribution-shift scenarios. By fitting a density estimator on these query features, our approach jointly recalibrates both classification and bounding box regression uncertainties. On both a multi-view camera and LiDAR-based detector, our approach consistently outperforms standard post-hoc methods in both in-distribution and distribution-shifted scenarios. Code available https://tillbeemelmanns.github.io/query2uncertainty/ .
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 44 of its 56 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
44 of 56 references.
References · 44
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2016Density estimation using Real NVPcited by 2,042
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 658
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 552
- 2018Accurate Uncertainties for Deep Learning Using Calibrated Regressioncited by 422
32 more
- 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 352
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 315
- 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
- 2021Deep Deterministic Uncertainty: A Simple Baselinecited by 200
- 2018Bounding Box Regression with Uncertainty for Accurate Object Detectioncited by 143
- 2022Robust Collaborative 3D Object Detection in Presence of Pose Errorscited by 129
- 2020A Review and Comparative Study on Probabilistic Object Detection in Autonomous Drivingcited by 115
- 2019Gaussian YOLOv3: An Accurate and Fast Object Detector Using Localization Uncertainty for Autonomous Drivingcited by 105
- 2022CenterFormer: Center-based Transformer for 3D Object Detectioncited by 99
- 2020Multivariate Confidence Calibration for Object Detectioncited by 98
- 2022GMMSeg: Gaussian Mixture based Generative Semantic Segmentation Modelscited by 87
- 2018Towards Safe Autonomous Driving: Capture Uncertainty in the Deep Neural Network For Lidar 3D Vehicle Detectioncited by 82
- 2019Sampling-free Epistemic Uncertainty Estimation Using Approximated Variance Propagationcited by 74
- 2019BayesOD: A Bayesian Approach for Uncertainty Estimation in Deep Object Detectorscited by 68
- 2020Post-hoc Uncertainty Calibration for Domain Drift Scenarioscited by 61
- 2021Estimating and Evaluating Regression Predictive Uncertainty in Deep Object Detectorscited by 37
- 2019Can We Trust You? On Calibration of a Probabilistic Object Detector for Autonomous Drivingcited by 30
- 2022Towards Improving Calibration in Object Detection Under Domain Shiftcited by 26
- 2024Uncertainty Estimation by Density Aware Evidential Deep Learningcited by 22
- 2023Towards Building Self-Aware Object Detectors via Reliable Uncertainty Quantification and Calibrationcited by 19
- 2024SEED: A Simple and Effective 3D DETR in Point Cloudscited by 19
- 2024MultiCorrupt: A Multi-Modal Robustness Dataset and Benchmark of LiDAR-Camera Fusion for 3D Object Detectioncited by 17
- 2023Multiclass Confidence and Localization Calibration for Object Detectioncited by 16
- 2023Beyond In-Domain Scenarios: Robust Density-Aware Calibrationcited by 14
- 2022Li3DeTr: A LiDAR based 3D Detection Transformercited by 11
- 2023Cal-DETR: Calibrated Detection Transformercited by 11
- 2024Calib3D: Calibrating Model Preferences for Reliable 3D Scene Understandingcited by 11
- 2024On Calibration of Object Detectors: Pitfalls, Evaluation and Baselinescited by 11
- 2020Uncertainty-Aware Voxel based 3D Object Detection and Tracking with von-Mises Losscited by 10
- 2025OCCUQ: Exploring Efficient Uncertainty Quantification for 3D Occupancy Predictioncited by 6
- 2022LiDAR-MIMO: Efficient Uncertainty Estimation for LiDAR-based 3D Object Detectioncited by 5
- 2021Approaching Neural Network Uncertainty Realismcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.