Multivariate Confidence Calibration for Object Detection
Not on the map. Why?
Abstract (arXiv)
Unbiased confidence estimates of neural networks are crucial especially for safety-critical applications. Many methods have been developed to calibrate biased confidence estimates. Though there is a variety of methods for classification, the field of object detection has not been addressed yet. Therefore, we present a novel framework to measure and calibrate biased (or miscalibrated) confidence estimates of object detection methods. The main difference to related work in the field of classifier calibration is that we also use additional information of the regression output of an object detector for calibration. Our approach allows, for the first time, to obtain calibrated confidence estimates with respect to image location and box scale. In addition, we propose a new measure to evaluate miscalibration of object detectors. Finally, we show that our developed methods outperform state-of-the-art calibration models for the task of object detection and provides reliable confidence estimates across different locations and scales.
Key facts. Cited by 98 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 17; 2023: 25; 2024: 14; 2025: 13; 2026: 16.
98 papers.
Sort:
By area:
- 2021Evaluating Large-Vocabulary Object Detectors: The Devil is in the Detailscited by 57
- 2022Annotation Error Detection: Analyzing the Past and Present for a More Coherent Futurecited by 45
- 2021How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Reviewcited by 36
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safetycited by 35
- 2022TeST: Test-time Self-Training under Distribution Shiftcited by 29
- 2024Improving Single Domain-Generalized Object Detection: A Focus on Diversification and Alignmentcited by 29
- 2022Towards Improving Calibration in Object Detection Under Domain Shiftcited by 26
- 2021Synergizing between Self-Training and Adversarial Learning for Domain Adaptive Object Detectioncited by 24
- 2024Adaptive Bounding Box Uncertainties via Two-Step Conformal Predictioncited by 23
- 2023Task-Aware Information Routing from Common Representation Space in Lifelong Learningcited by 22
- 2023Towards Building Self-Aware Object Detectors via Reliable Uncertainty Quantification and Calibrationcited by 19
- 2022ClassActionPrediction: A Challenging Benchmark for Legal Judgment Prediction of Class Action Cases in the UScited by 17
38 more
- 2023MoCaE: Mixture of Calibrated Experts Significantly Improves Object Detectioncited by 17
- 2021Gradient-Based Quantification of Epistemic Uncertainty for Deep Object Detectorscited by 16
- 2023Multiclass Confidence and Localization Calibration for Object Detectioncited by 16
- 2022Consistency is the key to further mitigating catastrophic forgetting in continual learningcited by 14
- 2022Task Agnostic Representation Consolidation: a Self-supervised based Continual Learning Approachcited by 13
- 2022Are we certain it's anomalous?cited by 13
- 2021Connecting Low-Loss Subspace for Personalized Federated Learningcited by 12
- 2022A Comprehensive Study of Real-Time Object Detection Networks Across Multiple Domains: A Surveycited by 12
- 2023Bridging Precision and Confidence: A Train-Time Loss for Calibrating Object Detectioncited by 12
- 2023Cal-DETR: Calibrated Detection Transformercited by 11
- 2024Calib3D: Calibrating Model Preferences for Reliable 3D Scene Understandingcited by 11
- 2024On Calibration of Object Detectors: Pitfalls, Evaluation and Baselinescited by 11
- 2024Confidence Calibration of Classifiers with Many Classescited by 11
- 2023Calibrated Teacher for Sparsely Annotated Object Detectioncited by 10
- 2023Beyond Classification: Definition and Density-based Estimation of Calibration in Object Detectioncited by 9
- 2021From Black-box to White-box: Examining Confidence Calibration under different Conditionscited by 8
- 2022A Comprehensive Study of Vision Transformers on Dense Prediction Taskscited by 8
- 2022Parametric and Multivariate Uncertainty Calibration for Regression and Object Detectioncited by 8
- 2023Learn, Unlearn and Relearn: An Online Learning Paradigm for Deep Neural Networkscited by 7
- 2023On the Limitations of Temperature Scaling for Distributions with Overlapscited by 7
- 2023Quantifying and mitigating the impact of label errors on model disparity metricscited by 7
- 2021False Negative Reduction in Video Instance Segmentation using Uncertainty Estimatescited by 6
- 2023Approaching Test Time Augmentation in the Context of Uncertainty Calibration for Deep Neural Networkscited by 6
- 2023Domain Adaptive Object Detection via Balancing Between Self-Training and Adversarial Learningcited by 6
- 2024ReliOcc: Towards Reliable Semantic Occupancy Prediction via Uncertainty Learningcited by 6
- 2024DrIFT: Autonomous Drone Dataset with Integrated Real and Synthetic Data, Flexible Views, and Transformed Domainscited by 6
- 2025Generalized Diffusion Detector: Mining Robust Features from Diffusion Models for Domain-Generalized Detectioncited by 6
- 2021Bayesian Confidence Calibration for Epistemic Uncertainty Modellingcited by 5
- 2021The Box Size Confidence Bias Harms Your Object Detectorcited by 5
- 2022Discrete-Event Controller Synthesis for Autonomous Systems with Deep-Learning Perception Componentscited by 5
- 2022Confidence Calibration for Object Detection and Segmentationcited by 5
- 2024Fractal Calibration for long-tailed object detectioncited by 5
- 2025Calibrating LLMs for Text-to-SQL Parsing by Leveraging Sub-clause Frequenciescited by 5
- 2022Active Learning and Novel Model Calibration Measurements for Automated Visual Inspection in Manufacturingcited by 4
- 2023A Hybrid of Generative and Discriminative Models Based on the Gaussian-coupled Softmax Layercited by 4
- 2023The Limits of Fair Medical Imaging AI In The Wildcited by 4
- 2024IMEX-Reg: Implicit-Explicit Regularization in the Function Space for Continual Learningcited by 4
- 2021Post-hoc Models for Performance Estimation of Machine Learning Inferencecited by 3
50 most cited of 98 All 98 (JSON)
- 2026Localisation-Aware Uncertainty for Pretrained Object Detection1 Oct 2026
- 2026Losing the name before the box: measuring and repairing what narrow fine-tuning costs a detector outside its deployment vocabulary29 Sep 2026
- 2026From internal representations to model improvement through prediction errors28 Sep 2026
- 2026Ev-YOLO: Uncertainty-Aware Object Detection via a Unified Evidential Formulation21 Sep 2026
- 2026Investigating White Blood Cells as a Source of False-Positive Malaria Parasite Detection in African Blood-Smear Images30 Aug 2026
- 2026Rethinking Detection Calibration: A Coordinate and Direction Perspective31 Jul 2026
- 2026From Keypoints to Predictive Distributions: Post-Hoc Uncertainty for YOLO-Pose Models29 Jul 2026
- 2026Confidence Scores in Open-Vocabulary Detection Are a Biased Mixture of Scale and Semantics13 Jul 2026
- 2026Calibrating Probabilistic Object Detectors with Annotator Disagreement23 May 2026
- 2026Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deployment15 May 2026
- 2026Query2Uncertainty: Robust Uncertainty Quantification and Calibration for 3D Object Detection under Distribution Shift6 May 2026
- 2026BEM: Training-Free Background Embedding Memory for False-Positive Suppression in Real-Time Fixed-Background Camera13 Apr 2026
38 more
- 2026GroupEnsemble: Efficient Uncertainty Estimation for DETR-based Object Detection2 Mar 2026
- 2026ALPACA: A Reinforcement Learning Environment for Medication Repurposing and Treatment Optimization in Alzheimer's Disease22 Feb 2026
- 2026Multiclass Calibration Assessment and Recalibration of Probability Predictions via the Linear Log Odds Calibration Function20 Feb 2026
- 2026Leveraging Multi-Rater Annotations to Calibrate Object Detectors in Microscopy Imaging30 Jan 2026
- 2025Beyond Size and Growth: Rethinking Lung Cancer Screening with AI Based Nodule Detection and Diagnosis29 Nov 2025
- 2025Calibrating the Full Predictive Class Distribution of 3D Object Detectors for Autonomous Driving2 Oct 2025
- 2025Automated Model Evaluation for Object Detection via Prediction Consistency and Reliability16 Aug 2025
- 2025Autonomy by Design: Preserving Human Autonomy in AI Decision-Support30 Jun 2025
- 2025h-calibration: Rethinking Classifier Recalibration with Probabilistic Error-Bounded Objective22 Jun 2025
- 2025Calibrating LLMs for Text-to-SQL Parsing by Leveraging Sub-clause Frequencies27 May 2025
- 2025Plasma State Monitoring and Disruption Characterization using Multimodal VAEs24 Apr 2025
- 2025Cooperative Inference for Real-Time 3D Human Pose Estimation in Multi-Device Edge Networks3 Apr 2025
- 2025Reliable Radiologic Skeletal Muscle Area Assessment -- A Biomarker for Cancer Cachexia Diagnosis19 Mar 2025
- 2025An Efficient Plugin Method for Metric Optimization of Black-Box Models3 Mar 2025
- 2025Generalized Diffusion Detector: Mining Robust Features from Diffusion Models for Domain-Generalized Detection3 Mar 2025
- 2025Robust Confinement State Classification with Uncertainty Quantification through Ensembled Data-Driven Methods24 Feb 2025
- 2025Breaking the SSL-AL Barrier: A Synergistic Semi-Supervised Active Learning Framework for 3D Object Detection26 Jan 2025
- 2024DrIFT: Autonomous Drone Dataset with Integrated Real and Synthetic Data, Flexible Views, and Transformed Domains6 Dec 2024
- 2024Uncertainty Quantification in Detection Transformers: Object-Level Calibration and Image-Level Reliability2 Dec 2024
- 2024Confidence Calibration of Classifiers with Many Classes5 Nov 2024
- 2024Fractal Calibration for long-tailed object detection15 Oct 2024
- 2024ReliOcc: Towards Reliable Semantic Occupancy Prediction via Uncertainty Learning26 Sep 2024
- 2024TSBP: Improving Object Detection in Histology Images via Test-time Self-guided Bounding-box Propagation25 Sep 2024
- 2024UTrack: Multi-Object Tracking with Uncertain Detections30 Aug 2024
- 2024On Calibration of Object Detectors: Pitfalls, Evaluation and Baselines30 May 2024
- 2024Improving Single Domain-Generalized Object Detection: A Focus on Diversification and Alignment23 May 2024
- 2024Mitigating Interference in the Knowledge Continuum through Attention-Guided Incremental Learning22 May 2024
- 2024IMEX-Reg: Implicit-Explicit Regularization in the Function Space for Continual Learning28 Apr 2024
- 2024Uncertainty Quantification on Graph Learning: A Survey23 Apr 2024
- 2024Calib3D: Calibrating Model Preferences for Reliable 3D Scene Understanding25 Mar 2024
- 2024Adaptive Bounding Box Uncertainties via Two-Step Conformal Prediction12 Mar 2024
- 2023The Limits of Fair Medical Imaging AI In The Wild11 Dec 2023
- 2023Beyond Classification: Definition and Density-based Estimation of Calibration in Object Detection11 Dec 2023
- 2023Domain Adaptive Object Detection via Balancing Between Self-Training and Adversarial Learning8 Nov 2023
- 2023Cal-DETR: Calibrated Detection Transformer6 Nov 2023
- 2023GACE: Geometry Aware Confidence Enhancement for Black-Box 3D Object Detectors on LiDAR-Data31 Oct 2023
- 2023CAST: Cluster-Aware Self-Training for Tabular Data via Reliable Confidence10 Oct 2023
- 2023Quantifying and mitigating the impact of label errors on model disparity metrics4 Oct 2023
50 newest of 98 All 98 (JSON)
- 2021Evaluating Large-Vocabulary Object Detectors: The Devil is in the Detailscited by 57
- 2022Annotation Error Detection: Analyzing the Past and Present for a More Coherent Futurecited by 45
- 2021How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Reviewcited by 36
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safetycited by 35
- 2022TeST: Test-time Self-Training under Distribution Shiftcited by 29
- 2024Improving Single Domain-Generalized Object Detection: A Focus on Diversification and Alignmentcited by 29
- 2022Towards Improving Calibration in Object Detection Under Domain Shiftcited by 26
- 2021Synergizing between Self-Training and Adversarial Learning for Domain Adaptive Object Detectioncited by 24
- 2024Adaptive Bounding Box Uncertainties via Two-Step Conformal Predictioncited by 23
- 2023Task-Aware Information Routing from Common Representation Space in Lifelong Learningcited by 22
- 2023Towards Building Self-Aware Object Detectors via Reliable Uncertainty Quantification and Calibrationcited by 19
- 2022ClassActionPrediction: A Challenging Benchmark for Legal Judgment Prediction of Class Action Cases in the UScited by 17
12 most cited of 96 All 96 (JSON)
- 2026Localisation-Aware Uncertainty for Pretrained Object Detection1 Oct 2026
- 2026Losing the name before the box: measuring and repairing what narrow fine-tuning costs a detector outside its deployment vocabulary29 Sep 2026
- 2026From internal representations to model improvement through prediction errors28 Sep 2026
- 2026Ev-YOLO: Uncertainty-Aware Object Detection via a Unified Evidential Formulation21 Sep 2026
- 2026Investigating White Blood Cells as a Source of False-Positive Malaria Parasite Detection in African Blood-Smear Images30 Aug 2026
- 2026Rethinking Detection Calibration: A Coordinate and Direction Perspective31 Jul 2026
- 2026From Keypoints to Predictive Distributions: Post-Hoc Uncertainty for YOLO-Pose Models29 Jul 2026
- 2026Confidence Scores in Open-Vocabulary Detection Are a Biased Mixture of Scale and Semantics13 Jul 2026
- 2026Calibrating Probabilistic Object Detectors with Annotator Disagreement23 May 2026
- 2026Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deployment15 May 2026
- 2026Query2Uncertainty: Robust Uncertainty Quantification and Calibration for 3D Object Detection under Distribution Shift6 May 2026
- 2026BEM: Training-Free Background Embedding Memory for False-Positive Suppression in Real-Time Fixed-Background Camera13 Apr 2026
12 newest of 96 All 96 (JSON)