Well-calibrated Model Uncertainty with Temperature Scaling for Dropout Variational Inference
Not on the map. Why?
Abstract (arXiv)
Model uncertainty obtained by variational Bayesian inference with Monte Carlo dropout is prone to miscalibration. The uncertainty does not represent the model error well. In this paper, temperature scaling is extended to dropout variational inference to calibrate model uncertainty. Expected uncertainty calibration error (UCE) is presented as a metric to measure miscalibration of uncertainty. The effectiveness of this approach is evaluated on CIFAR-10/100 for recent CNN architectures. Experimental results show, that temperature scaling considerably reduces miscalibration by means of UCE and enables robust rejection of uncertain predictions. The proposed approach can easily be derived from frequentist temperature scaling and yields well-calibrated model uncertainty. It is simple to implement and does not affect the model accuracy.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 3; 2023: 8; 2024: 7; 2025: 8; 2026: 2.
35 papers.
Sort:
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
- 2023Calibration in Deep Learning: A Survey of the State-of-the-Artcited by 72
- 2021Spatially Varying Label Smoothing: Capturing Uncertainty from Expert Annotationscited by 31
- 2022Towards Improving Calibration in Object Detection Under Domain Shiftcited by 26
- 2022BayesCap: Bayesian Identity Cap for Calibrated Uncertainty in Frozen Neural Networkscited by 23
- 2021Class-Distribution-Aware Calibration for Long-Tailed Visual Recognitioncited by 19
- 2021Recalibration of Aleatoric and Epistemic Regression Uncertainty in Medical Imagingcited by 18
- 2024A Survey on Safe Multi-Modal Learning Systemcited by 15
- 2023Cal-DETR: Calibrated Detection Transformercited by 11
- 2022On Calibrated Model Uncertainty in Deep Learningcited by 7
- 2024Rate-In: Information-Driven Adaptive Dropout Rates for Improved Inference-Time Uncertainty Estimationcited by 7
- 2023Overcoming the Limitations of Localization Uncertainty: Efficient & Exact Non-Linear Post-Processing and Calibrationcited by 5
23 more
- 2025Revisiting Gradient-based Uncertainty for Monocular Depth Estimationcited by 5
- 2021Posterior Temperature Optimization in Variational Inference for Inverse Problemscited by 3
- 2024Decoupling of neural network calibration measurescited by 3
- 2025Enhancing Uncertainty Estimation in Semantic Segmentation via Monte-Carlo Frequency Dropoutcited by 3
- 2025Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Reviewcited by 3
- 2023Realistic Conversational Question Answering with Answer Selection based on Calibrated Confidence and Uncertainty Measurementcited by 2
- 2024Evaluating Bayesian deep learning for radio galaxy classificationcited by 2
- 2025CLUE: Neural Networks Calibration via Learning Uncertainty-Error alignmentcited by 2
- 2025h-calibration: Rethinking Classifier Recalibration with Probabilistic Error-Bounded Objectivecited by 2
- 2021Unsupervised Model Drift Estimation with Batch Normalization Statistics for Dataset Shift Detection and Model Selectioncited by 1
- 2023Towards Unbiased Calibration using Meta-Regularizationcited by 1
- 2023An Uncertainty Aided Framework for Learning based Liver T1ρ Mapping and Analysiscited by 1
- 2023On Calibration of Modern Quantized Efficient Neural Networkscited by 1
- 2024Improving Uncertainty-Error Correspondence in Deep Bayesian Medical Image Segmentationcited by 1
- 2024A Deep Learning Approach to Estimate Canopy Height and Uncertainty by Integrating Seasonal Optical, SAR and Limited GEDI LiDAR Data over Northern Forestscited by 1
- 2026Extending confidence calibration to generalised measures of variationcited by 1
- 2021TransMorph: Transformer for unsupervised medical image registrationcited by 0
- 2023Rethinking Soft Label in Label Distribution Learning Perspectivecited by 0
- 2024Dual-Channel Reliable Breast Ultrasound Image Classification Based on Explainable Attribution and Uncertainty Quantificationcited by 0
- 2025Are you SURE? Enhancing Multimodal Pretraining with Missing Modalities through Uncertainty Estimationcited by 0
- 2025MMformer with Adaptive Transferable Attention: Advancing Multivariate Time Series Forecasting for Environmental Applicationscited by 0
- 2025Uncertainty in Semantic Language Modeling with PIXELScited by 0
- 2026Confidence-Uncertainty Boundary Calibration for Bayesian Deep Learning in Medical Image Analysiscited by 0
- 2026Extending confidence calibration to generalised measures of variation13 Feb 2026
- 2026Confidence-Uncertainty Boundary Calibration for Bayesian Deep Learning in Medical Image Analysis12 Feb 2026
- 2025Uncertainty in Semantic Language Modeling with PIXELS23 Sep 2025
- 2025h-calibration: Rethinking Classifier Recalibration with Probabilistic Error-Bounded Objective22 Jun 2025
- 2025CLUE: Neural Networks Calibration via Learning Uncertainty-Error alignment28 May 2025
- 2025Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Review25 Apr 2025
- 2025MMformer with Adaptive Transferable Attention: Advancing Multivariate Time Series Forecasting for Environmental Applications18 Apr 2025
- 2025Are you SURE? Enhancing Multimodal Pretraining with Missing Modalities through Uncertainty Estimation18 Apr 2025
- 2025Revisiting Gradient-based Uncertainty for Monocular Depth Estimation9 Feb 2025
- 2025Enhancing Uncertainty Estimation in Semantic Segmentation via Monte-Carlo Frequency Dropout20 Jan 2025
- 2024Rate-In: Information-Driven Adaptive Dropout Rates for Improved Inference-Time Uncertainty Estimation10 Dec 2024
- 2024A Deep Learning Approach to Estimate Canopy Height and Uncertainty by Integrating Seasonal Optical, SAR and Limited GEDI LiDAR Data over Northern Forests8 Oct 2024
23 more
- 2024Improving Uncertainty-Error Correspondence in Deep Bayesian Medical Image Segmentation5 Sep 2024
- 2024Decoupling of neural network calibration measures4 Jun 2024
- 2024Evaluating Bayesian deep learning for radio galaxy classification28 May 2024
- 2024A Survey on Safe Multi-Modal Learning System8 Feb 2024
- 2024Dual-Channel Reliable Breast Ultrasound Image Classification Based on Explainable Attribution and Uncertainty Quantification8 Jan 2024
- 2023Cal-DETR: Calibrated Detection Transformer6 Nov 2023
- 2023On Calibration of Modern Quantized Efficient Neural Networks25 Sep 2023
- 2023Calibration in Deep Learning: A Survey of the State-of-the-Art2 Aug 2023
- 2023An Uncertainty Aided Framework for Learning based Liver T1ρ Mapping and Analysis6 Jul 2023
- 2023Overcoming the Limitations of Localization Uncertainty: Efficient & Exact Non-Linear Post-Processing and Calibration15 Jun 2023
- 2023Towards Unbiased Calibration using Meta-Regularization27 Mar 2023
- 2023Realistic Conversational Question Answering with Answer Selection based on Calibrated Confidence and Uncertainty Measurement10 Feb 2023
- 2023Rethinking Soft Label in Label Distribution Learning Perspective31 Jan 2023
- 2022Towards Improving Calibration in Object Detection Under Domain Shift15 Sep 2022
- 2022BayesCap: Bayesian Identity Cap for Calibrated Uncertainty in Frozen Neural Networks14 Jul 2022
- 2022On Calibrated Model Uncertainty in Deep Learning15 Jun 2022
- 2021TransMorph: Transformer for unsupervised medical image registration19 Nov 2021
- 2021Class-Distribution-Aware Calibration for Long-Tailed Visual Recognition11 Sep 2021
- 2021A Survey of Uncertainty in Deep Neural Networks7 Jul 2021
- 2021Unsupervised Model Drift Estimation with Batch Normalization Statistics for Dataset Shift Detection and Model Selection1 Jul 2021
- 2021Posterior Temperature Optimization in Variational Inference for Inverse Problems11 Jun 2021
- 2021Recalibration of Aleatoric and Epistemic Regression Uncertainty in Medical Imaging26 Apr 2021
- 2021Spatially Varying Label Smoothing: Capturing Uncertainty from Expert Annotations12 Apr 2021
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
- 2023Calibration in Deep Learning: A Survey of the State-of-the-Artcited by 72
- 2021Spatially Varying Label Smoothing: Capturing Uncertainty from Expert Annotationscited by 31
- 2022Towards Improving Calibration in Object Detection Under Domain Shiftcited by 26
- 2022BayesCap: Bayesian Identity Cap for Calibrated Uncertainty in Frozen Neural Networkscited by 23
- 2021Class-Distribution-Aware Calibration for Long-Tailed Visual Recognitioncited by 19
- 2021Recalibration of Aleatoric and Epistemic Regression Uncertainty in Medical Imagingcited by 18
- 2024A Survey on Safe Multi-Modal Learning Systemcited by 15
- 2023Cal-DETR: Calibrated Detection Transformercited by 11
- 2022On Calibrated Model Uncertainty in Deep Learningcited by 7
- 2024Rate-In: Information-Driven Adaptive Dropout Rates for Improved Inference-Time Uncertainty Estimationcited by 7
- 2023Overcoming the Limitations of Localization Uncertainty: Efficient & Exact Non-Linear Post-Processing and Calibrationcited by 5
12 most cited of 35 All 35 (JSON)
- 2026Extending confidence calibration to generalised measures of variation13 Feb 2026
- 2026Confidence-Uncertainty Boundary Calibration for Bayesian Deep Learning in Medical Image Analysis12 Feb 2026
- 2025Uncertainty in Semantic Language Modeling with PIXELS23 Sep 2025
- 2025h-calibration: Rethinking Classifier Recalibration with Probabilistic Error-Bounded Objective22 Jun 2025
- 2025CLUE: Neural Networks Calibration via Learning Uncertainty-Error alignment28 May 2025
- 2025Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Review25 Apr 2025
- 2025MMformer with Adaptive Transferable Attention: Advancing Multivariate Time Series Forecasting for Environmental Applications18 Apr 2025
- 2025Are you SURE? Enhancing Multimodal Pretraining with Missing Modalities through Uncertainty Estimation18 Apr 2025
- 2025Revisiting Gradient-based Uncertainty for Monocular Depth Estimation9 Feb 2025
- 2025Enhancing Uncertainty Estimation in Semantic Segmentation via Monte-Carlo Frequency Dropout20 Jan 2025
- 2024Rate-In: Information-Driven Adaptive Dropout Rates for Improved Inference-Time Uncertainty Estimation10 Dec 2024
- 2024A Deep Learning Approach to Estimate Canopy Height and Uncertainty by Integrating Seasonal Optical, SAR and Limited GEDI LiDAR Data over Northern Forests8 Oct 2024
12 newest of 35 All 35 (JSON)