Calibration of Model Uncertainty for Dropout Variational Inference
Not on the map. Why?
Abstract (arXiv)
The model uncertainty obtained by variational Bayesian inference with Monte Carlo dropout is prone to miscalibration. In this paper, different logit scaling methods are extended to dropout variational inference to recalibrate model uncertainty. Expected uncertainty calibration error (UCE) is presented as a metric to measure miscalibration. The effectiveness of recalibration is evaluated on CIFAR-10/100 and SVHN for recent CNN architectures. Experimental results show that logit scaling considerably reduce miscalibration by means of UCE. Well-calibrated uncertainty enables reliable rejection of uncertain predictions and robust detection of out-of-distribution data.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 3; 2023: 4; 2024: 1; 2025: 7; 2026: 1.
18 papers.
Sort:
By area:
- 2022NP-Match: When Neural Processes meet Semi-Supervised Learningcited by 25
- 2022BayesCap: Bayesian Identity Cap for Calibrated Uncertainty in Frozen Neural Networkscited by 23
- 2023Discretization-Induced Dirichlet Posterior for Robust Uncertainty Quantification on Regressioncited by 7
- 2025On Epistemic Uncertainty of Visual Tokens for Object Hallucinations in Large Vision-Language Modelscited by 4
- 2025Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Reviewcited by 3
- 2025Uncertainty quantification with approximate variational learning for wearable photoplethysmography prediction taskscited by 3
- 2022Autoencoder Attractors for Uncertainty Estimationcited by 2
- 2023NP-Match: Towards a New Probabilistic Model for Semi-Supervised Learningcited by 1
- 2023An Uncertainty Aided Framework for Learning based Liver T1ρ Mapping and Analysiscited by 1
- 2023HypUC: Hyperfine Uncertainty Calibration with Gradient-boosted Corrections for Reliable Regression on Imbalanced Electrocardiogramscited by 1
- 2025Deep Neural Network Calibration by Reducing Classifier Shift with Stochastic Maskingcited by 1
- 2025Federated Learning via Meta-Variational Dropoutcited by 1
6 more
- 2021Weight Pruning and Uncertainty in Radio Galaxy Classificationcited by 0
- 2021Improving the Behaviour of Vision Transformers with Token-consistent Stochastic Layerscited by 0
- 2024Exploring Probabilistic Models for Semi-supervised Learningcited by 0
- 2025Uncertainty-aware Test-Time Training (UT3) for Efficient On-the-fly Domain Adaptive Dense Regressioncited by 0
- 2025Adaptive Individual Uncertainty under Out-Of-Distribution Shift with Expert-Routed Conformal Predictioncited by 0
- 2026CUPID: A Plug-in Framework for Joint Aleatoric and Epistemic Uncertainty Estimation with a Single Modelcited by 0
- 2026CUPID: A Plug-in Framework for Joint Aleatoric and Epistemic Uncertainty Estimation with a Single Model11 Mar 2026
- 2025Federated Learning via Meta-Variational Dropout23 Oct 2025
- 2025Adaptive Individual Uncertainty under Out-Of-Distribution Shift with Expert-Routed Conformal Prediction17 Oct 2025
- 2025On Epistemic Uncertainty of Visual Tokens for Object Hallucinations in Large Vision-Language Models10 Oct 2025
- 2025Uncertainty-aware Test-Time Training (UT3) for Efficient On-the-fly Domain Adaptive Dense Regression3 Sep 2025
- 2025Deep Neural Network Calibration by Reducing Classifier Shift with Stochastic Masking12 Aug 2025
- 2025Uncertainty quantification with approximate variational learning for wearable photoplethysmography prediction tasks16 May 2025
- 2025Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Review25 Apr 2025
- 2024Exploring Probabilistic Models for Semi-supervised Learning5 Apr 2024
- 2023HypUC: Hyperfine Uncertainty Calibration with Gradient-boosted Corrections for Reliable Regression on Imbalanced Electrocardiograms23 Nov 2023
- 2023Discretization-Induced Dirichlet Posterior for Robust Uncertainty Quantification on Regression17 Aug 2023
- 2023An Uncertainty Aided Framework for Learning based Liver T1ρ Mapping and Analysis6 Jul 2023
6 more
- 2023NP-Match: Towards a New Probabilistic Model for Semi-Supervised Learning31 Jan 2023
- 2022BayesCap: Bayesian Identity Cap for Calibrated Uncertainty in Frozen Neural Networks14 Jul 2022
- 2022NP-Match: When Neural Processes meet Semi-Supervised Learning3 Jul 2022
- 2022Autoencoder Attractors for Uncertainty Estimation1 Apr 2022
- 2021Improving the Behaviour of Vision Transformers with Token-consistent Stochastic Layers30 Dec 2021
- 2021Weight Pruning and Uncertainty in Radio Galaxy Classification23 Nov 2021
- 2022NP-Match: When Neural Processes meet Semi-Supervised Learningcited by 25
- 2022BayesCap: Bayesian Identity Cap for Calibrated Uncertainty in Frozen Neural Networkscited by 23
- 2023Discretization-Induced Dirichlet Posterior for Robust Uncertainty Quantification on Regressioncited by 7
- 2025Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Reviewcited by 3
- 2025Uncertainty quantification with approximate variational learning for wearable photoplethysmography prediction taskscited by 3
- 2022Autoencoder Attractors for Uncertainty Estimationcited by 2
- 2023NP-Match: Towards a New Probabilistic Model for Semi-Supervised Learningcited by 1
- 2023An Uncertainty Aided Framework for Learning based Liver T1ρ Mapping and Analysiscited by 1
- 2023HypUC: Hyperfine Uncertainty Calibration with Gradient-boosted Corrections for Reliable Regression on Imbalanced Electrocardiogramscited by 1
- 2025Deep Neural Network Calibration by Reducing Classifier Shift with Stochastic Maskingcited by 1
- 2025Federated Learning via Meta-Variational Dropoutcited by 1
- 2021Weight Pruning and Uncertainty in Radio Galaxy Classificationcited by 0
12 most cited of 17 All 17 (JSON)
- 2026CUPID: A Plug-in Framework for Joint Aleatoric and Epistemic Uncertainty Estimation with a Single Model11 Mar 2026
- 2025Federated Learning via Meta-Variational Dropout23 Oct 2025
- 2025Adaptive Individual Uncertainty under Out-Of-Distribution Shift with Expert-Routed Conformal Prediction17 Oct 2025
- 2025Uncertainty-aware Test-Time Training (UT3) for Efficient On-the-fly Domain Adaptive Dense Regression3 Sep 2025
- 2025Deep Neural Network Calibration by Reducing Classifier Shift with Stochastic Masking12 Aug 2025
- 2025Uncertainty quantification with approximate variational learning for wearable photoplethysmography prediction tasks16 May 2025
- 2025Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Review25 Apr 2025
- 2024Exploring Probabilistic Models for Semi-supervised Learning5 Apr 2024
- 2023HypUC: Hyperfine Uncertainty Calibration with Gradient-boosted Corrections for Reliable Regression on Imbalanced Electrocardiograms23 Nov 2023
- 2023Discretization-Induced Dirichlet Posterior for Robust Uncertainty Quantification on Regression17 Aug 2023
- 2023An Uncertainty Aided Framework for Learning based Liver T1ρ Mapping and Analysis6 Jul 2023
- 2023NP-Match: Towards a New Probabilistic Model for Semi-Supervised Learning31 Jan 2023
12 newest of 17 All 17 (JSON)