Posterior temperature optimized Bayesian models for inverse problems in medical imaging
Not on the map. Why?
Abstract (arXiv)
We present Posterior Temperature Optimized Bayesian Inverse Models (POTOBIM), an unsupervised Bayesian approach to inverse problems in medical imaging using mean-field variational inference with a fully tempered posterior. Bayesian methods exhibit useful properties for approaching inverse tasks, such as tomographic reconstruction or image denoising. A suitable prior distribution introduces regularization, which is needed to solve the ill-posed problem and reduces overfitting the data. In practice, however, this often results in a suboptimal posterior temperature, and the full potential of the Bayesian approach is not being exploited. In POTOBIM, we optimize both the parameters of the prior distribution and the posterior temperature with respect to reconstruction accuracy using Bayesian optimization with Gaussian process regression. Our method is extensively evaluated on four different inverse tasks on a variety of modalities with images from public data sets and we demonstrate that an optimized posterior temperature outperforms both non-Bayesian and Bayesian approaches without temperature optimization. The use of an optimized prior distribution and posterior temperature leads to improved accuracy and uncertainty estimation and we show that it is sufficient to find these hyperparameters per task domain. Well-tempered posteriors yield calibrated uncertainty, which increases the reliability in the predictions. Our source code is publicly available at github.com/Cardio-AI/mfvi-dip-mia.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 32 of its 64 references that are in the map. First posted on arXiv 2 Feb 2022.
Builds on
32 of 64 references.
References · 32
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2016Variational Inference: A Review for Statisticianscited by 1,466
- 2018On the Spectral Bias of Neural Networkscited by 1,321
- 2017Deep Image Priorcited by 1,097
- 2018A Tutorial on Bayesian Optimizationcited by 734
- 2018GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Accelerationcited by 603
- 2020Bayesian Deep Learning and a Probabilistic Perspective of Generalizationcited by 480
- 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 340
- 2015Scalable Bayesian Optimization Using Deep Neural Networkscited by 284
- 2017Image reconstruction by domain transform manifold learningcited by 231
- 2019On instabilities of deep learning in image reconstruction - Does AI come at a cost?cited by 211
20 more
- 2020Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learningcited by 208
- 2017Low Dose CT Image Denoising Using a Generative Adversarial Network with Wasserstein Distance and Perceptual Losscited by 161
- 2015Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inferencecited by 159
- 2020On hallucinations in tomographic image reconstructioncited by 66
- 2018The promises and pitfalls of Stochastic Gradient Langevin Dynamicscited by 56
- 2020Computed Tomography Reconstruction Using Deep Image Prior and Learned Reconstruction Methodscited by 56
- 2019Best Practices for Scientific Research on Neural Architecture Searchcited by 53
- 2020A statistical theory of cold posteriors in deep neural networkscited by 53
- 2019A Bayesian Perspective on the Deep Image Priorcited by 52
- 2019Uncertainty Quantification in Deep MRI Reconstructioncited by 49
- 2018Deep-neural-network based sinogram synthesis for sparse-view CT image reconstructioncited by 47
- 2019Denoising and Regularization via Exploiting the Structural Bias of Convolutional Generatorscited by 40
- 2017MR image reconstruction using deep density priorscited by 37
- 2021Bayesian Uncertainty Estimation of Learned Variational MRI Reconstructioncited by 30
- 2017Bayesian Image Quality Transfer with CNNs: Exploring Uncertainty in dMRI Super-Resolutioncited by 29
- 2017Sharpness-aware Low dose CT denoising using conditional generative adversarial networkcited by 28
- 2019The Spectral Bias of the Deep Image Priorcited by 20
- 2020Uncertainty Estimation in Medical Image Denoising with Bayesian Deep Image Priorcited by 18
- 2021Recalibration of Aleatoric and Epistemic Regression Uncertainty in Medical Imagingcited by 18
- 2019Deformable Medical Image Registration Using a Randomly-Initialized CNN as Regularization Priorcited by 4
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 1.
3 papers.
- 2022UncertaINR: Uncertainty Quantification of End-to-End Implicit Neural Representations for Computed Tomographycited by 19
- 2024FUNAvg: Federated Uncertainty Weighted Averaging for Datasets with Diverse Labelscited by 5
- 2023Unsupervised Domain Adaptation for Low-dose CT Reconstruction via Bayesian Uncertainty Alignmentcited by 4
- 2024FUNAvg: Federated Uncertainty Weighted Averaging for Datasets with Diverse Labels10 Jul 2024
- 2023Unsupervised Domain Adaptation for Low-dose CT Reconstruction via Bayesian Uncertainty Alignment26 Feb 2023
- 2022UncertaINR: Uncertainty Quantification of End-to-End Implicit Neural Representations for Computed Tomography22 Feb 2022