mlsanityData to 7 Oct 2026

Posterior temperature optimized Bayesian models for inverse problems in medical imaging

arXiv 2202.00986 ↗First posted 2 Feb 2022eess.IV cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

We present Posterior Temperature Optimized Bayesian Inverse Models (POTOBIM), an unsupervised Bayesian approach to inverse problems in medical imaging using mean-field variational inference with a fully tempered posterior. Bayesian methods exhibit useful properties for approaching inverse tasks, such as tomographic reconstruction or image denoising. A suitable prior distribution introduces regularization, which is needed to solve the ill-posed problem and reduces overfitting the data. In practice, however, this often results in a suboptimal posterior temperature, and the full potential of the Bayesian approach is not being exploited. In POTOBIM, we optimize both the parameters of the prior distribution and the posterior temperature with respect to reconstruction accuracy using Bayesian optimization with Gaussian process regression. Our method is extensively evaluated on four different inverse tasks on a variety of modalities with images from public data sets and we demonstrate that an optimized posterior temperature outperforms both non-Bayesian and Bayesian approaches without temperature optimization. The use of an optimized prior distribution and posterior temperature leads to improved accuracy and uncertainty estimation and we show that it is sufficient to find these hyperparameters per task domain. Well-tempered posteriors yield calibrated uncertainty, which increases the reliability in the predictions. Our source code is publicly available at github.com/Cardio-AI/mfvi-dip-mia.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 32 of its 64 references that are in the map. First posted on arXiv 2 Feb 2022.

Builds on

32 of 64 references.

References · 32

  1. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  2. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  3. 2016Variational Inference: A Review for Statisticianscited by 1,466
  4. 2018On the Spectral Bias of Neural Networkscited by 1,321
  5. 2017Deep Image Priorcited by 1,097
  6. 2018A Tutorial on Bayesian Optimizationcited by 734
  7. 2018GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Accelerationcited by 603
  8. 2020Bayesian Deep Learning and a Probabilistic Perspective of Generalizationcited by 480
  9. 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 340
  10. 2015Scalable Bayesian Optimization Using Deep Neural Networkscited by 284
  11. 2017Image reconstruction by domain transform manifold learningcited by 231
  12. 2019On instabilities of deep learning in image reconstruction - Does AI come at a cost?cited by 211
20 more
  1. 2020Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learningcited by 208
  2. 2017Low Dose CT Image Denoising Using a Generative Adversarial Network with Wasserstein Distance and Perceptual Losscited by 161
  3. 2015Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inferencecited by 159
  4. 2020On hallucinations in tomographic image reconstructioncited by 66
  5. 2018The promises and pitfalls of Stochastic Gradient Langevin Dynamicscited by 56
  6. 2020Computed Tomography Reconstruction Using Deep Image Prior and Learned Reconstruction Methodscited by 56
  7. 2019Best Practices for Scientific Research on Neural Architecture Searchcited by 53
  8. 2020A statistical theory of cold posteriors in deep neural networkscited by 53
  9. 2019A Bayesian Perspective on the Deep Image Priorcited by 52
  10. 2019Uncertainty Quantification in Deep MRI Reconstructioncited by 49
  11. 2018Deep-neural-network based sinogram synthesis for sparse-view CT image reconstructioncited by 47
  12. 2019Denoising and Regularization via Exploiting the Structural Bias of Convolutional Generatorscited by 40
  13. 2017MR image reconstruction using deep density priorscited by 37
  14. 2021Bayesian Uncertainty Estimation of Learned Variational MRI Reconstructioncited by 30
  15. 2017Bayesian Image Quality Transfer with CNNs: Exploring Uncertainty in dMRI Super-Resolutioncited by 29
  16. 2017Sharpness-aware Low dose CT denoising using conditional generative adversarial networkcited by 28
  17. 2019The Spectral Bias of the Deep Image Priorcited by 20
  18. 2020Uncertainty Estimation in Medical Image Denoising with Bayesian Deep Image Priorcited by 18
  19. 2021Recalibration of Aleatoric and Epistemic Regression Uncertainty in Medical Imagingcited by 18
  20. 2019Deformable Medical Image Registration Using a Randomly-Initialized CNN as Regularization Priorcited by 4

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 1; 2024: 1.

3 papers.