Uncertainty Visualization via Low-Dimensional Posterior Projections
Not on the map. Why?
Abstract (arXiv)
In ill-posed inverse problems, it is commonly desirable to obtain insight into the full spectrum of plausible solutions, rather than extracting only a single reconstruction. Information about the plausible solutions and their likelihoods is encoded in the posterior distribution. However, for high-dimensional data, this distribution is challenging to visualize. In this work, we introduce a new approach for estimating and visualizing posteriors by employing energy-based models (EBMs) over low-dimensional subspaces. Specifically, we train a conditional EBM that receives an input measurement and a set of directions that span some low-dimensional subspace of solutions, and outputs the probability density function of the posterior within that space. We demonstrate the effectiveness of our method across a diverse range of datasets and image restoration problems, showcasing its strength in uncertainty quantification and visualization. As we show, our method outperforms a baseline that projects samples from a diffusion-based posterior sampler, while being orders of magnitude faster. Furthermore, it is more accurate than a baseline that assumes a Gaussian posterior.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 51 of its 76 references that are in the map. First posted on arXiv 12 Dec 2023.
Builds on
51 of 76 references.
References · 51
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
38 more
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2023Consistency Modelscited by 1,778
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2022Denoising Diffusion Restoration Modelscited by 951
- 2022On Distillation of Guided Diffusion Modelscited by 721
- 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 670
- 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 574
- 2018Predictive Uncertainty Estimation via Prior Networkscited by 555
- 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 514
- 2019Deep Evidential Regressioncited by 354
- 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 344
- 2018Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networkscited by 278
- 2021Distribution-Free, Risk-Controlling Prediction Setscited by 278
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
- 2020SRFlow: Learning the Super-Resolution Space with Normalizing Flowcited by 209
- 2021SNIPS: Solving Noisy Inverse Problems Stochasticallycited by 191
- 2017Multiplicative Normalizing Flows for Variational Bayesian Neural Networkscited by 157
- 2019Mode Seeking Generative Adversarial Networks for Diverse Image Synthesiscited by 138
- 2020Improved Contrastive Divergence Training of Energy Based Modelscited by 127
- 2020Learning Energy-Based Models by Diffusion Recovery Likelihoodcited by 122
- 2018High-Quality Prediction Intervals for Deep Learning: A Distribution-Free, Ensembled Approachcited by 117
- 2022Image-to-Image Regression with Distribution-Free Uncertainty Quantification and Applications in Imagingcited by 107
- 2020Stochastic Segmentation Networks: Modelling Spatially Correlated Aleatoric Uncertaintycited by 100
- 2022Generating High Fidelity Data from Low-density Regions using Diffusion Modelscited by 78
- 2018Deep learning-based virtual histology staining using auto-fluorescence of label-free tissuecited by 70
- 2021Estimating High Order Gradients of the Data Distribution by Denoisingcited by 63
- 2020Inclusive GAN: Improving Data and Minority Coverage in Generative Modelscited by 44
- 2018Structured Uncertainty Prediction Networkscited by 34
- 2021High Perceptual Quality Image Denoising with a Posterior Sampling CGANcited by 33
- 2022Conffusion: Confidence Intervals for Diffusion Modelscited by 33
- 2023On the Posterior Distribution in Denoising: Application to Uncertainty Quantificationcited by 31
- 2023Principal Uncertainty Quantification with Spatial Correlation for Image Restoration Problemscited by 28
- 2022Semantic uncertainty intervals for disentangled latent spacescited by 22
- 2023Uncertainty Quantification via Neural Posterior Principal Componentscited by 16
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.
- 2024Hierarchical Uncertainty Exploration via Feedforward Posterior Treescited by 4
- 2025QUTCC: Quantile Uncertainty Training and Conformal Calibration for Imaging Inverse Problemscited by 0
- 2026It depends: Incorporating correlations for joint aleatoric and epistemic uncertainties of high-dimensional output spacescited by 0
- 2026It depends: Incorporating correlations for joint aleatoric and epistemic uncertainties of high-dimensional output spaces25 Aug 2026
- 2025QUTCC: Quantile Uncertainty Training and Conformal Calibration for Imaging Inverse Problems19 Jul 2025
- 2024Hierarchical Uncertainty Exploration via Feedforward Posterior Trees24 May 2024