mlsanityData to 7 Oct 2026

Uncertainty Visualization via Low-Dimensional Posterior Projections

arXiv 2312.07804 ↗First posted 12 Dec 2023cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

In ill-posed inverse problems, it is commonly desirable to obtain insight into the full spectrum of plausible solutions, rather than extracting only a single reconstruction. Information about the plausible solutions and their likelihoods is encoded in the posterior distribution. However, for high-dimensional data, this distribution is challenging to visualize. In this work, we introduce a new approach for estimating and visualizing posteriors by employing energy-based models (EBMs) over low-dimensional subspaces. Specifically, we train a conditional EBM that receives an input measurement and a set of directions that span some low-dimensional subspace of solutions, and outputs the probability density function of the posterior within that space. We demonstrate the effectiveness of our method across a diverse range of datasets and image restoration problems, showcasing its strength in uncertainty quantification and visualization. As we show, our method outperforms a baseline that projects samples from a diffusion-based posterior sampler, while being orders of magnitude faster. Furthermore, it is more accurate than a baseline that assumes a Gaussian posterior.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 51 of its 76 references that are in the map. First posted on arXiv 12 Dec 2023.

Builds on

51 of 76 references.

References · 51

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  8. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  9. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  10. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  11. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  12. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
38 more
  1. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  2. 2023Consistency Modelscited by 1,778
  3. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  4. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  5. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  6. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  7. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  8. 2022Denoising Diffusion Restoration Modelscited by 951
  9. 2022On Distillation of Guided Diffusion Modelscited by 721
  10. 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 670
  11. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 574
  12. 2018Predictive Uncertainty Estimation via Prior Networkscited by 555
  13. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 514
  14. 2019Deep Evidential Regressioncited by 354
  15. 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 344
  16. 2018Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networkscited by 278
  17. 2021Distribution-Free, Risk-Controlling Prediction Setscited by 278
  18. 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
  19. 2020SRFlow: Learning the Super-Resolution Space with Normalizing Flowcited by 209
  20. 2021SNIPS: Solving Noisy Inverse Problems Stochasticallycited by 191
  21. 2017Multiplicative Normalizing Flows for Variational Bayesian Neural Networkscited by 157
  22. 2019Mode Seeking Generative Adversarial Networks for Diverse Image Synthesiscited by 138
  23. 2020Improved Contrastive Divergence Training of Energy Based Modelscited by 127
  24. 2020Learning Energy-Based Models by Diffusion Recovery Likelihoodcited by 122
  25. 2018High-Quality Prediction Intervals for Deep Learning: A Distribution-Free, Ensembled Approachcited by 117
  26. 2022Image-to-Image Regression with Distribution-Free Uncertainty Quantification and Applications in Imagingcited by 107
  27. 2020Stochastic Segmentation Networks: Modelling Spatially Correlated Aleatoric Uncertaintycited by 100
  28. 2022Generating High Fidelity Data from Low-density Regions using Diffusion Modelscited by 78
  29. 2018Deep learning-based virtual histology staining using auto-fluorescence of label-free tissuecited by 70
  30. 2021Estimating High Order Gradients of the Data Distribution by Denoisingcited by 63
  31. 2020Inclusive GAN: Improving Data and Minority Coverage in Generative Modelscited by 44
  32. 2018Structured Uncertainty Prediction Networkscited by 34
  33. 2021High Perceptual Quality Image Denoising with a Posterior Sampling CGANcited by 33
  34. 2022Conffusion: Confidence Intervals for Diffusion Modelscited by 33
  35. 2023On the Posterior Distribution in Denoising: Application to Uncertainty Quantificationcited by 31
  36. 2023Principal Uncertainty Quantification with Spatial Correlation for Image Restoration Problemscited by 28
  37. 2022Semantic uncertainty intervals for disentangled latent spacescited by 22
  38. 2023Uncertainty Quantification via Neural Posterior Principal Componentscited by 16

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 1.

3 papers.