mlsanityData to 14 Oct 2026

Hierarchical Uncertainty Exploration via Feedforward Posterior Trees

arXiv 2405.15719 ↗First posted 24 May 2024cs.CV cs.LG eess.IVcited by 4

Not on the map. Why?

Abstract (arXiv)

When solving ill-posed inverse problems, one often desires to explore the space of potential solutions rather than be presented with a single plausible reconstruction. Valuable insights into these feasible solutions and their associated probabilities are embedded in the posterior distribution. However, when confronted with data of high dimensionality (such as images), visualizing this distribution becomes a formidable challenge, necessitating the application of effective summarization techniques before user examination. In this work, we introduce a new approach for visualizing posteriors across multiple levels of granularity using tree-valued predictions. Our method predicts a tree-valued hierarchical summarization of the posterior distribution for any input measurement, in a single forward pass of a neural network. We showcase the efficacy of our approach across diverse datasets and image restoration challenges, highlighting its prowess in uncertainty quantification and visualization. Our findings reveal that our method performs comparably to a baseline that hierarchically clusters samples from a diffusion-based posterior sampler, yet achieves this with orders of magnitude greater speed.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 50 of its 69 references that are in the map. First posted on arXiv 24 May 2024.

Builds on

50 of 69 references.

References · 50

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  5. 2017Neural Discrete Representation Learningcited by 4,712
  6. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  7. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  8. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  9. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  10. 2023Consistency Modelscited by 1,822
  11. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
  12. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
38 more
  1. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
  2. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  3. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  4. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
  5. 2022Denoising Diffusion Restoration Modelscited by 963
  6. 2022On Distillation of Guided Diffusion Modelscited by 725
  7. 2016CVXPY: A Python-Embedded Modeling Language for Convex Optimizationcited by 641
  8. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 583
  9. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 521
  10. 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 348
  11. 2018Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networkscited by 280
  12. 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 218
  13. 2020SRFlow: Learning the Super-Resolution Space with Normalizing Flowcited by 209
  14. 2021SNIPS: Solving Noisy Inverse Problems Stochasticallycited by 191
  15. 2015Why M Heads are Better than One: Training a Diverse Ensemble of Deep Networkscited by 139
  16. 2018Uncertainty Estimates and Multi-Hypotheses Networks for Optical Flowcited by 135
  17. 2023Score-Based Diffusion Models as Principled Priors for Inverse Imagingcited by 127
  18. 2022Image-to-Image Regression with Distribution-Free Uncertainty Quantification and Applications in Imagingcited by 107
  19. 2020Stochastic Segmentation Networks: Modelling Spatially Correlated Aleatoric Uncertaintycited by 101
  20. 2016Learning in an Uncertain World: Representing Ambiguity Through Multiple Hypothesescited by 97
  21. 2019Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Predictioncited by 96
  22. 2022Generating High Fidelity Data from Low-density Regions using Diffusion Modelscited by 78
  23. 2016Stochastic Multiple Choice Learning for Training Diverse Deep Ensemblescited by 77
  24. 2018Deep learning-based virtual histology staining using auto-fluorescence of label-free tissuecited by 70
  25. 2021Estimating High Order Gradients of the Data Distribution by Denoisingcited by 64
  26. 2021Anycost GANs for Interactive Image Synthesis and Editingcited by 54
  27. 2018Structured Uncertainty Prediction Networkscited by 34
  28. 2021High Perceptual Quality Image Denoising with a Posterior Sampling CGANcited by 33
  29. 2023On the Posterior Distribution in Denoising: Application to Uncertainty Quantificationcited by 33
  30. 2023Principal Uncertainty Quantification with Spatial Correlation for Image Restoration Problemscited by 28
  31. 2017Confident Multiple Choice Learningcited by 24
  32. 2023Uncertainty Quantification via Neural Posterior Principal Componentscited by 16
  33. 2023From Posterior Sampling to Meaningful Diversity in Image Restorationcited by 12
  34. 2023Resilient Multiple Choice Learning: A learned scoring scheme with application to audio scene analysiscited by 12
  35. 2020DiverseNet: When One Right Answer is not Enoughcited by 11
  36. 2022A Regularized Conditional GAN for Posterior Sampling in Image Recovery Problemscited by 9
  37. 2023Uncertainty Visualization via Low-Dimensional Posterior Projectionscited by 3
  38. 2017Double-Opportunity Estimation via Altruismcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.