Hierarchical Uncertainty Exploration via Feedforward Posterior Trees
Not on the map. Why?
Abstract (arXiv)
When solving ill-posed inverse problems, one often desires to explore the space of potential solutions rather than be presented with a single plausible reconstruction. Valuable insights into these feasible solutions and their associated probabilities are embedded in the posterior distribution. However, when confronted with data of high dimensionality (such as images), visualizing this distribution becomes a formidable challenge, necessitating the application of effective summarization techniques before user examination. In this work, we introduce a new approach for visualizing posteriors across multiple levels of granularity using tree-valued predictions. Our method predicts a tree-valued hierarchical summarization of the posterior distribution for any input measurement, in a single forward pass of a neural network. We showcase the efficacy of our approach across diverse datasets and image restoration challenges, highlighting its prowess in uncertainty quantification and visualization. Our findings reveal that our method performs comparably to a baseline that hierarchically clusters samples from a diffusion-based posterior sampler, yet achieves this with orders of magnitude greater speed.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 50 of its 69 references that are in the map. First posted on arXiv 24 May 2024.
Builds on
50 of 69 references.
References · 50
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2017Neural Discrete Representation Learningcited by 4,712
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2023Consistency Modelscited by 1,822
- 2021Image Super-Resolution via Iterative Refinementcited by 1,511
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
38 more
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
- 2022Denoising Diffusion Restoration Modelscited by 963
- 2022On Distillation of Guided Diffusion Modelscited by 725
- 2016CVXPY: A Python-Embedded Modeling Language for Convex Optimizationcited by 641
- 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 583
- 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 521
- 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 348
- 2018Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networkscited by 280
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 218
- 2020SRFlow: Learning the Super-Resolution Space with Normalizing Flowcited by 209
- 2021SNIPS: Solving Noisy Inverse Problems Stochasticallycited by 191
- 2015Why M Heads are Better than One: Training a Diverse Ensemble of Deep Networkscited by 139
- 2018Uncertainty Estimates and Multi-Hypotheses Networks for Optical Flowcited by 135
- 2023Score-Based Diffusion Models as Principled Priors for Inverse Imagingcited by 127
- 2022Image-to-Image Regression with Distribution-Free Uncertainty Quantification and Applications in Imagingcited by 107
- 2020Stochastic Segmentation Networks: Modelling Spatially Correlated Aleatoric Uncertaintycited by 101
- 2016Learning in an Uncertain World: Representing Ambiguity Through Multiple Hypothesescited by 97
- 2019Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Predictioncited by 96
- 2022Generating High Fidelity Data from Low-density Regions using Diffusion Modelscited by 78
- 2016Stochastic Multiple Choice Learning for Training Diverse Deep Ensemblescited by 77
- 2018Deep learning-based virtual histology staining using auto-fluorescence of label-free tissuecited by 70
- 2021Estimating High Order Gradients of the Data Distribution by Denoisingcited by 64
- 2021Anycost GANs for Interactive Image Synthesis and Editingcited by 54
- 2018Structured Uncertainty Prediction Networkscited by 34
- 2021High Perceptual Quality Image Denoising with a Posterior Sampling CGANcited by 33
- 2023On the Posterior Distribution in Denoising: Application to Uncertainty Quantificationcited by 33
- 2023Principal Uncertainty Quantification with Spatial Correlation for Image Restoration Problemscited by 28
- 2017Confident Multiple Choice Learningcited by 24
- 2023Uncertainty Quantification via Neural Posterior Principal Componentscited by 16
- 2023From Posterior Sampling to Meaningful Diversity in Image Restorationcited by 12
- 2023Resilient Multiple Choice Learning: A learned scoring scheme with application to audio scene analysiscited by 12
- 2020DiverseNet: When One Right Answer is not Enoughcited by 11
- 2022A Regularized Conditional GAN for Posterior Sampling in Image Recovery Problemscited by 9
- 2023Uncertainty Visualization via Low-Dimensional Posterior Projectionscited by 3
- 2017Double-Opportunity Estimation via Altruismcited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 1.
4 papers.
- 2024Annealed Multiple Choice Learning: Overcoming limitations of Winner-takes-all with annealingcited by 12
- 2025Multiple Choice Learning of Low-Rank Adapters for Language Modelingcited by 2
- 2025QUTCC: Quantile Uncertainty Training and Conformal Calibration for Imaging Inverse Problemscited by 0
- 2026Semantic Browsing: Controllable Diversity for Image Generationcited by 0
- 2026Semantic Browsing: Controllable Diversity for Image Generation22 Jun 2026
- 2025QUTCC: Quantile Uncertainty Training and Conformal Calibration for Imaging Inverse Problems19 Jul 2025
- 2025Multiple Choice Learning of Low-Rank Adapters for Language Modeling14 Jul 2025
- 2024Annealed Multiple Choice Learning: Overcoming limitations of Winner-takes-all with annealing22 Jul 2024