mlsanityData to 14 Oct 2026

On the Quantification of Image Reconstruction Uncertainty without Training Data

arXiv 2311.09639 ↗First posted 16 Nov 2023cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Computational imaging plays a pivotal role in determining hidden information from sparse measurements. A robust inverse solver is crucial to fully characterize the uncertainty induced by these measurements, as it allows for the estimation of the complete posterior of unrecoverable targets. This, in turn, facilitates a probabilistic interpretation of observational data for decision-making. In this study, we propose a deep variational framework that leverages a deep generative model to learn an approximate posterior distribution to effectively quantify image reconstruction uncertainty without the need for training data. We parameterize the target posterior using a flow-based model and minimize their Kullback-Leibler (KL) divergence to achieve accurate uncertainty estimation. To bolster stability, we introduce a robust flow-based model with bi-directional regularization and enhance expressivity through gradient boosting. Additionally, we incorporate a space-filling design to achieve substantial variance reduction on both latent prior space and target posterior space. We validate our method on several benchmark tasks and two real-world applications, namely fastMRI and black hole image reconstruction. Our results indicate that our method provides reliable and high-quality image reconstruction with robust uncertainty estimation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 35 of its 62 references that are in the map. First posted on arXiv 16 Nov 2023.

Builds on

35 of 62 references.

References · 35

  1. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  2. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  3. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  4. 2015Variational Inference with Normalizing Flowscited by 2,170
  5. 2016Density estimation using Real NVPcited by 2,042
  6. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
  7. 2016Variational Inference: A Review for Statisticianscited by 1,472
  8. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
  9. 2017Deep Image Priorcited by 1,098
  10. 2019Neural Spline Flowscited by 596
  11. 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 594
  12. 2020Bayesian Deep Learning and a Probabilistic Perspective of Generalizationcited by 480
23 more
  1. 2018fastMRI: An Open Dataset and Benchmarks for Accelerated MRIcited by 470
  2. 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 434
  3. 2018Assessing Generative Models via Precision and Recallcited by 406
  4. 2018Invertible Residual Networkscited by 365
  5. 2017Compressed Sensing using Generative Modelscited by 339
  6. 2015Probabilistic Backpropagation for Scalable Learning of Bayesian Neural Networkscited by 295
  7. 2017Image reconstruction by domain transform manifold learningcited by 232
  8. 2020Stochastic Normalizing Flowscited by 157
  9. 2018Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in Adamcited by 131
  10. 2019Robust Learning with Jacobian Regularizationcited by 129
  11. 2019Invertible generative models for inverse problems: mitigating representation error and dataset biascited by 94
  12. 2020Understanding and Mitigating Exploding Inverses in Invertible Neural Networkscited by 71
  13. 2020SurVAE Flows: Surjections to Bridge the Gap between VAEs and Flowscited by 71
  14. 2021Intermediate Layer Optimization for Inverse Problems using Deep Generative Modelscited by 70
  15. 2021Simulation Intelligence: Towards a New Generation of Scientific Methodscited by 68
  16. 2020Deep Probabilistic Imaging: Uncertainty Quantification and Multi-modal Solution Characterization for Computational Imagingcited by 57
  17. 2019Reducing Uncertainty in Undersampled MRI Reconstruction with Active Acquisitioncited by 56
  18. 2020Composing Normalizing Flows for Inverse Problemscited by 48
  19. 2020The Expressive Power of a Class of Normalizing Flow Modelscited by 35
  20. 2020Solving Inverse Problems with a Flow-based Noise Modelcited by 31
  21. 2020Modern Monte Carlo Methods for Efficient Uncertainty Quantification and Propagation: A Surveycited by 21
  22. 2020Quantifying Sources of Uncertainty in Deep Learning-Based Image Reconstructioncited by 6
  23. 2022Accelerating Inverse Learning via Intelligent Localization with Exploratory Samplingcited by 2

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.