NF-ULA: Langevin Monte Carlo with Normalizing Flow Prior for Imaging Inverse Problems
Not on the map. Why?
Abstract (arXiv)
Bayesian methods for solving inverse problems are a powerful alternative to classical methods since the Bayesian approach offers the ability to quantify the uncertainty in the solution. In recent years, data-driven techniques for solving inverse problems have also been remarkably successful, due to their superior representation ability. In this work, we incorporate data-based models into a class of Langevin-based sampling algorithms for Bayesian inference in imaging inverse problems. In particular, we introduce NF-ULA (Normalizing Flow-based Unadjusted Langevin algorithm), which involves learning a normalizing flow (NF) as the image prior. We use NF to learn the prior because a tractable closed-form expression for the log prior enables the differentiation of it using autograd libraries. Our algorithm only requires a normalizing flow-based generative network, which can be pre-trained independently of the considered inverse problem and the forward operator. We perform theoretical analysis by investigating the well-posedness and non-asymptotic convergence of the resulting NF-ULA algorithm. The efficacy of the proposed NF-ULA algorithm is demonstrated in various image restoration problems such as image deblurring, image inpainting, and limited-angle X-ray computed tomography (CT) reconstruction. NF-ULA is found to perform better than competing methods for severely ill-posed inverse problems.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 64 of its 114 references that are in the map. First posted on arXiv 17 Apr 2023.
Builds on
64 of 114 references.
References · 64
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2016Density estimation using Real NVPcited by 2,029
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
- 2016Variational Inference: A Review for Statisticianscited by 1,466
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
38 more
- 2017Deep Image Priorcited by 1,097
- 2014NICE: Non-linear Independent Components Estimationcited by 1,052
- 2017Masked Autoregressive Flow for Density Estimationcited by 680
- 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 636
- 2017Generative Adversarial Networks: An Overviewcited by 588
- 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 514
- 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 498
- 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 467
- 2016Deep Convolutional Neural Network for Inverse Problems in Imagingcited by 431
- 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 411
- 2016Input Convex Neural Networkscited by 407
- 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 303
- 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 290
- 2017Learned Primal-dual Reconstructioncited by 251
- 2020Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulationcited by 225
- 2014Theoretical guarantees for approximate sampling from smooth and log-concave densitiescited by 206
- 2019Plug-and-Play Methods Provably Converge with Properly Trained Denoiserscited by 197
- 2015Non-asymptotic convergence analysis for the Unadjusted Langevin Algorithmcited by 195
- 2020Stochastic Normalizing Flowscited by 156
- 2018Analysis of Langevin Monte Carlo via convex optimizationcited by 126
- 2021Deep Equilibrium Architectures for Inverse Problems in Imagingcited by 126
- 2017User-friendly guarantees for the Langevin Monte Carlo with inaccurate gradientcited by 116
- 2021Gradient Step Denoiser for convergent Plug-and-Playcited by 107
- 2018Adversarial Regularizers in Inverse Problemscited by 102
- 2021Bayesian imaging using Plug & Play priors: when Langevin meets Tweediecited by 96
- 2022Plug-and-Play Methods for Integrating Physical and Learned Models in Computational Imagingcited by 94
- 2019Invertible generative models for inverse problems: mitigating representation error and dataset biascited by 93
- 2016Efficient Bayesian computation by proximal Markov chain Monte Carlo: when Langevin meets Moreaucited by 83
- 2015Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolationcited by 78
- 2018Sharp convergence rates for Langevin dynamics in the nonconvex settingcited by 67
- 2020Learning Maximally Monotone Operators for Image Recoverycited by 62
- 2020On the Convergence of Langevin Monte Carlo: The Interplay between Tail Growth and Smoothnesscited by 55
- 2020Learned convex regularizers for inverse problemscited by 54
- 2013Proximal Markov chain Monte Carlo algorithmscited by 46
- 2020TorchRadon: Fast Differentiable Routines for Computed Tomographycited by 44
- 2022Can Push-forward Generative Models Fit Multimodal Distributions?cited by 41
- 2020Convolutional Proximal Neural Networks and Plug-and-Play Algorithmscited by 36
- 2018Non-asymptotic bounds for sampling algorithms without log-concavitycited by 35
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2024: 2; 2025: 1; 2026: 1.
4 papers.
- 2024Stability of Data-Dependent Ridge-Regularization for Inverse Problemscited by 5
- 2025Efficient Bayesian Computation Using Plug-and-Play Priors for Poisson Inverse Problemscited by 2
- 2024Equivariant Test-Time Training with Operator Sketching for Imaging Inverse Problemscited by 0
- 2026The Practicality of Normalizing Flow Test-Time Training in Bayesian Inference for Agent-Based Modelscited by 0
- 2026The Practicality of Normalizing Flow Test-Time Training in Bayesian Inference for Agent-Based Models12 Jan 2026
- 2025Efficient Bayesian Computation Using Plug-and-Play Priors for Poisson Inverse Problems20 Mar 2025
- 2024Equivariant Test-Time Training with Operator Sketching for Imaging Inverse Problems8 Nov 2024
- 2024Stability of Data-Dependent Ridge-Regularization for Inverse Problems18 Jun 2024