mlsanityData to 7 Oct 2026

NF-ULA: Langevin Monte Carlo with Normalizing Flow Prior for Imaging Inverse Problems

arXiv 2304.08342 ↗First posted 17 Apr 2023math.NA cs.CV cs.NAcited by 4

Not on the map. Why?

Abstract (arXiv)

Bayesian methods for solving inverse problems are a powerful alternative to classical methods since the Bayesian approach offers the ability to quantify the uncertainty in the solution. In recent years, data-driven techniques for solving inverse problems have also been remarkably successful, due to their superior representation ability. In this work, we incorporate data-based models into a class of Langevin-based sampling algorithms for Bayesian inference in imaging inverse problems. In particular, we introduce NF-ULA (Normalizing Flow-based Unadjusted Langevin algorithm), which involves learning a normalizing flow (NF) as the image prior. We use NF to learn the prior because a tractable closed-form expression for the log prior enables the differentiation of it using autograd libraries. Our algorithm only requires a normalizing flow-based generative network, which can be pre-trained independently of the considered inverse problem and the forward operator. We perform theoretical analysis by investigating the well-posedness and non-asymptotic convergence of the resulting NF-ULA algorithm. The efficacy of the proposed NF-ULA algorithm is demonstrated in various image restoration problems such as image deblurring, image inpainting, and limited-angle X-ray computed tomography (CT) reconstruction. NF-ULA is found to perform better than competing methods for severely ill-posed inverse problems.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 64 of its 114 references that are in the map. First posted on arXiv 17 Apr 2023.

Builds on

64 of 114 references.

References · 64

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  5. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  6. 2015Variational Inference with Normalizing Flowscited by 2,161
  7. 2016Density estimation using Real NVPcited by 2,029
  8. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
  9. 2016Variational Inference: A Review for Statisticianscited by 1,466
  10. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
  11. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
  12. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
38 more
  1. 2017Deep Image Priorcited by 1,097
  2. 2014NICE: Non-linear Independent Components Estimationcited by 1,052
  3. 2017Masked Autoregressive Flow for Density Estimationcited by 680
  4. 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 636
  5. 2017Generative Adversarial Networks: An Overviewcited by 588
  6. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 514
  7. 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 498
  8. 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 467
  9. 2016Deep Convolutional Neural Network for Inverse Problems in Imagingcited by 431
  10. 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 411
  11. 2016Input Convex Neural Networkscited by 407
  12. 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 303
  13. 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 290
  14. 2017Learned Primal-dual Reconstructioncited by 251
  15. 2020Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulationcited by 225
  16. 2014Theoretical guarantees for approximate sampling from smooth and log-concave densitiescited by 206
  17. 2019Plug-and-Play Methods Provably Converge with Properly Trained Denoiserscited by 197
  18. 2015Non-asymptotic convergence analysis for the Unadjusted Langevin Algorithmcited by 195
  19. 2020Stochastic Normalizing Flowscited by 156
  20. 2018Analysis of Langevin Monte Carlo via convex optimizationcited by 126
  21. 2021Deep Equilibrium Architectures for Inverse Problems in Imagingcited by 126
  22. 2017User-friendly guarantees for the Langevin Monte Carlo with inaccurate gradientcited by 116
  23. 2021Gradient Step Denoiser for convergent Plug-and-Playcited by 107
  24. 2018Adversarial Regularizers in Inverse Problemscited by 102
  25. 2021Bayesian imaging using Plug & Play priors: when Langevin meets Tweediecited by 96
  26. 2022Plug-and-Play Methods for Integrating Physical and Learned Models in Computational Imagingcited by 94
  27. 2019Invertible generative models for inverse problems: mitigating representation error and dataset biascited by 93
  28. 2016Efficient Bayesian computation by proximal Markov chain Monte Carlo: when Langevin meets Moreaucited by 83
  29. 2015Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolationcited by 78
  30. 2018Sharp convergence rates for Langevin dynamics in the nonconvex settingcited by 67
  31. 2020Learning Maximally Monotone Operators for Image Recoverycited by 62
  32. 2020On the Convergence of Langevin Monte Carlo: The Interplay between Tail Growth and Smoothnesscited by 55
  33. 2020Learned convex regularizers for inverse problemscited by 54
  34. 2013Proximal Markov chain Monte Carlo algorithmscited by 46
  35. 2020TorchRadon: Fast Differentiable Routines for Computed Tomographycited by 44
  36. 2022Can Push-forward Generative Models Fit Multimodal Distributions?cited by 41
  37. 2020Convolutional Proximal Neural Networks and Plug-and-Play Algorithmscited by 36
  38. 2018Non-asymptotic bounds for sampling algorithms without log-concavitycited by 35

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 1; 2026: 1.

4 papers.