mlsanityData to 14 Oct 2026

Taming Score-Based Diffusion Priors for Infinite-Dimensional Nonlinear Inverse Problems

arXiv 2405.15676 ↗First posted 24 May 2024stat.ML cs.LG cs.NAcited by 7

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

This work introduces a sampling method capable of solving Bayesian inverse problems in function space. It does not assume the log-concavity of the likelihood, meaning that it is compatible with nonlinear inverse problems. The method leverages the recently defined infinite-dimensional score-based diffusion models as a learning-based prior, while enabling provable posterior sampling through a Langevin-type MCMC algorithm defined on function spaces. A novel convergence analysis is conducted, inspired by the fixed-point methods established for traditional regularization-by-denoising algorithms and compatible with weighted annealing. The obtained convergence bound explicitly depends on the approximation error of the score; a well-approximated score is essential to obtain a well-approximated posterior. Stylized and PDE-based examples are provided, demonstrating the validity of our convergence analysis. We conclude by presenting a discussion of the method's challenges related to learning the score and computational complexity.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 45 of its 114 references that are in the map. First posted on arXiv 24 May 2024.

Builds on

45 of 114 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024Provably Robust Score-Based Diffusion Posterior Sampling for Plug-and-Play Image Reconstruction25 Mar
  2. 2023Variational Bayesian Imaging with an Efficient Surrogate Score-based Prior5 Sep
  3. 2023Conditional score-based diffusion models for Bayesian inference in infinite dimensions28 May
  4. 2023Score-Based Diffusion Models as Principled Priors for Inverse Imaging23 Apr
  5. 2022Diffusion Posterior Sampling for General Noisy Inverse Problems29 Sep

Other references · 40

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  6. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  7. 2022Video Diffusion Modelscited by 2,305
  8. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
  9. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,043
  10. 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 602
  11. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 521
  12. 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 516
28 more
  1. 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 445
  2. 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 307
  3. 2021Robust Compressed Sensing MRI with Deep Generative Priorscited by 286
  4. 2022Diffusion Probabilistic Modeling for Video Generationcited by 238
  5. 2014Theoretical guarantees for approximate sampling from smooth and log-concave densitiescited by 208
  6. 2015Non-asymptotic convergence analysis for the Unadjusted Langevin Algorithmcited by 197
  7. 2021Conditional Image Generation with Score-Based Diffusion Modelscited by 197
  8. 2021SNIPS: Solving Noisy Inverse Problems Stochasticallycited by 191
  9. 2016High-dimensional Bayesian inference via the Unadjusted Langevin Algorithmcited by 146
  10. 2015Preconditioned Stochastic Gradient Langevin Dynamics for Deep Neural Networkscited by 121
  11. 2020Generative Modeling with Denoising Auto-Encoders and Langevin Samplingcited by 119
  12. 2018Regularization by Denoising: Clarifications and New Interpretationscited by 103
  13. 2021Bayesian imaging using Plug & Play priors: when Langevin meets Tweediecited by 97
  14. 2021Soft Truncation: A Universal Training Technique of Score-based Diffusion Model for High Precision Score Estimationcited by 97
  15. 2023Score-based Diffusion Models in Function Spacecited by 82
  16. 2014Consistency and fluctuations for stochastic gradient Langevin dynamicscited by 65
  17. 2022Towards a Theory of Non-Log-Concave Sampling: First-Order Stationarity Guarantees for Langevin Monte Carlocited by 63
  18. 2017Plug-and-Play Unplugged: Optimization Free Reconstruction using Consensus Equilibriumcited by 58
  19. 2023Provable Probabilistic Imaging using Score-Based Generative Priorscited by 51
  20. 2022Diffusion Generative Models in Infinite Dimensionscited by 49
  21. 2023Continuous-Time Functional Diffusion Processescited by 39
  22. 2023Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generationcited by 37
  23. 2023Conditional Optimal Transport on Function Spacescited by 26
  24. 2023∞-Diff: Infinite Resolution Diffusion with Subsampled Mollified Statescited by 21
  25. 2020Dimension-free convergence rates for gradient Langevin dynamics in RKHScited by 6
  26. 2015Nonparametric Bayesian posterior contraction rates for discretely observed scalar diffusionscited by 5
  27. 2017Localization for MCMC: sampling high-dimensional posterior distributions with local structurecited by 5
  28. 2019Multilevel Dimension-Independent Likelihood-Informed MCMC for Large-Scale Inverse Problemscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 5.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Supervised Guidance Training for Infinite-Dimensional Diffusion Models
  2. 2025Solving Inverse Problems via Diffusion-Based Priors: An Approximation-Free Ensemble Sampling Approach
  3. 2023Monte Carlo guided Diffusion for Bayesian linear inverse problems
  4. 2024Divide-and-Conquer Posterior Sampling for Denoising Diffusion Priors
  5. 2026Noise-Adaptive Diffusion Sampling for Inverse Problems Without Task-Specific Tuning
  6. 2024Think Twice Before You Act: Improving Inverse Problem Solving With MCMC
  7. 2024Improving Diffusion Inverse Problem Solving with Decoupled Noise Annealing
  8. 2024An Unconditional Representation of the Conditional Score in Infinite-Dimensional Linear Inverse Problems