Taming Score-Based Diffusion Priors for Infinite-Dimensional Nonlinear Inverse Problems
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
This work introduces a sampling method capable of solving Bayesian inverse problems in function space. It does not assume the log-concavity of the likelihood, meaning that it is compatible with nonlinear inverse problems. The method leverages the recently defined infinite-dimensional score-based diffusion models as a learning-based prior, while enabling provable posterior sampling through a Langevin-type MCMC algorithm defined on function spaces. A novel convergence analysis is conducted, inspired by the fixed-point methods established for traditional regularization-by-denoising algorithms and compatible with weighted annealing. The obtained convergence bound explicitly depends on the approximation error of the score; a well-approximated score is essential to obtain a well-approximated posterior. Stylized and PDE-based examples are provided, demonstrating the validity of our convergence analysis. We conclude by presenting a discussion of the method's challenges related to learning the score and computational complexity.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 45 of its 114 references that are in the map. First posted on arXiv 24 May 2024.
Builds on
45 of 114 references.
Closest ancestors · 5
Same direction, newest first
- 2024Provably Robust Score-Based Diffusion Posterior Sampling for Plug-and-Play Image Reconstruction25 Mar
- 2023Variational Bayesian Imaging with an Efficient Surrogate Score-based Prior5 Sep
- 2023Conditional score-based diffusion models for Bayesian inference in infinite dimensions28 May
- 2023Score-Based Diffusion Models as Principled Priors for Inverse Imaging23 Apr
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problems29 Sep
Other references · 40
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2022Video Diffusion Modelscited by 2,305
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,043
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 602
- 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 521
- 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 516
28 more
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 445
- 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 307
- 2021Robust Compressed Sensing MRI with Deep Generative Priorscited by 286
- 2022Diffusion Probabilistic Modeling for Video Generationcited by 238
- 2014Theoretical guarantees for approximate sampling from smooth and log-concave densitiescited by 208
- 2015Non-asymptotic convergence analysis for the Unadjusted Langevin Algorithmcited by 197
- 2021Conditional Image Generation with Score-Based Diffusion Modelscited by 197
- 2021SNIPS: Solving Noisy Inverse Problems Stochasticallycited by 191
- 2016High-dimensional Bayesian inference via the Unadjusted Langevin Algorithmcited by 146
- 2015Preconditioned Stochastic Gradient Langevin Dynamics for Deep Neural Networkscited by 121
- 2020Generative Modeling with Denoising Auto-Encoders and Langevin Samplingcited by 119
- 2018Regularization by Denoising: Clarifications and New Interpretationscited by 103
- 2021Bayesian imaging using Plug & Play priors: when Langevin meets Tweediecited by 97
- 2021Soft Truncation: A Universal Training Technique of Score-based Diffusion Model for High Precision Score Estimationcited by 97
- 2023Score-based Diffusion Models in Function Spacecited by 82
- 2014Consistency and fluctuations for stochastic gradient Langevin dynamicscited by 65
- 2022Towards a Theory of Non-Log-Concave Sampling: First-Order Stationarity Guarantees for Langevin Monte Carlocited by 63
- 2017Plug-and-Play Unplugged: Optimization Free Reconstruction using Consensus Equilibriumcited by 58
- 2023Provable Probabilistic Imaging using Score-Based Generative Priorscited by 51
- 2022Diffusion Generative Models in Infinite Dimensionscited by 49
- 2023Continuous-Time Functional Diffusion Processescited by 39
- 2023Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generationcited by 37
- 2023Conditional Optimal Transport on Function Spacescited by 26
- 2023∞-Diff: Infinite Resolution Diffusion with Subsampled Mollified Statescited by 21
- 2020Dimension-free convergence rates for gradient Langevin dynamics in RKHScited by 6
- 2015Nonparametric Bayesian posterior contraction rates for discretely observed scalar diffusionscited by 5
- 2017Localization for MCMC: sampling high-dimensional posterior distributions with local structurecited by 5
- 2019Multilevel Dimension-Independent Likelihood-Informed MCMC for Large-Scale Inverse Problemscited by 3
Built on by
Citing papers per year: 2025: 2; 2026: 5.
7 papers.
- 2025Bifidelity Parameter Estimation Using Conditional Diffusion Modelscited by 7
- 2025Preconditioned Langevin Dynamics with Score-Based Generative Models for Infinite-Dimensional Linear Bayesian Inverse Problemscited by 5
- 2026Dimension-Free Multimodal Sampling via Preconditioned Annealed Langevin Dynamicscited by 3
- 2026LatentFlow: A General Framework for Conditioning Stochastic Processescited by 2
- 2026Stochastic Interpolants in Hilbert Spacescited by 0
- 2026SPDE Methods for Nonparametric Bayesian Posterior Contraction and Laplace Approximationcited by 0
- 2026Dimension-Uniform Discretization Analysis of Preconditioned Annealed Langevin Dynamics for Multimodal Gaussian Mixturescited by 0
- 2026LatentFlow: A General Framework for Conditioning Stochastic Processes14 Jul 2026
- 2026Dimension-Uniform Discretization Analysis of Preconditioned Annealed Langevin Dynamics for Multimodal Gaussian Mixtures15 May 2026
- 2026SPDE Methods for Nonparametric Bayesian Posterior Contraction and Laplace Approximation23 Mar 2026
- 2026Stochastic Interpolants in Hilbert Spaces2 Feb 2026
- 2026Dimension-Free Multimodal Sampling via Preconditioned Annealed Langevin Dynamics1 Feb 2026
- 2025Preconditioned Langevin Dynamics with Score-Based Generative Models for Infinite-Dimensional Linear Bayesian Inverse Problems23 May 2025
- 2025Bifidelity Parameter Estimation Using Conditional Diffusion Models2 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2026Supervised Guidance Training for Infinite-Dimensional Diffusion Models
- 2025Solving Inverse Problems via Diffusion-Based Priors: An Approximation-Free Ensemble Sampling Approach
- 2023Monte Carlo guided Diffusion for Bayesian linear inverse problems
- 2024Divide-and-Conquer Posterior Sampling for Denoising Diffusion Priors
- 2026Noise-Adaptive Diffusion Sampling for Inverse Problems Without Task-Specific Tuning
- 2024Think Twice Before You Act: Improving Inverse Problem Solving With MCMC
- 2024Improving Diffusion Inverse Problem Solving with Decoupled Noise Annealing
- 2024An Unconditional Representation of the Conditional Score in Infinite-Dimensional Linear Inverse Problems