Preconditioned Langevin Dynamics with Score-Based Generative Models for Infinite-Dimensional Linear Bayesian Inverse Problems
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Designing algorithms for solving high-dimensional Bayesian inverse problems directly in infinite-dimensional function spaces - where such problems are naturally formulated - is crucial to ensure stability and convergence as the discretization of the underlying problem is refined. In this paper, we contribute to this line of work by analyzing a widely used sampler for linear inverse problems: Langevin dynamics driven by score-based generative models (SGMs) acting as priors, formulated directly in function space. Building on the theoretical framework for SGMs in Hilbert spaces, we give a rigorous definition of this sampler in the infinite-dimensional setting and derive, for the first time, error estimates that explicitly depend on the approximation error of the score. As a consequence, we obtain sufficient conditions for global convergence in Kullback-Leibler divergence on the underlying function space. Preventing numerical instabilities requires preconditioning of the Langevin algorithm and we prove the existence and the form of an optimal preconditioner. The preconditioner depends on both the score error and the forward operator and guarantees a uniform convergence rate across all posterior modes. Our analysis applies to both Gaussian and a general class of non-Gaussian priors. Finally, we present examples that illustrate and validate our theoretical findings.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 29 of its 52 references that are in the map. First posted on arXiv 23 May 2025.
Builds on
29 of 52 references.
Closest ancestors · 12
Same direction, newest first
- 2023∞-Diff: Infinite Resolution Diffusion with Subsampled Mollified States31 Mar
- 2023Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generation8 Mar
- 2023Continuous-Time Functional Diffusion Processes1 Mar
- 2023Infinite-Dimensional Diffusion Models20 Feb
- 2023Score-based Diffusion Models in Function Space14 Feb
- 2023Preconditioned Score-based Generative Models13 Feb
- 2022Diffusion Generative Models in Infinite Dimensions1 Dec
- 2022Accelerating Score-based Generative Models with Preconditioned Diffusion Sampling5 Jul
- 2021Conditional Image Generation with Score-Based Diffusion Models26 Nov
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Probabilistic Models19 Jun
- 2020Improved Techniques for Training Score-Based Generative Models16 Jun
Other references · 17
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2021Robust Compressed Sensing MRI with Deep Generative Priorscited by 286
- 2016A Kernelized Stein Discrepancy for Goodness-of-fit Tests and Model Evaluationcited by 236
- 2014Theoretical guarantees for approximate sampling from smooth and log-concave densitiescited by 208
- 2015Non-asymptotic convergence analysis for the Unadjusted Langevin Algorithmcited by 197
- 2021SNIPS: Solving Noisy Inverse Problems Stochasticallycited by 191
- 2016High-dimensional Bayesian inference via the Unadjusted Langevin Algorithmcited by 146
- 2023Score-Based Diffusion Models as Principled Priors for Inverse Imagingcited by 127
- 2024Provably Robust Score-Based Diffusion Posterior Sampling for Plug-and-Play Image Reconstructioncited by 73
- 2023Provable Probabilistic Imaging using Score-Based Generative Priorscited by 51
- 2023Conditional score-based diffusion models for Bayesian inference in infinite dimensionscited by 38
5 more
- 2014Dimension-independent likelihood-informed MCMCcited by 37
- 2023Conditional Optimal Transport on Function Spacescited by 26
- 2024Taming Score-Based Diffusion Priors for Infinite-Dimensional Nonlinear Inverse Problemscited by 7
- 2017Localization for MCMC: sampling high-dimensional posterior distributions with local structurecited by 5
- 2019Multilevel Dimension-Independent Likelihood-Informed MCMC for Large-Scale Inverse Problemscited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Dimension-Free Multimodal Sampling via Preconditioned Annealed Langevin Dynamicscited by 3
- 2026LatentFlow: A General Framework for Conditioning Stochastic Processescited by 2
- 2026Annealed Langevin Posterior Sampling (ALPS): A Rapid Algorithm for Image Restoration with Multiscale Energy Modelscited by 0
- 2026Christoffel-DPS: Optimal sensor placement in diffusion posterior sampling for arbitrary distributionscited by 0
- 2026Dimension-Uniform Discretization Analysis of Preconditioned Annealed Langevin Dynamics for Multimodal Gaussian Mixturescited by 0
- 2026LatentFlow: A General Framework for Conditioning Stochastic Processes14 Jul 2026
- 2026Dimension-Uniform Discretization Analysis of Preconditioned Annealed Langevin Dynamics for Multimodal Gaussian Mixtures15 May 2026
- 2026Christoffel-DPS: Optimal sensor placement in diffusion posterior sampling for arbitrary distributions7 May 2026
- 2026Dimension-Free Multimodal Sampling via Preconditioned Annealed Langevin Dynamics1 Feb 2026
- 2026Annealed Langevin Posterior Sampling (ALPS): A Rapid Algorithm for Image Restoration with Multiscale Energy Models5 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2024Posterior sampling via Langevin dynamics based on generative priors
- 2023Monte Carlo guided Diffusion for Bayesian linear inverse problems
- 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusion
- 2026Discrete Langevin-Inspired Posterior Sampling
- 2025Solving Linear-Gaussian Bayesian Inverse Problems with Decoupled Diffusion Sequential Monte Carlo
- 2026Measurement-Consistent Langevin Corrector for Stabilizing Latent Diffusion Inverse Problem Solvers
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions
- 2023A Complete Recipe for Diffusion Generative Models