mlsanityData to 14 Oct 2026

Preconditioned Langevin Dynamics with Score-Based Generative Models for Infinite-Dimensional Linear Bayesian Inverse Problems

arXiv 2505.18276 ↗First posted 23 May 2025stat.ML cs.LG cs.NAcited by 5

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Designing algorithms for solving high-dimensional Bayesian inverse problems directly in infinite-dimensional function spaces - where such problems are naturally formulated - is crucial to ensure stability and convergence as the discretization of the underlying problem is refined. In this paper, we contribute to this line of work by analyzing a widely used sampler for linear inverse problems: Langevin dynamics driven by score-based generative models (SGMs) acting as priors, formulated directly in function space. Building on the theoretical framework for SGMs in Hilbert spaces, we give a rigorous definition of this sampler in the infinite-dimensional setting and derive, for the first time, error estimates that explicitly depend on the approximation error of the score. As a consequence, we obtain sufficient conditions for global convergence in Kullback-Leibler divergence on the underlying function space. Preventing numerical instabilities requires preconditioning of the Langevin algorithm and we prove the existence and the form of an optimal preconditioner. The preconditioner depends on both the score error and the forward operator and guarantees a uniform convergence rate across all posterior modes. Our analysis applies to both Gaussian and a general class of non-Gaussian priors. Finally, we present examples that illustrate and validate our theoretical findings.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 29 of its 52 references that are in the map. First posted on arXiv 23 May 2025.

Builds on

29 of 52 references.

Closest ancestors · 12

Same direction, newest first

  1. 2023∞-Diff: Infinite Resolution Diffusion with Subsampled Mollified States31 Mar
  2. 2023Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generation8 Mar
  3. 2023Continuous-Time Functional Diffusion Processes1 Mar
  4. 2023Infinite-Dimensional Diffusion Models20 Feb
  5. 2023Score-based Diffusion Models in Function Space14 Feb
  6. 2023Preconditioned Score-based Generative Models13 Feb
  7. 2022Diffusion Generative Models in Infinite Dimensions1 Dec
  8. 2022Accelerating Score-based Generative Models with Preconditioned Diffusion Sampling5 Jul
  9. 2021Conditional Image Generation with Score-Based Diffusion Models26 Nov
  10. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  11. 2020Denoising Diffusion Probabilistic Models19 Jun
  12. 2020Improved Techniques for Training Score-Based Generative Models16 Jun

Other references · 17

  1. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  2. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  3. 2021Robust Compressed Sensing MRI with Deep Generative Priorscited by 286
  4. 2016A Kernelized Stein Discrepancy for Goodness-of-fit Tests and Model Evaluationcited by 236
  5. 2014Theoretical guarantees for approximate sampling from smooth and log-concave densitiescited by 208
  6. 2015Non-asymptotic convergence analysis for the Unadjusted Langevin Algorithmcited by 197
  7. 2021SNIPS: Solving Noisy Inverse Problems Stochasticallycited by 191
  8. 2016High-dimensional Bayesian inference via the Unadjusted Langevin Algorithmcited by 146
  9. 2023Score-Based Diffusion Models as Principled Priors for Inverse Imagingcited by 127
  10. 2024Provably Robust Score-Based Diffusion Posterior Sampling for Plug-and-Play Image Reconstructioncited by 73
  11. 2023Provable Probabilistic Imaging using Score-Based Generative Priorscited by 51
  12. 2023Conditional score-based diffusion models for Bayesian inference in infinite dimensionscited by 38
5 more
  1. 2014Dimension-independent likelihood-informed MCMCcited by 37
  2. 2023Conditional Optimal Transport on Function Spacescited by 26
  3. 2024Taming Score-Based Diffusion Priors for Infinite-Dimensional Nonlinear Inverse Problemscited by 7
  4. 2017Localization for MCMC: sampling high-dimensional posterior distributions with local structurecited by 5
  5. 2019Multilevel Dimension-Independent Likelihood-Informed MCMC for Large-Scale Inverse Problemscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Posterior sampling via Langevin dynamics based on generative priors
  2. 2023Monte Carlo guided Diffusion for Bayesian linear inverse problems
  3. 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusion
  4. 2026Discrete Langevin-Inspired Posterior Sampling
  5. 2025Solving Linear-Gaussian Bayesian Inverse Problems with Decoupled Diffusion Sequential Monte Carlo
  6. 2026Measurement-Consistent Langevin Corrector for Stabilizing Latent Diffusion Inverse Problem Solvers
  7. 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions
  8. 2023A Complete Recipe for Diffusion Generative Models