mlsanityData to 7 Oct 2026

Dimension-Free Multimodal Sampling via Preconditioned Annealed Langevin Dynamics

arXiv 2602.01449 ↗First posted 1 Feb 2026math.NA cs.NA math.PRcited by 2

Not on the map. Why?

Abstract (arXiv)

Designing sampling algorithms for multimodal targets that remain stable under refinement of the finite-dimensional approximation of an underlying function-space problem is a central challenge. Annealed Langevin dynamics (ALD) is a natural alternative to classical Langevin in this context, since it is often observed to improve exploration across modes. Yet a gap remains between its empirical success and existing theory: under which conditions can ALD be guaranteed to remain stable across dimensions? In this paper, we bridge this gap by providing a uniform-in-dimension analysis of continuous-time ALD for Gaussian-mixture targets. Along an explicit annealing path obtained by gradually removing Gaussian smoothing from the target, we identify spectral conditions linking the smoothing covariance to the component covariances under which ALD achieves a prescribed accuracy in Kullback-Leibler divergence within a dimension-uniform time horizon. We then establish stability in a perturbative regime with imperfect initialization and approximate scores. Under a misspecified-mixture score model, we show that preconditioning ALD with an operator whose spectrum decays sufficiently fast prevents error terms from accumulating across coordinates and thereby preserves dimension-uniform control.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 39 of its 66 references that are in the map. First posted on arXiv 1 Feb 2026.

Builds on

39 of 66 references.

References · 39

  1. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  2. 2022Classifier-Free Diffusion Guidancecited by 5,717
  3. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  4. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
  5. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
  6. 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 440
  7. 2019Rapid Convergence of the Unadjusted Langevin Algorithm: Isoperimetry Sufficescited by 224
  8. 2014Theoretical guarantees for approximate sampling from smooth and log-concave densitiescited by 206
  9. 2015Non-asymptotic convergence analysis for the Unadjusted Langevin Algorithmcited by 195
  10. 2016High-dimensional Bayesian inference via the Unadjusted Langevin Algorithmcited by 144
  11. 2018Analysis of Langevin Monte Carlo via convex optimizationcited by 126
  12. 2020Generative Modeling with Denoising Auto-Encoders and Langevin Samplingcited by 118
27 more
  1. 2017User-friendly guarantees for the Langevin Monte Carlo with inaccurate gradientcited by 116
  2. 2023Score-based Diffusion Models in Function Spacecited by 80
  3. 2024Classifier-Free Guidance is a Predictor-Correctorcited by 79
  4. 2018Sampling Can Be Faster Than Optimizationcited by 68
  5. 2024Analysis of Classifier-Free Guidance Weight Schedulerscited by 64
  6. 2023Provable Probabilistic Imaging using Score-Based Generative Priorscited by 51
  7. 2022Diffusion Generative Models in Infinite Dimensionscited by 49
  8. 2024Theoretical Insights for Diffusion Guidance: A Case Study for Gaussian Mixture Modelscited by 46
  9. 2023Continuous-Time Functional Diffusion Processescited by 39
  10. 2023Infinite-Dimensional Diffusion Modelscited by 38
  11. 2023Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generationcited by 37
  12. 2023Conditional score-based diffusion models for Bayesian inference in infinite dimensionscited by 37
  13. 2014Dimension-independent likelihood-informed MCMCcited by 36
  14. 2024Consistency-diversity-realism Pareto fronts of conditional image generative modelscited by 35
  15. 2017Beyond Log-concavity: Provable Guarantees for Sampling Multi-modal Distributions using Simulated Tempering Langevin Monte Carlocited by 33
  16. 2024Provable Benefit of Annealed Langevin Monte Carlo for Non-log-concave Samplingcited by 23
  17. 2023∞-Diff: Infinite Resolution Diffusion with Subsampled Mollified Statescited by 21
  18. 2022Annealed Langevin Dynamics for Massive MIMO Detectioncited by 16
  19. 2025Navigating with Annealing Guidance Scale in Diffusion Spacecited by 11
  20. 2025Non-asymptotic Analysis of Diffusion Annealed Langevin Monte Carlo for Generative Modellingcited by 10
  21. 2025Classifier-Free Guidance: From High-Dimensional Analysis to Generalized Guidance Formscited by 9
  22. 2016Quantifying the accuracy of approximate diffusions and Markov chainscited by 7
  23. 2024Taming Score-Based Diffusion Priors for Infinite-Dimensional Nonlinear Inverse Problemscited by 7
  24. 2022On free energy barriers in Gaussian priors and failure of cold start MCMC for high-dimensional unimodal distributionscited by 6
  25. 2025Preconditioned Langevin Dynamics with Score-Based Generative Models for Infinite-Dimensional Linear Bayesian Inverse Problemscited by 5
  26. 2024Sampling from multi-modal distributions with polynomial query complexity in fixed dimension via reverse diffusioncited by 4
  27. 2025Diffusion annealed Langevin dynamics: a theoretical studycited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.