Fast Convergence of Phi-Divergence Along the Unadjusted Langevin Algorithm and Proximal Sampler
Not on the map. Why?
Abstract (arXiv)
We study the mixing time of two popular discrete-time Markov chains in continuous space, the Unadjusted Langevin Algorithm and the Proximal Sampler, which are discretizations of the Langevin dynamics. We extend mixing time analyses for these Markov chains to hold in Phi-divergence. We show that any Phi-divergence arising from a twice-differentiable strictly convex function Phi converges to 0 exponentially fast along these Markov chains, under the assumption that their stationary distributions satisfy the corresponding Phi-Sobolev inequality, which holds for example when the target distribution of the Langevin dynamics is strongly log-concave. Our setting includes as special cases popular mixing time regimes, namely the mixing in chi-squared divergence under a Poincar'e inequality, and the mixing in relative entropy under a log-Sobolev inequality. Our results follow by viewing the sampling algorithms as noisy channels and bounding the contraction coefficients arising in the appropriate strong data processing inequalities.
Key facts. Cited by 10 papers in the map (data through 13 Oct 2026). Builds on 16 of its 55 references that are in the map. First posted on arXiv 14 Oct 2024.
Builds on
16 of 55 references.
References · 16
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 917
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 441
- 2019Rapid Convergence of the Unadjusted Langevin Algorithm: Isoperimetry Sufficescited by 224
- 2018Sampling as optimization in the space of measures: The Langevin dynamics as a composite optimization problemcited by 123
- 2017Convergence of Langevin MCMC in KL-divergencecited by 87
- 2020Structured Logconcave Sampling with a Restricted Gaussian Oraclecited by 85
- 2022Improved analysis for a proximal algorithm for samplingcited by 72
- 2023Faster high-accuracy log-concave sampling via algorithmic warm startscited by 44
- 2023Improved dimension dependence of a proximal algorithm for samplingcited by 29
- 2019Langevin Monte Carlo without smoothnesscited by 27
- 2021A Proximal Algorithm for Sampling from Non-smooth Potentialscited by 23
- 2022Resolving the Mixing Time of the Langevin Algorithm to its Stationary Distribution for Log-Concave Samplingcited by 22
4 more
- 2019An Efficient Sampling Algorithm for Non-smooth Composite Potentialscited by 19
- 2021The query complexity of sampling from strongly log-concave distributions in one dimensioncited by 18
- 2024In-and-Out: Algorithmic Diffusion for Sampling Convex Bodiescited by 18
- 2024The Sample Complexity of Simple Binary Hypothesis Testingcited by 8
Built on by
Citing papers per year: 2025: 6; 2026: 4.
10 papers.
- 2025Mixing Time of the Proximal Sampler in Relative Fisher Information via Strong Data Processing Inequalitycited by 11
- 2025Beyond Scores: Proximal Diffusion Modelscited by 3
- 2025Oracle-based Uniform Sampling from Convex Bodiescited by 3
- 2026A Non-asymptotic Analysis for Learning and Applying a Preconditioner in MCMCcited by 2
- 2025Mixing Times and Privacy Analysis for the Projected Langevin Algorithm under a Modulus of Continuitycited by 0
- 2025Improved sampling algorithms and functional inequalities for non-log-concave distributionscited by 0
- 2025A transport approach to the cutoff phenomenoncited by 0
- 2026Functional Stochastic Localizationcited by 0
- 2026Local and Global Contraction Principles for MCMC Mixingcited by 0
- 2026Local Geometric Mixing via Dobrushin Contraction with Applications to Diffusion Path Monte Carlo and the Proximal Samplercited by 0
- 2026Local Geometric Mixing via Dobrushin Contraction with Applications to Diffusion Path Monte Carlo and the Proximal Sampler23 Sep 2026
- 2026Local and Global Contraction Principles for MCMC Mixing2 Jun 2026
- 2026A Non-asymptotic Analysis for Learning and Applying a Preconditioner in MCMC11 Feb 2026
- 2026Functional Stochastic Localization3 Feb 2026
- 2025Oracle-based Uniform Sampling from Convex Bodies3 Oct 2025
- 2025A transport approach to the cutoff phenomenon10 Sep 2025
- 2025Improved sampling algorithms and functional inequalities for non-log-concave distributions15 Jul 2025
- 2025Beyond Scores: Proximal Diffusion Models11 Jul 2025
- 2025Mixing Time of the Proximal Sampler in Relative Fisher Information via Strong Data Processing Inequality8 Feb 2025
- 2025Mixing Times and Privacy Analysis for the Projected Langevin Algorithm under a Modulus of Continuity7 Jan 2025