mlsanityData to 13 Oct 2026

Mixing Time of the Proximal Sampler in Relative Fisher Information via Strong Data Processing Inequality

arXiv 2502.05623 ↗First posted 8 Feb 2025cs.IT cs.LG math.ITcited by 11

Not on the map. Why?

Abstract (arXiv)

We study the mixing time guarantee for sampling in relative Fisher information via the Proximal Sampler algorithm, which is an approximate proximal discretization of the Langevin dynamics. We show that when the target probability distribution is strongly log-concave, the relative Fisher information converges exponentially fast along the Proximal Sampler; this matches the exponential convergence rate of the relative Fisher information along the continuous-time Langevin dynamics for strongly log-concave target. When combined with a standard implementation of the Proximal Sampler via rejection sampling, this exponential convergence rate provides a high-accuracy iteration complexity guarantee for the Proximal Sampler in relative Fisher information when the target distribution is strongly log-concave and log-smooth. Our proof proceeds by establishing a strong data processing inequality for relative Fisher information along the Gaussian channel under strong log-concavity, and a data processing inequality along the reverse Gaussian channel for a special distribution. The forward and reverse Gaussian channels compose to form the Proximal Sampler, and these data processing inequalities imply the exponential convergence rate of the relative Fisher information along the Proximal Sampler.

Key facts. Cited by 11 papers in the map (data through 13 Oct 2026). Builds on 33 of its 65 references that are in the map. First posted on arXiv 8 Feb 2025.

Builds on

33 of 65 references.

References · 33

  1. 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 441
  2. 2019Rapid Convergence of the Unadjusted Langevin Algorithm: Isoperimetry Sufficescited by 224
  3. 2014Theoretical guarantees for approximate sampling from smooth and log-concave densitiescited by 207
  4. 2015Non-asymptotic convergence analysis for the Unadjusted Langevin Algorithmcited by 195
  5. 2018Analysis of Langevin Monte Carlo via convex optimizationcited by 126
  6. 2018Sampling as optimization in the space of measures: The Langevin dynamics as a composite optimization problemcited by 123
  7. 2018Log-concave sampling: Metropolis-Hastings algorithms are fastcited by 117
  8. 2017Convergence of Langevin MCMC in KL-divergencecited by 87
  9. 2020Structured Logconcave Sampling with a Restricted Gaussian Oraclecited by 85
  10. 2022Improved analysis for a proximal algorithm for samplingcited by 72
  11. 2022Towards a Theory of Non-Log-Concave Sampling: First-Order Stationarity Guarantees for Langevin Monte Carlocited by 63
  12. 2024Optimal score estimation via empirical Bayes smoothingcited by 60
21 more
  1. 2020Optimal dimension dependence of the Metropolis-Adjusted Langevin Algorithmcited by 57
  2. 2019Fast mixing of Metropolized Hamiltonian Monte Carlo: Benefits of multi-step gradientscited by 51
  3. 2022Private Convex Optimization via Exponential Mechanismcited by 47
  4. 2021Minimax Mixing Time of the Metropolis-Adjusted Langevin Algorithm for Log-Concave Samplingcited by 44
  5. 2023Faster high-accuracy log-concave sampling via algorithmic warm startscited by 44
  6. 2023Improved dimension dependence of a proximal algorithm for samplingcited by 29
  7. 2021A Proximal Algorithm for Sampling from Non-smooth Potentialscited by 23
  8. 2022Resolving the Mixing Time of the Langevin Algorithm to its Stationary Distribution for Log-Concave Samplingcited by 22
  9. 2016Auxiliary gradient-based sampling algorithmscited by 21
  10. 2022A Proximal Algorithm for Samplingcited by 21
  11. 2021The query complexity of sampling from strongly log-concave distributions in one dimensioncited by 18
  12. 2024In-and-Out: Algorithmic Diffusion for Sampling Convex Bodiescited by 18
  13. 2022Fisher information lower bounds for samplingcited by 12
  14. 2024Fast Convergence of Phi-Divergence Along the Unadjusted Langevin Algorithm and Proximal Samplercited by 10
  15. 2023A Simple Proof of the Mixing of Metropolis-Adjusted Langevin Algorithm under Smoothness and Isoperimetrycited by 7
  16. 2023Fast Conditional Mixing of MCMC Algorithms for Non-log-concave Distributionscited by 5
  17. 2024Characterizing Dependence of Samples along the Langevin Dynamics and Algorithms via Contraction of Phi-Mutual Informationcited by 5
  18. 2024Proximal Oracles for Optimization and Samplingcited by 5
  19. 2024Coupled Wasserstein Gradient Flows for Min-Max and Cooperative Gamescited by 4
  20. 2024On the Convergence of Min-Max Langevin Dynamics and Algorithmcited by 3
  21. 2024Fisher information dissipation for time inhomogeneous stochastic differential equationscited by 2

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 7; 2026: 4.

11 papers.