Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisited
Not on the map. Why?
Abstract (arXiv)
We revisit the problem of sampling from a target distribution that has a smooth strongly log-concave density everywhere in mathbb Rp. In this context, if no additional density information is available, the randomized midpoint discretization for the kinetic Langevin diffusion is known to be the most scalable method in high dimensions with large condition numbers. Our main result is a nonasymptotic and easy to compute upper bound on the Wasserstein-2 error of this method. To provide a more thorough explanation of our method for establishing the computable upper bound, we conduct an analysis of the midpoint discretization for the vanilla Langevin process. This analysis helps to clarify the underlying principles and provides valuable insights that we use to establish an improved upper bound for the kinetic Langevin process with the midpoint discretization. Furthermore, by applying these techniques we establish new guarantees for the kinetic Langevin process with Euler discretization, which have a better dependence on the condition number than existing upper bounds.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 30 of its 49 references that are in the map. First posted on arXiv 14 Jun 2023.
Builds on
30 of 49 references.
References · 30
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2021What Are Bayesian Neural Network Posteriors Really Like?cited by 307
- 2017Non-convex learning via Stochastic Gradient Langevin Dynamics: a nonasymptotic analysiscited by 242
- 2019Rapid Convergence of the Unadjusted Langevin Algorithm: Isoperimetry Sufficescited by 224
- 2014Theoretical guarantees for approximate sampling from smooth and log-concave densitiescited by 206
- 2015Non-asymptotic convergence analysis for the Unadjusted Langevin Algorithmcited by 195
- 2016High-dimensional Bayesian inference via the Unadjusted Langevin Algorithmcited by 144
- 2017Underdamped Langevin MCMC: A non-asymptotic analysiscited by 131
- 2018Analysis of Langevin Monte Carlo via convex optimizationcited by 126
- 2018Log-concave sampling: Metropolis-Hastings algorithms are fastcited by 117
- 2017User-friendly guarantees for the Langevin Monte Carlo with inaccurate gradientcited by 116
- 2019Subspace Inference for Bayesian Deep Learningcited by 94
18 more
- 2016Efficient Bayesian computation by proximal Markov chain Monte Carlo: when Langevin meets Moreaucited by 83
- 2019The Randomized Midpoint Method for Log-Concave Samplingcited by 77
- 2018Sampling Can Be Faster Than Optimizationcited by 68
- 2018Sharp convergence rates for Langevin dynamics in the nonconvex settingcited by 67
- 2022Towards a Theory of Non-Log-Concave Sampling: First-Order Stationarity Guarantees for Langevin Monte Carlocited by 63
- 2018On sampling from a log-concave density using kinetic Langevin diffusionscited by 61
- 2020On the Convergence of Langevin Monte Carlo: The Interplay between Tail Growth and Smoothnesscited by 55
- 2018Global Non-convex Optimization with Discretized Diffusionscited by 44
- 2017Sampling from a log-concave distribution with compact support with proximal Langevin Monte Carlocited by 43
- 2020Convergence of Langevin Monte Carlo in Chi-Squared and Renyi Divergencecited by 42
- 2019Improved Bounds for Discretization of Langevin Diffusions: Near-Optimal Rates without Convexitycited by 38
- 2020Exponential ergodicity of mirror-Langevin diffusionscited by 37
- 2019High-Order Langevin Diffusion Yields an Accelerated MCMC Algorithmcited by 36
- 2023Towards a Complete Analysis of Langevin Monte Carlo: Beyond Poincar'e Inequalitycited by 31
- 2019Langevin Monte Carlo without smoothnesscited by 27
- 2023Improved Discretization Analysis for Underdamped Langevin Monte Carlocited by 26
- 2020On the Ergodicity, Bias and Asymptotic Normality of Randomized Midpoint Sampling Methodcited by 23
- 2019Bounding the error of discretized Langevin algorithms for non-strongly log-concave targetscited by 16
Built on by
Citing papers per year: 2024: 4; 2025: 5; 2026: 1.
10 papers.
- 2024Faster Diffusion Sampling with Randomized Midpoints: Sequential and Parallelcited by 29
- 2025Advancing Wasserstein Convergence Analysis of Score-Based Models: Insights from Discretization and Second-Order Accelerationcited by 17
- 2024Parallelized Midpoint Randomization for Langevin Monte Carlocited by 9
- 2025Assessing the Quality of Denoising Diffusion Models in Wasserstein Distance: Noisy Score and Optimal Boundscited by 8
- 2024The Poisson Midpoint Method for Langevin Dynamics: Provably Efficient Discretization for Diffusion Modelscited by 6
- 2024Randomized Midpoint Method for Log-Concave Sampling under Constraintscited by 2
- 2025Beyond Propagation of Chaos: A Stochastic Algorithm for Mean Field Optimizationcited by 1
- 2026Error estimates for tamed Euler and Randomized Euler schemes for SDEs with locally Lipschitz drift with applications to non-logconcave sampling and optimizationcited by 1
- 2025Poisson Midpoint Method for Log Concave Sampling: Beyond the Strong Error Lower Boundscited by 0
- 2025When Langevin Monte Carlo Meets Randomization: New Sampling Algorithms with Non-asymptotic Error Bounds beyond Log-Concavity and Gradient Lipschitznesscited by 0
- 2026Error estimates for tamed Euler and Randomized Euler schemes for SDEs with locally Lipschitz drift with applications to non-logconcave sampling and optimization24 May 2026
- 2025When Langevin Monte Carlo Meets Randomization: New Sampling Algorithms with Non-asymptotic Error Bounds beyond Log-Concavity and Gradient Lipschitzness30 Sep 2025
- 2025Assessing the Quality of Denoising Diffusion Models in Wasserstein Distance: Noisy Score and Optimal Bounds11 Jun 2025
- 2025Poisson Midpoint Method for Log Concave Sampling: Beyond the Strong Error Lower Bounds9 Jun 2025
- 2025Beyond Propagation of Chaos: A Stochastic Algorithm for Mean Field Optimization17 Mar 2025
- 2025Advancing Wasserstein Convergence Analysis of Score-Based Models: Insights from Discretization and Second-Order Acceleration7 Feb 2025
- 2024Faster Diffusion Sampling with Randomized Midpoints: Sequential and Parallel3 Jun 2024
- 2024The Poisson Midpoint Method for Langevin Dynamics: Provably Efficient Discretization for Diffusion Models27 May 2024
- 2024Randomized Midpoint Method for Log-Concave Sampling under Constraints24 May 2024
- 2024Parallelized Midpoint Randomization for Langevin Monte Carlo22 Feb 2024