High-Order Langevin Diffusion Yields an Accelerated MCMC Algorithm
Not on the map. Why?
Abstract (arXiv)
We propose a Markov chain Monte Carlo (MCMC) algorithm based on third-order Langevin dynamics for sampling from distributions with log-concave and smooth densities. The higher-order dynamics allow for more flexible discretization schemes, and we develop a specific method that combines splitting with more accurate integration. For a broad class of d-dimensional distributions arising from generalized linear models, we prove that the resulting third-order algorithm produces samples from a distribution that is at most varepsilon > 0 in Wasserstein distance from the target distribution in Oleft(fracd1/4 varepsilon1/2 right) steps. This result requires only Lipschitz conditions on the gradient. For general strongly convex potentials with α-th order smoothness, we prove that the mixing time scales as O left(fracd1/4varepsilon1/2 + fracd1/2varepsilon1/(α - 1) right).
Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 3; 2023: 10; 2024: 4; 2025: 6; 2026: 2.
36 papers.
Sort:
By area:
- 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusioncited by 233
- 2021Estimating High Order Gradients of the Data Distribution by Denoisingcited by 64
- 2022Private Convex Optimization via Exponential Mechanismcited by 49
- 2025Fast Solvers for Discrete Diffusion Models: Theory and Applications of High-Order Algorithmscited by 47
- 2021Minimax Mixing Time of the Metropolis-Adjusted Langevin Algorithm for Log-Concave Samplingcited by 44
- 2023Reverse Diffusion Monte Carlocited by 41
- 2023On the Posterior Distribution in Denoising: Application to Uncertainty Quantificationcited by 33
- 2023Where to Diffuse, How to Diffuse, and How to Get Back: Automated Learning for Multivariate Diffusionscited by 29
- 2025Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distancecited by 29
- 2025Underdamped Diffusion Bridges with Applications to Samplingcited by 29
- 2021Sqrt(d) Dimension Dependence of Langevin Monte Carlocited by 25
- 2021Lower Bounds on Metropolized Sampling Methods for Well-Conditioned Distributionscited by 19
24 more
- 2021Heavy-tailed denoising score matchingcited by 18
- 2023A connection between Tempering and Entropic Mirror Descentcited by 16
- 2023When does Metropolized Hamiltonian Monte Carlo provably outperform Metropolis-adjusted Langevin algorithm?cited by 15
- 2021On Convergence of Federated Averaging Langevin Dynamicscited by 14
- 2023Chain of Log-Concave Markov Chainscited by 14
- 2021When is the Convergence Time of Langevin Algorithms Dimension Independent? A Composite Optimization Viewpointcited by 12
- 2023Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisitedcited by 10
- 2021Wasserstein distance estimates for the distributions of numerical approximations to ergodic stochastic differential equationscited by 8
- 2022Hamiltonian Monte Carlo for efficient Gaussian sampling: long and random stepscited by 8
- 2023Solving Linear Inverse Problems using Higher-Order Annealed Langevin Diffusioncited by 6
- 2024Parallel Simulation for Log-concave Sampling and Score-based Diffusion Modelscited by 6
- 2024Generative Modelling with High-Order Langevin Dynamicscited by 5
- 2024Faster Sampling via Stochastic Gradient Proximal Samplercited by 5
- 2025Sequential Monte Carlo approximations of Wasserstein--Fisher--Rao gradient flowscited by 5
- 2023Accelerated Bayesian imaging by relaxed proximal-point Langevin samplingcited by 4
- 2025Accelerating Langevin Monte Carlo Sampling: A Large Deviations Analysiscited by 4
- 2021De-randomizing MCMC dynamics with the diffusion Stein operatorcited by 3
- 2022Learning and Inference in Sparse Coding Models with Langevin Dynamicscited by 2
- 2025An operator splitting analysis of Wasserstein--Fisher--Rao gradient flowscited by 2
- 2026Improved Guarantees for Langevin Monte Carlo with Average Smoothnesscited by 2
- 2021Quantifying the mini-batching error in Bayesian inference for Adaptive Langevin dynamicscited by 1
- 2023A Gentle Introduction to Gradient-Based Optimization and Variational Inequalities for Machine Learningcited by 0
- 2024Feynman-Kac Operator Expectation Estimatorcited by 0
- 2026Particle-based Generalised Stochastic Optimisationcited by 0
- 2026Particle-based Generalised Stochastic Optimisation3 Aug 2026
- 2026Improved Guarantees for Langevin Monte Carlo with Average Smoothness29 May 2026
- 2025An operator splitting analysis of Wasserstein--Fisher--Rao gradient flows22 Nov 2025
- 2025Sequential Monte Carlo approximations of Wasserstein--Fisher--Rao gradient flows6 Jun 2025
- 2025Accelerating Langevin Monte Carlo Sampling: A Large Deviations Analysis24 Mar 2025
- 2025Underdamped Diffusion Bridges with Applications to Sampling2 Mar 2025
- 2025Fast Solvers for Discrete Diffusion Models: Theory and Applications of High-Order Algorithms1 Feb 2025
- 2025Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distance4 Jan 2025
- 2024Parallel Simulation for Log-concave Sampling and Score-based Diffusion Models10 Dec 2024
- 2024Feynman-Kac Operator Expectation Estimator2 Jul 2024
- 2024Faster Sampling via Stochastic Gradient Proximal Sampler27 May 2024
- 2024Generative Modelling with High-Order Langevin Dynamics19 Apr 2024
24 more
- 2023A connection between Tempering and Entropic Mirror Descent18 Oct 2023
- 2023On the Posterior Distribution in Denoising: Application to Uncertainty Quantification24 Sep 2023
- 2023A Gentle Introduction to Gradient-Based Optimization and Variational Inequalities for Machine Learning9 Sep 2023
- 2023Accelerated Bayesian imaging by relaxed proximal-point Langevin sampling18 Aug 2023
- 2023Reverse Diffusion Monte Carlo5 Jul 2023
- 2023Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisited14 Jun 2023
- 2023Chain of Log-Concave Markov Chains31 May 2023
- 2023Solving Linear Inverse Problems using Higher-Order Annealed Langevin Diffusion8 May 2023
- 2023When does Metropolized Hamiltonian Monte Carlo provably outperform Metropolis-adjusted Langevin algorithm?10 Apr 2023
- 2023Where to Diffuse, How to Diffuse, and How to Get Back: Automated Learning for Multivariate Diffusions14 Feb 2023
- 2022Hamiltonian Monte Carlo for efficient Gaussian sampling: long and random steps26 Sep 2022
- 2022Learning and Inference in Sparse Coding Models with Langevin Dynamics23 Apr 2022
- 2022Private Convex Optimization via Exponential Mechanism1 Mar 2022
- 2021Heavy-tailed denoising score matching17 Dec 2021
- 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusion14 Dec 2021
- 2021On Convergence of Federated Averaging Langevin Dynamics9 Dec 2021
- 2021Estimating High Order Gradients of the Data Distribution by Denoising8 Nov 2021
- 2021De-randomizing MCMC dynamics with the diffusion Stein operator7 Oct 2021
- 2021When is the Convergence Time of Langevin Algorithms Dimension Independent? A Composite Optimization Viewpoint5 Oct 2021
- 2021Minimax Mixing Time of the Metropolis-Adjusted Langevin Algorithm for Log-Concave Sampling27 Sep 2021
- 2021Sqrt(d) Dimension Dependence of Langevin Monte Carlo8 Sep 2021
- 2021Lower Bounds on Metropolized Sampling Methods for Well-Conditioned Distributions10 Jun 2021
- 2021Quantifying the mini-batching error in Bayesian inference for Adaptive Langevin dynamics21 May 2021
- 2021Wasserstein distance estimates for the distributions of numerical approximations to ergodic stochastic differential equations26 Apr 2021
- 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusioncited by 233
- 2025Fast Solvers for Discrete Diffusion Models: Theory and Applications of High-Order Algorithmscited by 47
- 2023On the Posterior Distribution in Denoising: Application to Uncertainty Quantificationcited by 33
- 2023Where to Diffuse, How to Diffuse, and How to Get Back: Automated Learning for Multivariate Diffusionscited by 29
- 2025Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distancecited by 29
- 2021Heavy-tailed denoising score matchingcited by 18
- 2024Parallel Simulation for Log-concave Sampling and Score-based Diffusion Modelscited by 6
- 2024Generative Modelling with High-Order Langevin Dynamicscited by 5
- 2025Fast Solvers for Discrete Diffusion Models: Theory and Applications of High-Order Algorithms1 Feb 2025
- 2025Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distance4 Jan 2025
- 2024Parallel Simulation for Log-concave Sampling and Score-based Diffusion Models10 Dec 2024
- 2024Generative Modelling with High-Order Langevin Dynamics19 Apr 2024
- 2023On the Posterior Distribution in Denoising: Application to Uncertainty Quantification24 Sep 2023
- 2023Where to Diffuse, How to Diffuse, and How to Get Back: Automated Learning for Multivariate Diffusions14 Feb 2023
- 2021Heavy-tailed denoising score matching17 Dec 2021
- 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusion14 Dec 2021
- 2021Estimating High Order Gradients of the Data Distribution by Denoisingcited by 64
- 2022Private Convex Optimization via Exponential Mechanismcited by 49
- 2021Minimax Mixing Time of the Metropolis-Adjusted Langevin Algorithm for Log-Concave Samplingcited by 44
- 2023Reverse Diffusion Monte Carlocited by 41
- 2025Underdamped Diffusion Bridges with Applications to Samplingcited by 29
- 2021Sqrt(d) Dimension Dependence of Langevin Monte Carlocited by 25
- 2021Lower Bounds on Metropolized Sampling Methods for Well-Conditioned Distributionscited by 19
- 2023A connection between Tempering and Entropic Mirror Descentcited by 16
- 2023When does Metropolized Hamiltonian Monte Carlo provably outperform Metropolis-adjusted Langevin algorithm?cited by 15
- 2021On Convergence of Federated Averaging Langevin Dynamicscited by 14
- 2023Chain of Log-Concave Markov Chainscited by 14
- 2021When is the Convergence Time of Langevin Algorithms Dimension Independent? A Composite Optimization Viewpointcited by 12
12 most cited of 28 All 28 (JSON)
- 2026Particle-based Generalised Stochastic Optimisation3 Aug 2026
- 2026Improved Guarantees for Langevin Monte Carlo with Average Smoothness29 May 2026
- 2025An operator splitting analysis of Wasserstein--Fisher--Rao gradient flows22 Nov 2025
- 2025Sequential Monte Carlo approximations of Wasserstein--Fisher--Rao gradient flows6 Jun 2025
- 2025Accelerating Langevin Monte Carlo Sampling: A Large Deviations Analysis24 Mar 2025
- 2025Underdamped Diffusion Bridges with Applications to Sampling2 Mar 2025
- 2024Feynman-Kac Operator Expectation Estimator2 Jul 2024
- 2024Faster Sampling via Stochastic Gradient Proximal Sampler27 May 2024
- 2023A connection between Tempering and Entropic Mirror Descent18 Oct 2023
- 2023A Gentle Introduction to Gradient-Based Optimization and Variational Inequalities for Machine Learning9 Sep 2023
- 2023Accelerated Bayesian imaging by relaxed proximal-point Langevin sampling18 Aug 2023
- 2023Reverse Diffusion Monte Carlo5 Jul 2023
12 newest of 28 All 28 (JSON)