Underdamped Langevin MCMC: A non-asymptotic analysis
Not on the map. Why?
Abstract (arXiv)
We study the underdamped Langevin diffusion when the log of the target distribution is smooth and strongly concave. We present a MCMC algorithm based on its discretization and show that it achieves varepsilon error (in 2-Wasserstein distance) in O(√d/varepsilon) steps. This is a significant improvement over the best known rate for overdamped Langevin MCMC, which is O(d/varepsilon2) steps under the same smoothness/concavity assumptions. The underdamped Langevin MCMC scheme can be viewed as a version of Hamiltonian Monte Carlo (HMC) which has been observed to outperform overdamped Langevin MCMC methods in a number of application areas. We provide quantitative rates that support this empirical wisdom.
Key facts. Cited by 133 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Jul 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 18; 2023: 31; 2024: 24; 2025: 21; 2026: 19.
133 papers.
Sort:
By area:
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 445
- 2022Convergence for score-based generative modeling with polynomial complexitycited by 177
- 2021Bayesian imaging using Plug & Play priors: when Langevin meets Tweediecited by 97
- 2023Faster high-accuracy log-concave sampling via algorithmic warm startscited by 45
- 2021Minimax Mixing Time of the Metropolis-Adjusted Langevin Algorithm for Log-Concave Samplingcited by 44
- 2023Reverse Diffusion Monte Carlocited by 41
- 20233D molecule generation by denoising voxel gridscited by 40
- 2021MCMC Variational Inference via Uncorrected Hamiltonian Annealingcited by 39
- 2021Differentiable Annealed Importance Sampling and the Perils of Gradient Noisecited by 36
- 2024Model-Based Diffusion for Trajectory Optimizationcited by 32
- 2023Towards a Complete Analysis of Langevin Monte Carlo: Beyond Poincar'e Inequalitycited by 31
- 2023Improved dimension dependence of a proximal algorithm for samplingcited by 30
38 more
- 2025Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distancecited by 29
- 2022Sampling with Riemannian Hamiltonian Monte Carlo in a Constrained Spacecited by 28
- 2023Improved Discretization Analysis for Underdamped Langevin Monte Carlocited by 28
- 2022Particle algorithms for maximum likelihood training of latent variable modelscited by 26
- 2022Langevin Diffusion Variational Inferencecited by 26
- 2021Sqrt(d) Dimension Dependence of Langevin Monte Carlocited by 25
- 2021A Proximal Algorithm for Sampling from Non-smooth Potentialscited by 24
- 2022A Proximal Algorithm for Samplingcited by 22
- 2022Resolving the Mixing Time of the Langevin Algorithm to its Stationary Distribution for Log-Concave Samplingcited by 22
- 2021A Convergence Theory for SVGD in the Population Limit under Talagrand's Inequality T1cited by 21
- 2021Lower Bounds on Metropolized Sampling Methods for Well-Conditioned Distributionscited by 19
- 2023Renormalizing Diffusion Modelscited by 16
- 2021Lazy OCO: Online Convex Optimization on a Switching Budgetcited by 14
- 2021On Convergence of Federated Averaging Langevin Dynamicscited by 14
- 2023Chain of Log-Concave Markov Chainscited by 14
- 2024Sampling from Bayesian Neural Network Posteriors with Symmetric Minibatch Splitting Langevin Dynamicscited by 13
- 2021When is the Convergence Time of Langevin Algorithms Dimension Independent? A Composite Optimization Viewpointcited by 12
- 2022Fisher information lower bounds for samplingcited by 12
- 2023Kinetic Langevin MCMC Sampling Without Gradient Lipschitz Continuity -- the Strongly Convex Casecited by 12
- 2023Query lower bounds for log-concave samplingcited by 12
- 2023Momentum Particle Maximum Likelihoodcited by 12
- 2024Fast parallel sampling under isoperimetrycited by 12
- 2024More Efficient Randomized Exploration for Reinforcement Learning via Approximate Samplingcited by 12
- 2021Asymptotic bias of inexact Markov Chain Monte Carlo methods in high dimensioncited by 11
- 2025LanPaint: Training-Free Diffusion Inpainting with Asymptotically Exact and Fast Conditional Samplingcited by 11
- 2025Complexity Analysis of Normalizing Constant Estimation: from Jarzynski Equality to Annealed Importance Sampling and beyondcited by 11
- 2022Condition-number-independent convergence rate of Riemannian Hamiltonian Monte Carlo with numerical integratorscited by 10
- 2023Algorithmic Aspects of the Log-Laplace Transform and a Non-Euclidean Proximal Samplercited by 10
- 2023Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisitedcited by 10
- 2023Accelerating optimization over the space of probability measurescited by 10
- 2024Accelerating Approximate Thompson Sampling with Underdamped Langevin Monte Carlocited by 10
- 2022A Kernel-Expanded Stochastic Neural Networkcited by 9
- 2024Parallelized Midpoint Randomization for Langevin Monte Carlocited by 9
- 2021Wasserstein distance estimates for the distributions of numerical approximations to ergodic stochastic differential equationscited by 8
- 2021An Introduction to Hamiltonian Monte Carlo Method for Samplingcited by 8
- 2021Multimeasurement Generative Modelscited by 8
- 2022Gradient Norm Minimization of Nesterov Acceleration: o(1/k3)cited by 8
- 2022Quantum Algorithms for Sampling Log-Concave Distributions and Estimating Normalizing Constantscited by 8
50 most cited of 133 All 133 (JSON)
- 2026Reflected Proximal Dynamics for Accelerated High-Accuracy Log-Concave Sampling12 Oct 2026
- 2026Nonlocal Hamiltonian Dynamics on Sparse L'evy Graphs: Spectral Analysis and Multimodal Sampling1 Oct 2026
- 2026Muon meets Tamed Langevin: Momentum Preconditioning beyond Convex and gradient-Lipschitz Potentials1 Oct 2026
- 2026Wasserstein Gradient Flows and Forward-Only Diffusion Are Not Enough for Multimodal Sampling1 Oct 2026
- 2026Improved Analysis for Hessian-free High-resolution Monte Carlo Sampling25 Aug 2026
- 2026Path-dependent Discrete Amortized Inference9 Aug 2026
- 2026A Blueprint for Equilibrium-Based Differentiable Continuous-Variable Thermodynamic Computing17 Jul 2026
- 2026Event Generation with Parallel Langevin Sampling and Learned Stein Diagnostics12 Jun 2026
- 2026Improved Guarantees for Langevin Monte Carlo with Average Smoothness29 May 2026
- 2026Time-Inhomogeneous Preconditioned Langevin Dynamics7 May 2026
- 2026Conditional Diffusion Under Linear Constraints: Langevin Mixing and Information-Theoretic Guarantees6 May 2026
- 2026Efficient Diffusion Models under Nonconvex Equality and Inequality constraints via Landing20 Apr 2026
38 more
- 2026Shuffling the Data, Stretching the Step-size: Sharper Bias in constant step-size SGD11 Apr 2026
- 2026Kinetic Langevin Splitting Schemes for Constrained Sampling24 Mar 2026
- 2026Counterdiabatic Hamiltonian Monte Carlo24 Feb 2026
- 2026Leakage and Second-Order Dynamics Improve Hippocampal RNN Replay20 Feb 2026
- 2026A Non-asymptotic Analysis for Learning and Applying a Preconditioner in MCMC11 Feb 2026
- 2026Accelerated Regularized Wasserstein Proximal Sampling Algorithms14 Jan 2026
- 2026Learning Relationship between Quantum Walks and Underdamped Langevin Dynamics4 Jan 2026
- 2025A Critical Review of Monte Carlo Algorithms Balancing Performance and Probabilistic Accuracy with AI Augmented Framework19 Dec 2025
- 2025Weighted Stochastic Differential Equation to Implement Wasserstein-Fisher-Rao Gradient Flow19 Dec 2025
- 2025Fast Riemannian-manifold Hamiltonian Monte Carlo for hierarchical Gaussian-process models9 Nov 2025
- 2025Contractive kinetic Langevin samplers beyond global Lipschitz continuity15 Sep 2025
- 2025Regime-Switching Langevin Monte Carlo Algorithms31 Aug 2025
- 2025Sampling by averaging: A multiscale approach to score estimation20 Aug 2025
- 2025Do we need equivariant models for molecule generation?13 Jul 2025
- 2025Critically-Damped Higher-Order Langevin Dynamics for Generative Modeling26 Jun 2025
- 2025Continuous Policy and Value Iteration for Relaxed Stochastic Control Problems and Its Convergence9 Jun 2025
- 2025Poisson Midpoint Method for Log Concave Sampling: Beyond the Strong Error Lower Bounds9 Jun 2025
- 2025Accelerated Markov Chain Monte Carlo Algorithms on Discrete States19 May 2025
- 2025Accelerating Langevin Monte Carlo Sampling: A Large Deviations Analysis24 Mar 2025
- 2025BLADE: Bayesian Langevin Active Discovery with Replica Exchange for Identification of Complex Systems4 Mar 2025
- 2025End-To-End Learning of Gaussian Mixture Priors for Diffusion Sampler1 Mar 2025
- 2025Guiding Time-Varying Generative Models with Natural Gradients on Exponential Family Manifold11 Feb 2025
- 2025On the query complexity of sampling from non-log-concave distributions10 Feb 2025
- 2025Complexity Analysis of Normalizing Constant Estimation: from Jarzynski Equality to Annealed Importance Sampling and beyond7 Feb 2025
- 2025LanPaint: Training-Free Diffusion Inpainting with Asymptotically Exact and Fast Conditional Sampling5 Feb 2025
- 2025Active Learning with Bayesian Multi-Fidelity Laplace Neural Operators for Oscillatory Parametric PDEs1 Feb 2025
- 2025Convergence of two-timescale gradient descent ascent dynamics: finite-dimensional and mean-field perspectives28 Jan 2025
- 2025Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distance4 Jan 2025
- 2024Sampling with Adaptive Variance for Multimodal Distributions20 Nov 2024
- 2024Error estimates between SGD with momentum and underdamped Langevin diffusion22 Oct 2024
- 2024Sampling from Bayesian Neural Network Posteriors with Symmetric Minibatch Splitting Langevin Dynamics14 Oct 2024
- 2024Mixing of the No-U-Turn Sampler and the Geometry of Gaussian Concentration9 Oct 2024
- 2024Bayesian Federated Learning with Hamiltonian Monte Carlo: Algorithm and Theory9 Jul 2024
- 2024Kinetic Interacting Particle Langevin Monte Carlo8 Jul 2024
- 2024NEBULA: Neural Empirical Bayes Under Latent Representations for Efficient and Controllable Design of Molecular Libraries3 Jul 2024
- 2024Feynman-Kac Operator Expectation Estimator2 Jul 2024
- 2024More Efficient Randomized Exploration for Reinforcement Learning via Approximate Sampling18 Jun 2024
- 2024Weak Generative Sampler to Efficiently Sample Invariant Distribution of Stochastic Differential Equation29 May 2024
50 newest of 133 All 133 (JSON)
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 445
- 2022Convergence for score-based generative modeling with polynomial complexitycited by 177
- 2024Model-Based Diffusion for Trajectory Optimizationcited by 32
- 2025Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distancecited by 29
- 2023Renormalizing Diffusion Modelscited by 16
- 2025LanPaint: Training-Free Diffusion Inpainting with Asymptotically Exact and Fast Conditional Samplingcited by 11
- 2024The Poisson Midpoint Method for Langevin Dynamics: Provably Efficient Discretization for Diffusion Modelscited by 6
- 2023Convergence guarantee for consistency modelscited by 5
- 2025End-To-End Learning of Gaussian Mixture Priors for Diffusion Samplercited by 4
- 2025Critically-Damped Higher-Order Langevin Dynamics for Generative Modelingcited by 3
- 2025Weighted Stochastic Differential Equation to Implement Wasserstein-Fisher-Rao Gradient Flowcited by 0
- 2026Efficient Diffusion Models under Nonconvex Equality and Inequality constraints via Landingcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Conditional Diffusion Under Linear Constraints: Langevin Mixing and Information-Theoretic Guarantees6 May 2026
- 2026Efficient Diffusion Models under Nonconvex Equality and Inequality constraints via Landing20 Apr 2026
- 2025Weighted Stochastic Differential Equation to Implement Wasserstein-Fisher-Rao Gradient Flow19 Dec 2025
- 2025Critically-Damped Higher-Order Langevin Dynamics for Generative Modeling26 Jun 2025
- 2025End-To-End Learning of Gaussian Mixture Priors for Diffusion Sampler1 Mar 2025
- 2025LanPaint: Training-Free Diffusion Inpainting with Asymptotically Exact and Fast Conditional Sampling5 Feb 2025
- 2025Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distance4 Jan 2025
- 2024Model-Based Diffusion for Trajectory Optimization28 May 2024
- 2024The Poisson Midpoint Method for Langevin Dynamics: Provably Efficient Discretization for Diffusion Models27 May 2024
- 2023Renormalizing Diffusion Models23 Aug 2023
- 2023Convergence guarantee for consistency models22 Aug 2023
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions22 Sep 2022
12 newest of 13 All 13 (JSON)
- 2021Bayesian imaging using Plug & Play priors: when Langevin meets Tweediecited by 97
- 2023Faster high-accuracy log-concave sampling via algorithmic warm startscited by 45
- 2021Minimax Mixing Time of the Metropolis-Adjusted Langevin Algorithm for Log-Concave Samplingcited by 44
- 2023Reverse Diffusion Monte Carlocited by 41
- 20233D molecule generation by denoising voxel gridscited by 40
- 2021MCMC Variational Inference via Uncorrected Hamiltonian Annealingcited by 39
- 2021Differentiable Annealed Importance Sampling and the Perils of Gradient Noisecited by 36
- 2023Towards a Complete Analysis of Langevin Monte Carlo: Beyond Poincar'e Inequalitycited by 31
- 2023Improved dimension dependence of a proximal algorithm for samplingcited by 30
- 2022Sampling with Riemannian Hamiltonian Monte Carlo in a Constrained Spacecited by 28
- 2023Improved Discretization Analysis for Underdamped Langevin Monte Carlocited by 28
- 2022Particle algorithms for maximum likelihood training of latent variable modelscited by 26
12 most cited of 118 All 118 (JSON)
- 2026Reflected Proximal Dynamics for Accelerated High-Accuracy Log-Concave Sampling12 Oct 2026
- 2026Nonlocal Hamiltonian Dynamics on Sparse L'evy Graphs: Spectral Analysis and Multimodal Sampling1 Oct 2026
- 2026Muon meets Tamed Langevin: Momentum Preconditioning beyond Convex and gradient-Lipschitz Potentials1 Oct 2026
- 2026Wasserstein Gradient Flows and Forward-Only Diffusion Are Not Enough for Multimodal Sampling1 Oct 2026
- 2026Improved Analysis for Hessian-free High-resolution Monte Carlo Sampling25 Aug 2026
- 2026Path-dependent Discrete Amortized Inference9 Aug 2026
- 2026A Blueprint for Equilibrium-Based Differentiable Continuous-Variable Thermodynamic Computing17 Jul 2026
- 2026Event Generation with Parallel Langevin Sampling and Learned Stein Diagnostics12 Jun 2026
- 2026Improved Guarantees for Langevin Monte Carlo with Average Smoothness29 May 2026
- 2026Time-Inhomogeneous Preconditioned Langevin Dynamics7 May 2026
- 2026Shuffling the Data, Stretching the Step-size: Sharper Bias in constant step-size SGD11 Apr 2026
- 2026Kinetic Langevin Splitting Schemes for Constrained Sampling24 Mar 2026
12 newest of 118 All 118 (JSON)