Optimal Convergence Rate of Hamiltonian Monte Carlo for Strongly Logconcave Distributions
Not on the map. Why?
Abstract (arXiv)
We study Hamiltonian Monte Carlo (HMC) for sampling from a strongly logconcave density proportional to e-f where f:ℝd → ℝ is μ-strongly convex and L-smooth (the condition number is kappa = L/μ). We show that the relaxation time (inverse of the spectral gap) of ideal HMC is O(kappa), improving on the previous best bound of O(kappa1.5); we complement this with an example where the relaxation time is Omega(kappa). When implemented using a nearly optimal ODE solver, HMC returns an varepsilon-approximate point in 2-Wasserstein distance using widetildeO((kappa d)0.5 varepsilon-1) gradient evaluations per step and widetildeO((kappa d)1.5varepsilon-1) total time.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 6; 2023: 6; 2024: 6; 2025: 2; 2026: 1.
28 papers.
Sort:
By area:
- 2022Private Convex Optimization via Exponential Mechanismcited by 47
- 2023Faster high-accuracy log-concave sampling via algorithmic warm startscited by 44
- 2021Lower Bounds on Metropolized Sampling Methods for Well-Conditioned Distributionscited by 19
- 2021Mixing Time Guarantees for Unadjusted Hamiltonian Monte Carlocited by 18
- 2021On Convergence of Federated Averaging Langevin Dynamicscited by 14
- 2023When does Metropolized Hamiltonian Monte Carlo provably outperform Metropolis-adjusted Langevin algorithm?cited by 12
- 2025Source-Guided Flow Matchingcited by 11
- 2022Condition-number-independent convergence rate of Riemannian Hamiltonian Monte Carlo with numerical integratorscited by 10
- 2024Accelerating Approximate Thompson Sampling with Underdamped Langevin Monte Carlocited by 10
- 2023Algorithmic Aspects of the Log-Laplace Transform and a Non-Euclidean Proximal Samplercited by 9
- 2021An Introduction to Hamiltonian Monte Carlo Method for Samplingcited by 8
- 2022Hamiltonian Monte Carlo for efficient Gaussian sampling: long and random stepscited by 8
16 more
- 2022Unadjusted Hamiltonian MCMC with Stratified Monte Carlo Time Integrationcited by 8
- 2022Accelerating Hamiltonian Monte Carlo via Chebyshev Integration Timecited by 7
- 2023Fit Like You Sample: Sample-Efficient Generalized Score Matching from Fast Mixing Diffusionscited by 6
- 2021Entropy-based adaptive Hamiltonian Monte Carlocited by 5
- 2024Faster Sampling via Stochastic Gradient Proximal Samplercited by 5
- 2023Mean-Square Analysis of Discretized Ito Diffusions for Heavy-tailed Samplingcited by 4
- 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithmscited by 4
- 2024Bayesian Federated Learning with Hamiltonian Monte Carlo: Algorithm and Theorycited by 4
- 2025Feel-Good Thompson Sampling for Contextual Bandits: a Markov Chain Monte Carlo Showdowncited by 4
- 2021Hamiltonian Monte Carlo with Asymmetrical Momentum Distributionscited by 1
- 2022On the Dissipation of Ideal Hamiltonian Monte Carlo Samplercited by 1
- 2024Sampling with Adaptive Variance for Multimodal Distributionscited by 1
- 2026Mirror Langevin diffusions: Convergence rates and Markov chain approximationscited by 1
- 2021Truncated Log-concave Sampling with Reflective Hamiltonian Monte Carlocited by 0
- 2024On Convergence of the Alternating Directions SGHMC Algorithmcited by 0
- 2024Randomized Transport Plans via Hierarchical Fully Probabilistic Designcited by 0
- 2026Mirror Langevin diffusions: Convergence rates and Markov chain approximations24 Jul 2026
- 2025Source-Guided Flow Matching20 Aug 2025
- 2025Feel-Good Thompson Sampling for Contextual Bandits: a Markov Chain Monte Carlo Showdown21 Jul 2025
- 2024Sampling with Adaptive Variance for Multimodal Distributions20 Nov 2024
- 2024Randomized Transport Plans via Hierarchical Fully Probabilistic Design4 Aug 2024
- 2024Bayesian Federated Learning with Hamiltonian Monte Carlo: Algorithm and Theory9 Jul 2024
- 2024Faster Sampling via Stochastic Gradient Proximal Sampler27 May 2024
- 2024On Convergence of the Alternating Directions SGHMC Algorithm21 May 2024
- 2024Accelerating Approximate Thompson Sampling with Underdamped Langevin Monte Carlo22 Jan 2024
- 2023Fit Like You Sample: Sample-Efficient Generalized Score Matching from Fast Mixing Diffusions15 Jun 2023
- 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithms25 May 2023
- 2023When does Metropolized Hamiltonian Monte Carlo provably outperform Metropolis-adjusted Langevin algorithm?10 Apr 2023
16 more
- 2023Mean-Square Analysis of Discretized Ito Diffusions for Heavy-tailed Sampling1 Mar 2023
- 2023Faster high-accuracy log-concave sampling via algorithmic warm starts20 Feb 2023
- 2023Algorithmic Aspects of the Log-Laplace Transform and a Non-Euclidean Proximal Sampler13 Feb 2023
- 2022Unadjusted Hamiltonian MCMC with Stratified Monte Carlo Time Integration20 Nov 2022
- 2022Condition-number-independent convergence rate of Riemannian Hamiltonian Monte Carlo with numerical integrators13 Oct 2022
- 2022Hamiltonian Monte Carlo for efficient Gaussian sampling: long and random steps26 Sep 2022
- 2022On the Dissipation of Ideal Hamiltonian Monte Carlo Sampler15 Sep 2022
- 2022Accelerating Hamiltonian Monte Carlo via Chebyshev Integration Time5 Jul 2022
- 2022Private Convex Optimization via Exponential Mechanism1 Mar 2022
- 2021On Convergence of Federated Averaging Langevin Dynamics9 Dec 2021
- 2021Entropy-based adaptive Hamiltonian Monte Carlo27 Oct 2021
- 2021Hamiltonian Monte Carlo with Asymmetrical Momentum Distributions21 Oct 2021
- 2021An Introduction to Hamiltonian Monte Carlo Method for Sampling27 Aug 2021
- 2021Lower Bounds on Metropolized Sampling Methods for Well-Conditioned Distributions10 Jun 2021
- 2021Mixing Time Guarantees for Unadjusted Hamiltonian Monte Carlo3 May 2021
- 2021Truncated Log-concave Sampling with Reflective Hamiltonian Monte Carlo25 Feb 2021
- 2025Source-Guided Flow Matchingcited by 11
- 2025Source-Guided Flow Matching20 Aug 2025
- 2022Private Convex Optimization via Exponential Mechanismcited by 47
- 2023Faster high-accuracy log-concave sampling via algorithmic warm startscited by 44
- 2021Lower Bounds on Metropolized Sampling Methods for Well-Conditioned Distributionscited by 19
- 2021Mixing Time Guarantees for Unadjusted Hamiltonian Monte Carlocited by 18
- 2021On Convergence of Federated Averaging Langevin Dynamicscited by 14
- 2023When does Metropolized Hamiltonian Monte Carlo provably outperform Metropolis-adjusted Langevin algorithm?cited by 12
- 2022Condition-number-independent convergence rate of Riemannian Hamiltonian Monte Carlo with numerical integratorscited by 10
- 2024Accelerating Approximate Thompson Sampling with Underdamped Langevin Monte Carlocited by 10
- 2023Algorithmic Aspects of the Log-Laplace Transform and a Non-Euclidean Proximal Samplercited by 9
- 2021An Introduction to Hamiltonian Monte Carlo Method for Samplingcited by 8
- 2022Hamiltonian Monte Carlo for efficient Gaussian sampling: long and random stepscited by 8
- 2022Unadjusted Hamiltonian MCMC with Stratified Monte Carlo Time Integrationcited by 8
12 most cited of 27 All 27 (JSON)
- 2026Mirror Langevin diffusions: Convergence rates and Markov chain approximations24 Jul 2026
- 2025Feel-Good Thompson Sampling for Contextual Bandits: a Markov Chain Monte Carlo Showdown21 Jul 2025
- 2024Sampling with Adaptive Variance for Multimodal Distributions20 Nov 2024
- 2024Randomized Transport Plans via Hierarchical Fully Probabilistic Design4 Aug 2024
- 2024Bayesian Federated Learning with Hamiltonian Monte Carlo: Algorithm and Theory9 Jul 2024
- 2024Faster Sampling via Stochastic Gradient Proximal Sampler27 May 2024
- 2024On Convergence of the Alternating Directions SGHMC Algorithm21 May 2024
- 2024Accelerating Approximate Thompson Sampling with Underdamped Langevin Monte Carlo22 Jan 2024
- 2023Fit Like You Sample: Sample-Efficient Generalized Score Matching from Fast Mixing Diffusions15 Jun 2023
- 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithms25 May 2023
- 2023When does Metropolized Hamiltonian Monte Carlo provably outperform Metropolis-adjusted Langevin algorithm?10 Apr 2023
- 2023Mean-Square Analysis of Discretized Ito Diffusions for Heavy-tailed Sampling1 Mar 2023
12 newest of 27 All 27 (JSON)