Sharp convergence rates for Langevin dynamics in the nonconvex setting
Not on the map. Why?
Abstract (arXiv)
We study the problem of sampling from a distribution p^*(x) propto expleft(-U(x)right), where the function U is L-smooth everywhere and m-strongly convex outside a ball of radius R, but potentially nonconvex inside this ball. We study both overdamped and underdamped Langevin MCMC and establish upper bounds on the number of steps required to obtain a sample from a distribution that is within ε of p^* in 1-Wasserstein distance. For the first-order method (overdamped Langevin MCMC), the iteration complexity is tildeOleft(ecLR2d/ε2right), where d is the dimension of the underlying space. For the second-order method (underdamped Langevin MCMC), the iteration complexity is tildeOleft(ecLR2√d/εright) for an explicit positive constant c. Surprisingly, the iteration complexity for both these algorithms is only polynomial in the dimension d and the target accuracy ε. It is exponential, however, in the problem parameter LR2, which is a measure of non-log-concavity of the target distribution.
Key facts. Cited by 68 papers in the map (data through 14 Oct 2026). First posted on arXiv 4 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 21; 2023: 15; 2024: 4; 2025: 13; 2026: 5.
68 papers.
Sort:
By area:
- 2022Towards a Theory of Non-Log-Concave Sampling: First-Order Stationarity Guarantees for Langevin Monte Carlocited by 63
- 2021Minimax Mixing Time of the Metropolis-Adjusted Langevin Algorithm for Log-Concave Samplingcited by 44
- 2023Improved Discretization Analysis for Underdamped Langevin Monte Carlocited by 28
- 2022Homogenization of SGD in high-dimensions: Exact dynamics and generalization propertiescited by 27
- 2021Sqrt(d) Dimension Dependence of Langevin Monte Carlocited by 25
- 2022Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensionscited by 23
- 2022Resolving the Mixing Time of the Langevin Algorithm to its Stationary Distribution for Log-Concave Samplingcited by 22
- 2022Mean-field Variational Inference via Wasserstein Gradient Flowcited by 19
- 2021Heavy-tailed denoising score matchingcited by 18
- 2022Convergence of Stein Variational Gradient Descent under a Weaker Smoothness Conditioncited by 16
- 2021When is the Convergence Time of Langevin Algorithms Dimension Independent? A Composite Optimization Viewpointcited by 12
- 2022Fisher information lower bounds for samplingcited by 12
38 more
- 2023Kinetic Langevin MCMC Sampling Without Gradient Lipschitz Continuity -- the Strongly Convex Casecited by 12
- 2021Non-asymptotic estimates for TUSLA algorithm for non-convex learning with applications to neural networks with ReLU activation functioncited by 10
- 2023Convergence Rates for Non-Log-Concave Sampling and Log-Partition Estimationcited by 10
- 2023Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisitedcited by 10
- 2022Gradient Norm Minimization of Nesterov Acceleration: o(1/k3)cited by 8
- 2022Unadjusted Hamiltonian MCMC with Stratified Monte Carlo Time Integrationcited by 8
- 2021Convergence Analysis of Schr"odinger-F"ollmer Sampler without Convexitycited by 7
- 2022Utilising the CLT Structure in Stochastic Gradient based Sampling : Improved Analysis and Faster Algorithmscited by 7
- 2022Bregman Proximal Langevin Monte Carlo via Bregman--Moreau Envelopescited by 7
- 2022Statistical and Computational Trade-offs in Variational Inference: A Case Study in Inferential Model Selectioncited by 7
- 2023Taming under isoperimetrycited by 7
- 2024Tamed Langevin sampling under weaker conditionscited by 7
- 2024Kinetic Interacting Particle Langevin Monte Carlocited by 7
- 2022Heavy-tailed Sampling via Transformed Unadjusted Langevin Algorithmcited by 6
- 2022Constrained Langevin Algorithms with L-mixing External Random Variablescited by 6
- 2025Diffusion at Absolute Zero: Langevin Sampling Using Successive Moreau Envelopes [conference paper]cited by 6
- 2022Langevin dynamics based algorithm e-THvarepsilonO POULA for stochastic optimization problems with discontinuous stochastic gradientcited by 5
- 2025From Global to Local: A Scalable Benchmark for Local Posterior Samplingcited by 5
- 2021A Unifying and Canonical Description of Measure-Preserving Diffusionscited by 4
- 2022Federated Learning with a Sampling Algorithm under Isoperimetrycited by 4
- 2023ELF: Federated Langevin Algorithms with Primal, Dual and Bidirectional Compressioncited by 4
- 2023NF-ULA: Langevin Monte Carlo with Normalizing Flow Prior for Imaging Inverse Problemscited by 4
- 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithmscited by 4
- 2025The Performance Of The Unadjusted Langevin Algorithm Without Smoothness Assumptionscited by 4
- 2025Accelerating Langevin Monte Carlo Sampling: A Large Deviations Analysiscited by 4
- 2021Unadjusted Langevin algorithm for sampling a mixture of weakly smooth potentialscited by 3
- 2022Differentially Private Sampling from Rashomon Sets, and the Universality of Langevin Diffusion for Convex Optimizationcited by 3
- 2023Efficient Multimodal Sampling via Tempered Distribution Flowcited by 3
- 2023Reflection coupling for unadjusted generalized Hamiltonian Monte Carlo in the nonconvex stochastic gradient casecited by 3
- 2025kTULA: A Langevin sampling algorithm with improved KL bounds under super-linear log-gradientscited by 3
- 2025Regime-Switching Langevin Monte Carlo Algorithmscited by 3
- 2025Exponential Convergence Guarantees for Iterative Markovian Fittingcited by 3
- 2021A generalization gap estimation for overparameterized models via the Langevin functional variancecited by 2
- 2022Weak Convergence of Approximate reflection coupling and its Application to Non-convex Optimizationcited by 2
- 2022A Dynamical System View of Langevin-Based Non-Convex Samplingcited by 2
- 2023Approximating Langevin Monte Carlo with ResNet-like Neural Network architecturescited by 2
- 2024Kernelized Normalizing Constant Estimation: Bridging Bayesian Quadrature and Bayesian Optimizationcited by 2
- 2025Convergence of two-timescale gradient descent ascent dynamics: finite-dimensional and mean-field perspectivescited by 2
50 most cited of 68 All 68 (JSON)
- 2026Improved Analysis for Hessian-free High-resolution Monte Carlo Sampling25 Aug 2026
- 2026Mirror Langevin diffusions: Convergence rates and Markov chain approximations24 Jul 2026
- 2026Local and Global Contraction Principles for MCMC Mixing2 Jun 2026
- 2026On couplings for kinetic Langevin diffusions29 May 2026
- 2026Shuffling the Data, Stretching the Step-size: Sharper Bias in constant step-size SGD11 Apr 2026
- 2025Exponential Convergence Guarantees for Iterative Markovian Fitting23 Oct 2025
- 2025Generalization of Gibbs and Langevin Monte Carlo Algorithms in the Interpolation Regime7 Oct 2025
- 2025When Langevin Monte Carlo Meets Randomization: New Sampling Algorithms with Non-asymptotic Error Bounds beyond Log-Concavity and Gradient Lipschitzness30 Sep 2025
- 2025Contractive kinetic Langevin samplers beyond global Lipschitz continuity15 Sep 2025
- 2025Regime-Switching Langevin Monte Carlo Algorithms31 Aug 2025
- 2025From Global to Local: A Scalable Benchmark for Local Posterior Sampling29 Jul 2025
- 2025kTULA: A Langevin sampling algorithm with improved KL bounds under super-linear log-gradients5 Jun 2025
38 more
- 2025Operator-Level Quantum Acceleration of Non-Logconcave Sampling8 May 2025
- 2025Accelerating Langevin Monte Carlo Sampling: A Large Deviations Analysis24 Mar 2025
- 2025Efficient Bayesian Computation Using Plug-and-Play Priors for Poisson Inverse Problems20 Mar 2025
- 2025The Performance Of The Unadjusted Langevin Algorithm Without Smoothness Assumptions5 Feb 2025
- 2025Diffusion at Absolute Zero: Langevin Sampling Using Successive Moreau Envelopes [conference paper]3 Feb 2025
- 2025Convergence of two-timescale gradient descent ascent dynamics: finite-dimensional and mean-field perspectives28 Jan 2025
- 2024Error estimates between SGD with momentum and underdamped Langevin diffusion22 Oct 2024
- 2024Kinetic Interacting Particle Langevin Monte Carlo8 Jul 2024
- 2024Tamed Langevin sampling under weaker conditions27 May 2024
- 2024Kernelized Normalizing Constant Estimation: Bridging Bayesian Quadrature and Bayesian Optimization11 Jan 2024
- 2023Adam-like Algorithm with Smooth Clipping Attains Global Minima: Analysis Based on Ergodicity of Functional SDEs29 Nov 2023
- 2023Taming under isoperimetry15 Nov 2023
- 2023Approximating Langevin Monte Carlo with ResNet-like Neural Network architectures6 Nov 2023
- 2023Reflection coupling for unadjusted generalized Hamiltonian Monte Carlo in the nonconvex stochastic gradient case28 Oct 2023
- 2023Randomized Runge-Kutta-Nystr"om Methods for Unadjusted Hamiltonian and Kinetic Langevin Monte Carlo11 Oct 2023
- 2023Ito Diffusion Approximation of Universal Ito Chains for Sampling, Optimization and Boosting9 Oct 2023
- 2023Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisited14 Jun 2023
- 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithms25 May 2023
- 2023Subsampling Error in Stochastic Gradient Langevin Diffusions23 May 2023
- 2023NF-ULA: Langevin Monte Carlo with Normalizing Flow Prior for Imaging Inverse Problems17 Apr 2023
- 2023Efficient Multimodal Sampling via Tempered Distribution Flow8 Apr 2023
- 2023ELF: Federated Langevin Algorithms with Primal, Dual and Bidirectional Compression8 Mar 2023
- 2023Convergence Rates for Non-Log-Concave Sampling and Log-Partition Estimation6 Mar 2023
- 2023Improved Discretization Analysis for Underdamped Langevin Monte Carlo16 Feb 2023
- 2023Kinetic Langevin MCMC Sampling Without Gradient Lipschitz Continuity -- the Strongly Convex Case19 Jan 2023
- 2022Unadjusted Hamiltonian MCMC with Stratified Monte Carlo Time Integration20 Nov 2022
- 2022Asynchronous Bayesian Learning over a Network16 Nov 2022
- 2022A Dynamical System View of Langevin-Based Non-Convex Sampling25 Oct 2022
- 2022Langevin dynamics based algorithm e-THvarepsilonO POULA for stochastic optimization problems with discontinuous stochastic gradient24 Oct 2022
- 2022Resolving the Mixing Time of the Langevin Algorithm to its Stationary Distribution for Log-Concave Sampling16 Oct 2022
- 2022Fisher information lower bounds for sampling5 Oct 2022
- 2022Gradient Norm Minimization of Nesterov Acceleration: o(1/k3)19 Sep 2022
- 2022Statistical and Computational Trade-offs in Variational Inference: A Case Study in Inferential Model Selection22 Jul 2022
- 2022Mean-field Variational Inference via Wasserstein Gradient Flow17 Jul 2022
- 2022Bregman Proximal Langevin Monte Carlo via Bregman--Moreau Envelopes10 Jul 2022
- 2022Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions15 Jun 2022
- 2022Utilising the CLT Structure in Stochastic Gradient based Sampling : Improved Analysis and Faster Algorithms8 Jun 2022
- 2022Federated Learning with a Sampling Algorithm under Isoperimetry2 Jun 2022
50 newest of 68 All 68 (JSON)
- 2021Heavy-tailed denoising score matchingcited by 18
- 2021Heavy-tailed denoising score matching17 Dec 2021
- 2022Towards a Theory of Non-Log-Concave Sampling: First-Order Stationarity Guarantees for Langevin Monte Carlocited by 63
- 2021Minimax Mixing Time of the Metropolis-Adjusted Langevin Algorithm for Log-Concave Samplingcited by 44
- 2023Improved Discretization Analysis for Underdamped Langevin Monte Carlocited by 28
- 2022Homogenization of SGD in high-dimensions: Exact dynamics and generalization propertiescited by 27
- 2021Sqrt(d) Dimension Dependence of Langevin Monte Carlocited by 25
- 2022Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensionscited by 23
- 2022Resolving the Mixing Time of the Langevin Algorithm to its Stationary Distribution for Log-Concave Samplingcited by 22
- 2022Mean-field Variational Inference via Wasserstein Gradient Flowcited by 19
- 2022Convergence of Stein Variational Gradient Descent under a Weaker Smoothness Conditioncited by 16
- 2021When is the Convergence Time of Langevin Algorithms Dimension Independent? A Composite Optimization Viewpointcited by 12
- 2022Fisher information lower bounds for samplingcited by 12
- 2023Kinetic Langevin MCMC Sampling Without Gradient Lipschitz Continuity -- the Strongly Convex Casecited by 12
12 most cited of 67 All 67 (JSON)
- 2026Improved Analysis for Hessian-free High-resolution Monte Carlo Sampling25 Aug 2026
- 2026Mirror Langevin diffusions: Convergence rates and Markov chain approximations24 Jul 2026
- 2026Local and Global Contraction Principles for MCMC Mixing2 Jun 2026
- 2026On couplings for kinetic Langevin diffusions29 May 2026
- 2026Shuffling the Data, Stretching the Step-size: Sharper Bias in constant step-size SGD11 Apr 2026
- 2025Exponential Convergence Guarantees for Iterative Markovian Fitting23 Oct 2025
- 2025Generalization of Gibbs and Langevin Monte Carlo Algorithms in the Interpolation Regime7 Oct 2025
- 2025When Langevin Monte Carlo Meets Randomization: New Sampling Algorithms with Non-asymptotic Error Bounds beyond Log-Concavity and Gradient Lipschitzness30 Sep 2025
- 2025Contractive kinetic Langevin samplers beyond global Lipschitz continuity15 Sep 2025
- 2025Regime-Switching Langevin Monte Carlo Algorithms31 Aug 2025
- 2025From Global to Local: A Scalable Benchmark for Local Posterior Sampling29 Jul 2025
- 2025kTULA: A Langevin sampling algorithm with improved KL bounds under super-linear log-gradients5 Jun 2025
12 newest of 67 All 67 (JSON)