mlsanityData to 14 Oct 2026

Sharp convergence rates for Langevin dynamics in the nonconvex setting

arXiv 1805.01648 ↗First posted 4 May 2018stat.ML cs.LG math.PRcited by 68

Not on the map. Why?

Abstract (arXiv)

We study the problem of sampling from a distribution p^*(x) propto expleft(-U(x)right), where the function U is L-smooth everywhere and m-strongly convex outside a ball of radius R, but potentially nonconvex inside this ball. We study both overdamped and underdamped Langevin MCMC and establish upper bounds on the number of steps required to obtain a sample from a distribution that is within ε of p^* in 1-Wasserstein distance. For the first-order method (overdamped Langevin MCMC), the iteration complexity is tildeOleft(ecLR2d/ε2right), where d is the dimension of the underlying space. For the second-order method (underdamped Langevin MCMC), the iteration complexity is tildeOleft(ecLR2√d/εright) for an explicit positive constant c. Surprisingly, the iteration complexity for both these algorithms is only polynomial in the dimension d and the target accuracy ε. It is exponential, however, in the problem parameter LR2, which is a measure of non-log-concavity of the target distribution.

Key facts. Cited by 68 papers in the map (data through 14 Oct 2026). First posted on arXiv 4 May 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 10; 2022: 21; 2023: 15; 2024: 4; 2025: 13; 2026: 5.

68 papers.

Sort:

By area:

  1. 2022Towards a Theory of Non-Log-Concave Sampling: First-Order Stationarity Guarantees for Langevin Monte Carlocited by 63
  2. 2021Minimax Mixing Time of the Metropolis-Adjusted Langevin Algorithm for Log-Concave Samplingcited by 44
  3. 2023Improved Discretization Analysis for Underdamped Langevin Monte Carlocited by 28
  4. 2022Homogenization of SGD in high-dimensions: Exact dynamics and generalization propertiescited by 27
  5. 2021Sqrt(d) Dimension Dependence of Langevin Monte Carlocited by 25
  6. 2022Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensionscited by 23
  7. 2022Resolving the Mixing Time of the Langevin Algorithm to its Stationary Distribution for Log-Concave Samplingcited by 22
  8. 2022Mean-field Variational Inference via Wasserstein Gradient Flowcited by 19
  9. 2021Heavy-tailed denoising score matchingcited by 18
  10. 2022Convergence of Stein Variational Gradient Descent under a Weaker Smoothness Conditioncited by 16
  11. 2021When is the Convergence Time of Langevin Algorithms Dimension Independent? A Composite Optimization Viewpointcited by 12
  12. 2022Fisher information lower bounds for samplingcited by 12
38 more
  1. 2023Kinetic Langevin MCMC Sampling Without Gradient Lipschitz Continuity -- the Strongly Convex Casecited by 12
  2. 2021Non-asymptotic estimates for TUSLA algorithm for non-convex learning with applications to neural networks with ReLU activation functioncited by 10
  3. 2023Convergence Rates for Non-Log-Concave Sampling and Log-Partition Estimationcited by 10
  4. 2023Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisitedcited by 10
  5. 2022Gradient Norm Minimization of Nesterov Acceleration: o(1/k3)cited by 8
  6. 2022Unadjusted Hamiltonian MCMC with Stratified Monte Carlo Time Integrationcited by 8
  7. 2021Convergence Analysis of Schr"odinger-F"ollmer Sampler without Convexitycited by 7
  8. 2022Utilising the CLT Structure in Stochastic Gradient based Sampling : Improved Analysis and Faster Algorithmscited by 7
  9. 2022Bregman Proximal Langevin Monte Carlo via Bregman--Moreau Envelopescited by 7
  10. 2022Statistical and Computational Trade-offs in Variational Inference: A Case Study in Inferential Model Selectioncited by 7
  11. 2023Taming under isoperimetrycited by 7
  12. 2024Tamed Langevin sampling under weaker conditionscited by 7
  13. 2024Kinetic Interacting Particle Langevin Monte Carlocited by 7
  14. 2022Heavy-tailed Sampling via Transformed Unadjusted Langevin Algorithmcited by 6
  15. 2022Constrained Langevin Algorithms with L-mixing External Random Variablescited by 6
  16. 2025Diffusion at Absolute Zero: Langevin Sampling Using Successive Moreau Envelopes [conference paper]cited by 6
  17. 2022Langevin dynamics based algorithm e-THvarepsilonO POULA for stochastic optimization problems with discontinuous stochastic gradientcited by 5
  18. 2025From Global to Local: A Scalable Benchmark for Local Posterior Samplingcited by 5
  19. 2021A Unifying and Canonical Description of Measure-Preserving Diffusionscited by 4
  20. 2022Federated Learning with a Sampling Algorithm under Isoperimetrycited by 4
  21. 2023ELF: Federated Langevin Algorithms with Primal, Dual and Bidirectional Compressioncited by 4
  22. 2023NF-ULA: Langevin Monte Carlo with Normalizing Flow Prior for Imaging Inverse Problemscited by 4
  23. 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithmscited by 4
  24. 2025The Performance Of The Unadjusted Langevin Algorithm Without Smoothness Assumptionscited by 4
  25. 2025Accelerating Langevin Monte Carlo Sampling: A Large Deviations Analysiscited by 4
  26. 2021Unadjusted Langevin algorithm for sampling a mixture of weakly smooth potentialscited by 3
  27. 2022Differentially Private Sampling from Rashomon Sets, and the Universality of Langevin Diffusion for Convex Optimizationcited by 3
  28. 2023Efficient Multimodal Sampling via Tempered Distribution Flowcited by 3
  29. 2023Reflection coupling for unadjusted generalized Hamiltonian Monte Carlo in the nonconvex stochastic gradient casecited by 3
  30. 2025kTULA: A Langevin sampling algorithm with improved KL bounds under super-linear log-gradientscited by 3
  31. 2025Regime-Switching Langevin Monte Carlo Algorithmscited by 3
  32. 2025Exponential Convergence Guarantees for Iterative Markovian Fittingcited by 3
  33. 2021A generalization gap estimation for overparameterized models via the Langevin functional variancecited by 2
  34. 2022Weak Convergence of Approximate reflection coupling and its Application to Non-convex Optimizationcited by 2
  35. 2022A Dynamical System View of Langevin-Based Non-Convex Samplingcited by 2
  36. 2023Approximating Langevin Monte Carlo with ResNet-like Neural Network architecturescited by 2
  37. 2024Kernelized Normalizing Constant Estimation: Bridging Bayesian Quadrature and Bayesian Optimizationcited by 2
  38. 2025Convergence of two-timescale gradient descent ascent dynamics: finite-dimensional and mean-field perspectivescited by 2

50 most cited of 68 All 68 (JSON)