Langevin Monte Carlo without smoothness
Not on the map. Why?
Abstract (arXiv)
Langevin Monte Carlo (LMC) is an iterative algorithm used to generate samples from a distribution that is known only up to a normalizing constant. The nonasymptotic dependence of its mixing time on the dimension and target accuracy is understood mainly in the setting of smooth (gradient-Lipschitz) log-densities, a serious limitation for applications in machine learning. In this paper, we remove this limitation, providing polynomial-time convergence guarantees for a variant of LMC in the setting of nonsmooth log-concave distributions. At a high level, our results follow by leveraging the implicit smoothing of the log-density that comes from a small Gaussian perturbation that we add to the iterates of the algorithm and controlling the bias and variance that are induced by this perturbation.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 9; 2023: 6; 2024: 4; 2025: 5; 2026: 1.
28 papers.
Sort:
By area:
- 2022Towards a Theory of Non-Log-Concave Sampling: First-Order Stationarity Guarantees for Langevin Monte Carlocited by 63
- 2022Private Convex Optimization via Exponential Mechanismcited by 49
- 2021A Proximal Algorithm for Sampling from Non-smooth Potentialscited by 24
- 2024Provable Benefit of Annealed Langevin Monte Carlo for Non-log-concave Samplingcited by 23
- 2022A Proximal Algorithm for Samplingcited by 22
- 2022Resolving the Mixing Time of the Langevin Algorithm to its Stationary Distribution for Log-Concave Samplingcited by 22
- 2022Convergence of Stein Variational Gradient Descent under a Weaker Smoothness Conditioncited by 16
- 2021When is the Convergence Time of Langevin Algorithms Dimension Independent? A Composite Optimization Viewpointcited by 12
- 2024Fast Convergence of Phi-Divergence Along the Unadjusted Langevin Algorithm and Proximal Samplercited by 11
- 2023Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisitedcited by 10
- 2022Bregman Proximal Langevin Monte Carlo via Bregman--Moreau Envelopescited by 7
- 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithmscited by 4
16 more
- 2024Convergence of Unadjusted Langevin in High Dimensions: Delocalization of Biascited by 4
- 2024Sampling from multi-modal distributions with polynomial query complexity in fixed dimension via reverse diffusioncited by 4
- 2025The Performance Of The Unadjusted Langevin Algorithm Without Smoothness Assumptionscited by 4
- 2021Unadjusted Langevin algorithm for sampling a mixture of weakly smooth potentialscited by 3
- 2025Anchored Langevin Algorithmscited by 3
- 2022A Proximal Algorithm for Sampling from Non-convex Potentialscited by 2
- 2022Stochastic Langevin Differential Inclusions with Applications to Machine Learningcited by 2
- 2025Efficient Bayesian Computation Using Plug-and-Play Priors for Poisson Inverse Problemscited by 2
- 2022Covid19 Reproduction Number: Credibility Intervals by Blockwise Proximal Monte Carlo Samplerscited by 1
- 2023Efficient Sampling of Stochastic Differential Equations with Positive Semi-Definite Modelscited by 1
- 2023Non-asymptotic analysis of Langevin-type Monte Carlo algorithmscited by 0
- 2023A Gentle Introduction to Gradient-Based Optimization and Variational Inequalities for Machine Learningcited by 0
- 2023Ito Diffusion Approximation of Universal Ito Chains for Sampling, Optimization and Boostingcited by 0
- 2025Mixing Times and Privacy Analysis for the Projected Langevin Algorithm under a Modulus of Continuitycited by 0
- 2025Estimating Multi-chirp Parameters using Curvature-guided Langevin Monte Carlocited by 0
- 2026In-Context Batch Black-box Optimization via Flow Matchingcited by 0
- 2026In-Context Batch Black-box Optimization via Flow Matching14 Oct 2026
- 2025Anchored Langevin Algorithms23 Sep 2025
- 2025Efficient Bayesian Computation Using Plug-and-Play Priors for Poisson Inverse Problems20 Mar 2025
- 2025The Performance Of The Unadjusted Langevin Algorithm Without Smoothness Assumptions5 Feb 2025
- 2025Estimating Multi-chirp Parameters using Curvature-guided Langevin Monte Carlo30 Jan 2025
- 2025Mixing Times and Privacy Analysis for the Projected Langevin Algorithm under a Modulus of Continuity7 Jan 2025
- 2024Sampling from multi-modal distributions with polynomial query complexity in fixed dimension via reverse diffusion31 Dec 2024
- 2024Fast Convergence of Phi-Divergence Along the Unadjusted Langevin Algorithm and Proximal Sampler14 Oct 2024
- 2024Convergence of Unadjusted Langevin in High Dimensions: Delocalization of Bias20 Aug 2024
- 2024Provable Benefit of Annealed Langevin Monte Carlo for Non-log-concave Sampling24 Jul 2024
- 2023Ito Diffusion Approximation of Universal Ito Chains for Sampling, Optimization and Boosting9 Oct 2023
- 2023A Gentle Introduction to Gradient-Based Optimization and Variational Inequalities for Machine Learning9 Sep 2023
16 more
- 2023Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisited14 Jun 2023
- 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithms25 May 2023
- 2023Efficient Sampling of Stochastic Differential Equations with Positive Semi-Definite Models30 Mar 2023
- 2023Non-asymptotic analysis of Langevin-type Monte Carlo algorithms22 Mar 2023
- 2022Resolving the Mixing Time of the Langevin Algorithm to its Stationary Distribution for Log-Concave Sampling16 Oct 2022
- 2022Bregman Proximal Langevin Monte Carlo via Bregman--Moreau Envelopes10 Jul 2022
- 2022Stochastic Langevin Differential Inclusions with Applications to Machine Learning23 Jun 2022
- 2022Convergence of Stein Variational Gradient Descent under a Weaker Smoothness Condition1 Jun 2022
- 2022A Proximal Algorithm for Sampling from Non-convex Potentials20 May 2022
- 2022Covid19 Reproduction Number: Credibility Intervals by Blockwise Proximal Monte Carlo Samplers17 Mar 2022
- 2022Private Convex Optimization via Exponential Mechanism1 Mar 2022
- 2022A Proximal Algorithm for Sampling28 Feb 2022
- 2022Towards a Theory of Non-Log-Concave Sampling: First-Order Stationarity Guarantees for Langevin Monte Carlo10 Feb 2022
- 2021Unadjusted Langevin algorithm for sampling a mixture of weakly smooth potentials17 Dec 2021
- 2021A Proximal Algorithm for Sampling from Non-smooth Potentials9 Oct 2021
- 2021When is the Convergence Time of Langevin Algorithms Dimension Independent? A Composite Optimization Viewpoint5 Oct 2021
- 2026In-Context Batch Black-box Optimization via Flow Matching14 Oct 2026
- 2022Towards a Theory of Non-Log-Concave Sampling: First-Order Stationarity Guarantees for Langevin Monte Carlocited by 63
- 2022Private Convex Optimization via Exponential Mechanismcited by 49
- 2021A Proximal Algorithm for Sampling from Non-smooth Potentialscited by 24
- 2024Provable Benefit of Annealed Langevin Monte Carlo for Non-log-concave Samplingcited by 23
- 2022A Proximal Algorithm for Samplingcited by 22
- 2022Resolving the Mixing Time of the Langevin Algorithm to its Stationary Distribution for Log-Concave Samplingcited by 22
- 2022Convergence of Stein Variational Gradient Descent under a Weaker Smoothness Conditioncited by 16
- 2021When is the Convergence Time of Langevin Algorithms Dimension Independent? A Composite Optimization Viewpointcited by 12
- 2024Fast Convergence of Phi-Divergence Along the Unadjusted Langevin Algorithm and Proximal Samplercited by 11
- 2023Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisitedcited by 10
- 2022Bregman Proximal Langevin Monte Carlo via Bregman--Moreau Envelopescited by 7
- 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithmscited by 4
12 most cited of 27 All 27 (JSON)
- 2025Anchored Langevin Algorithms23 Sep 2025
- 2025Efficient Bayesian Computation Using Plug-and-Play Priors for Poisson Inverse Problems20 Mar 2025
- 2025The Performance Of The Unadjusted Langevin Algorithm Without Smoothness Assumptions5 Feb 2025
- 2025Estimating Multi-chirp Parameters using Curvature-guided Langevin Monte Carlo30 Jan 2025
- 2025Mixing Times and Privacy Analysis for the Projected Langevin Algorithm under a Modulus of Continuity7 Jan 2025
- 2024Sampling from multi-modal distributions with polynomial query complexity in fixed dimension via reverse diffusion31 Dec 2024
- 2024Fast Convergence of Phi-Divergence Along the Unadjusted Langevin Algorithm and Proximal Sampler14 Oct 2024
- 2024Convergence of Unadjusted Langevin in High Dimensions: Delocalization of Bias20 Aug 2024
- 2024Provable Benefit of Annealed Langevin Monte Carlo for Non-log-concave Sampling24 Jul 2024
- 2023Ito Diffusion Approximation of Universal Ito Chains for Sampling, Optimization and Boosting9 Oct 2023
- 2023A Gentle Introduction to Gradient-Based Optimization and Variational Inequalities for Machine Learning9 Sep 2023
- 2023Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisited14 Jun 2023
12 newest of 27 All 27 (JSON)