Simulated annealing from continuum to discretization: a convergence analysis via the Eyring--Kramers law
Not on the map. Why?
Abstract (arXiv)
We study the convergence rate of continuous-time simulated annealing (Xt; , t ≥ 0) and its discretization (xk; , k =0,1, ldots) for approximating the global optimum of a given function f. We prove that the tail probability mathbbP(f(Xt) > min f +δ) (resp. mathbbP(f(xk) > min f +δ)) decays polynomial in time (resp. in cumulative step size), and provide an explicit rate as a function of the model parameters. Our argument applies the recent development on functional inequalities for the Gibbs measure at low temperatures -- the Eyring-Kramers law. In the discrete setting, we obtain a condition on the step size to ensure the convergence.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 10 of its 55 references that are in the map. First posted on arXiv 3 Feb 2021.
Builds on
10 of 55 references.
References · 10
- 2017How to Escape Saddle Points Efficientlycited by 284
- 2017Non-convex learning via Stochastic Gradient Langevin Dynamics: a nonasymptotic analysiscited by 242
- 2015Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decompositioncited by 241
- 2019Rapid Convergence of the Unadjusted Langevin Algorithm: Isoperimetry Sufficescited by 224
- 2015Non-asymptotic convergence analysis for the Unadjusted Langevin Algorithmcited by 195
- 2017Non-convex Optimization for Machine Learningcited by 132
- 2018Sampling Can Be Faster Than Optimizationcited by 68
- 2019Is There an Analog of Nesterov Acceleration for MCMC?cited by 19
- 2020State-Dependent Temperature Control for Langevin Diffusionscited by 17
- 2019On Stationary-Point Hitting Time and Ergodicity of Stochastic Gradient Langevin Dynamicscited by 14
Built on by
Citing papers per year: 2022: 2; 2023: 0; 2024: 2; 2025: 1.
5 papers.
- 2022Score-Based Diffusion meets Annealed Importance Samplingcited by 51
- 2022Two-Scale Gradient Descent Ascent Dynamics Finds Mixed Nash Equilibria of Continuous Games: A Mean-Field Perspectivecited by 13
- 2024Variational Learning of Gaussian Process Latent Variable Models through Stochastic Gradient Annealed Importance Samplingcited by 3
- 2024Fisher information dissipation for time inhomogeneous stochastic differential equationscited by 2
- 2025Continuous Policy and Value Iteration for Relaxed Stochastic Control Problems and Its Convergencecited by 1
- 2025Continuous Policy and Value Iteration for Relaxed Stochastic Control Problems and Its Convergence9 Jun 2025
- 2024Variational Learning of Gaussian Process Latent Variable Models through Stochastic Gradient Annealed Importance Sampling13 Aug 2024
- 2024Fisher information dissipation for time inhomogeneous stochastic differential equations1 Feb 2024
- 2022Two-Scale Gradient Descent Ascent Dynamics Finds Mixed Nash Equilibria of Continuous Games: A Mean-Field Perspective17 Dec 2022
- 2022Score-Based Diffusion meets Annealed Importance Sampling16 Aug 2022