Geometric Moment Contraction for Stochastic Nesterov Acceleration
Not on the map. Why?
Abstract (arXiv)
We study geometric moment contraction (GMC) of the constant-parameter stochastic Nesterov recursion [ Yk=Thetak+β(Thetak-Thetak-1),qquad Thetak+1=Yk-γ G(Yk,Xk+1). ] Under mean strong monotonicity and stochastic Lp Lipschitz continuity, an explicit Perron comparison proves synchronous Lp contraction when βγ Lp<(1-β)(1-qγ,p). This direct criterion includes infinite-variance gradients for 1<p<2, but its small-step regime requires β<μ/(μ+Lp). A complementary power-Lyapunov argument establishes a positive, generally much smaller, step-size interval for every fixed β<1 and every p>1, using only a finite pth gradient moment. At p=2, a simpler explicit certificate gives [ 0<γ<frac2μ(1-β)2L22(1-β+2β2). ] Its quadratic high-momentum scaling is a limitation of the chosen metric, not a sharp stability boundary. We quantify this loss, provide a general mean-only quadratic S-procedure, and exploit endpoint Lyapunov inequalities under stronger samplewise sector information. Verified endpoint certificates can be orders of magnitude less conservative than the explicit metric.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 109 references that are in the map. First posted on arXiv 25 Sep 2026.
Builds on
15 of 109 references.
References · 15
- 2016Unified Convergence Analysis of Stochastic Momentum Methods for Convex and Non-convex Optimizationcited by 37
- 2023Convergence and concentration properties of constant step-size SGD through Markov chainscited by 11
- 2023Acceleration of stochastic gradient descent with momentum by averaging: finite-sample rates and asymptotic normalitycited by 9
- 2022Revisiting the central limit theorems for the SGD-type methodscited by 7
- 2024Nesterov acceleration in benignly non-convex landscapescited by 7
- 2024Limit Theorems for Stochastic Gradient Descent with Infinite Variancecited by 4
- 2023The Anytime Convergence of Stochastic Gradient Descent with Momentum: From a Continuous-Time Perspectivecited by 3
- 2026SHANG++: Robust Stochastic Acceleration under Multiplicative Noisecited by 3
- 2025Algorithmic Stability of Stochastic Gradient Descent with Momentum under Heavy-Tailed Noisecited by 2
- 2026Statistical Inference for Stochastic Gradient Descent: Beyond Finite Variancecited by 2
- 2026A Polyak-Ruppert Central Limit Theorem for SA-Adam with Momentum and Non-Convergent Adaptive Preconditioningcited by 2
- 2024Delayed supermartingale convergence lemmas for stochastic approximation with Nesterov momentumcited by 1
Built on by
Not cited yet.