A closed-measure approach to stochastic approximation
Not on the map. Why?
Abstract (arXiv)
This paper introduces a new method to tackle the issue of the almost sure convergence of stochastic approximation algorithms defined from a differential inclusion. Under the assumption of slowly decaying step-sizes, we establish that the set of essential accumulation points of the iterates belongs to the Birkhoff center associated with the differential inclusion. Unlike previous works, our results do not rely on the notion of asymptotic pseudotrajectories introduced by Bena"im--Hofbauer--Sorin, which is the predominant technique to address the convergence problem. They follow as a consequence of Young's superposition principle for closed measures. This perspective bridges the gap between Young's principle and the notion of invariant measure of set-valued dynamical systems introduced by Faure and Roth. Also, the proposed method allows to obtain sufficient conditions under which the velocities locally compensate around any essential accumulation point.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Dec 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 2; 2024: 2.
4 papers.
- 2023Adam-family Methods with Decoupled Weight Decay in Deep Learningcited by 5
- 2023Stochastic Subgradient Methods with Guaranteed Global Stability in Nonsmooth Nonconvex Optimizationcited by 3
- 2024Developing Lagrangian-based Methods for Nonsmooth Nonconvex Optimizationcited by 2
- 2024Convergence of Decentralized Stochastic Subgradient-based Methods for Nonsmooth Nonconvex functionscited by 1
- 2024Developing Lagrangian-based Methods for Nonsmooth Nonconvex Optimization15 Apr 2024
- 2024Convergence of Decentralized Stochastic Subgradient-based Methods for Nonsmooth Nonconvex functions18 Mar 2024
- 2023Adam-family Methods with Decoupled Weight Decay in Deep Learning13 Oct 2023
- 2023Stochastic Subgradient Methods with Guaranteed Global Stability in Nonsmooth Nonconvex Optimization19 Jul 2023