On the convergence of gradient-like flows with noisy gradient input
Not on the map. Why?
Abstract (arXiv)
In view of solving convex optimization problems with noisy gradient input, we analyze the asymptotic behavior of gradient-like flows under stochastic disturbances. Specifically, we focus on the widely studied class of mirror descent schemes for convex programs with compact feasible regions, and we examine the dynamics' convergence and concentration properties in the presence of noise. In the vanishing noise limit, we show that the dynamics converge to the solution set of the underlying problem (a.s.). Otherwise, when the noise is persistent, we show that the dynamics are concentrated around interior solutions in the long run, and they converge to boundary solutions that are sufficiently "sharp". Finally, we show that a suitably rectified variant of the method converges irrespective of the magnitude of the noise (or the structure of the underlying convex program), and we derive an explicit estimate for its rate of convergence.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 0; 2023: 0; 2024: 0; 2025: 2; 2026: 1.
7 papers.
- 2021Adaptive Learning in Continuous Games: Optimal Regret Bounds and Convergence to Nash Equilibriumcited by 51
- 2021Learning in nonatomic games, Part I: Finite action spaces and population gamescited by 7
- 2021Zeroth-order non-convex learning via hierarchical dual averagingcited by 6
- 2021First-Order Methods for Convex Optimizationcited by 4
- 2025The impact of uncertainty on regularized learning in gamescited by 2
- 2026Adaptive Methods Are Preferable in High Privacy Settings: An SDE Perspectivecited by 2
- 2025Multi-agent learning under uncertainty: Recurrence vs. concentrationcited by 0
- 2026Adaptive Methods Are Preferable in High Privacy Settings: An SDE Perspective3 Mar 2026
- 2025Multi-agent learning under uncertainty: Recurrence vs. concentration9 Dec 2025
- 2025The impact of uncertainty on regularized learning in games16 Jun 2025
- 2021Zeroth-order non-convex learning via hierarchical dual averaging13 Sep 2021
- 2021Learning in nonatomic games, Part I: Finite action spaces and population games4 Jul 2021
- 2021Adaptive Learning in Continuous Games: Optimal Regret Bounds and Convergence to Nash Equilibrium26 Apr 2021
- 2021First-Order Methods for Convex Optimization4 Jan 2021