Restarting accelerated gradient methods with a rough strong convexity estimate
Not on the map. Why?
Abstract (arXiv)
We propose new restarting strategies for accelerated gradient and accelerated coordinate descent methods. Our main contribution is to show that the restarted method has a geometric rate of convergence for any restarting frequency, and so it allows us to take profit of restarting even when we do not know the strong convexity coefficient. The scheme can be combined with adaptive restarting, leading to the first provable convergence for adaptive restarting schemes with accelerated gradient methods. Finally, we illustrate the properties of the algorithm on a regularized logistic regression problem and on a Lasso problem.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Sep 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 1.
3 papers.
- 2023Restarts subject to approximate sharpness: A parameter-free and optimal scheme for first-order methodscited by 2
- 2021WARPd: A linearly convergent first-order method for inverse problems with approximate sharpness conditionscited by 1
- 2022Gradient Descent-Type Methods: Background and Simple Unified Convergence Analysiscited by 1
- 2023Restarts subject to approximate sharpness: A parameter-free and optimal scheme for first-order methods5 Jan 2023
- 2022Gradient Descent-Type Methods: Background and Simple Unified Convergence Analysis19 Dec 2022
- 2021WARPd: A linearly convergent first-order method for inverse problems with approximate sharpness conditions24 Oct 2021