Convergence of the Forward-Backward Algorithm: Beyond the Worst Case with the Help of Geometry
Not on the map. Why?
Abstract (arXiv)
We provide a comprehensive study of the convergence of the forward-backward algorithm under suitable geometric conditions, such as conditioning or Lojasiewicz properties. These geometrical notions are usually local by nature, and may fail to describe the fine geometry of objective functions relevant in inverse problems and signal processing, that have a nice behaviour on manifolds, or sets open with respect to a weak topology. Motivated by this observation, we revisit those geometric notions over arbitrary sets. In turn, this allows us to present several new results as well as collect in a unified view a variety of results scattered in the literature. Our contributions include the analysis of infinite dimensional convex minimization problems, showing the first Lojasiewicz inequality for a quadratic function associated to a compact operator, and the derivation of new linear rates for problems arising from inverse problems with low-complexity priors. Our approach allows to establish unexpected connections between geometry and a priori conditions in inverse problems, such as source conditions, or restricted isometry properties.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 2; 2023: 2; 2024: 1; 2025: 2.
7 papers.
- 2023Gradient-free optimization of highly smooth functions: improved analysis and a new algorithmcited by 12
- 2022Differentiating Nonsmooth Solutions to Parametric Monotone Inclusion Problemscited by 5
- 2023Variance reduction techniques for stochastic proximal point algorithmscited by 3
- 2025Controlling the Flow: Stability and Convergence for Stochastic Gradient Descent with Decaying Regularizationcited by 3
- 2024Polyak's Heavy Ball Method Achieves Accelerated Local Rate of Convergence under Polyak-Lojasiewicz Inequalitycited by 2
- 2025Bias-Optimal Bounds for SGD: A Computer-Aided Lyapunov Analysiscited by 2
- 2022Iterative regularization in classification via hinge loss diagonal descentcited by 0
- 2025Bias-Optimal Bounds for SGD: A Computer-Aided Lyapunov Analysis23 May 2025
- 2025Controlling the Flow: Stability and Convergence for Stochastic Gradient Descent with Decaying Regularization16 May 2025
- 2024Polyak's Heavy Ball Method Achieves Accelerated Local Rate of Convergence under Polyak-Lojasiewicz Inequality22 Oct 2024
- 2023Variance reduction techniques for stochastic proximal point algorithms18 Aug 2023
- 2023Gradient-free optimization of highly smooth functions: improved analysis and a new algorithm3 Jun 2023
- 2022Iterative regularization in classification via hinge loss diagonal descent24 Dec 2022
- 2022Differentiating Nonsmooth Solutions to Parametric Monotone Inclusion Problems15 Dec 2022