mlsanityData to 14 Oct 2026

The rate of convergence of Nesterov's accelerated forward-backward method is actually faster than 1/k2

arXiv 1510.08740 ↗First posted 29 Oct 2015math.OCcited by 15

Not on the map. Why?

Abstract (arXiv)

The it forward-backward algorithm is a powerful tool for solving optimization problems with a it additively separable and it smooth + it nonsmooth structure. In the convex setting, a simple but ingenious acceleration scheme developed by Nesterov has been proved useful to improve the theoretical rate of convergence for the function values from the standard mathcal O(k-1) down to mathcal O(k-2). In this short paper, we prove that the rate of convergence of a slight variant of Nesterov's accelerated forward-backward method, which produces it convergent sequences, is actually o(k-2), rather than mathcal O(k-2). Our arguments rely on the connection between this algorithm and a second-order differential inclusion with vanishing damping.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Oct 2015.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 3; 2023: 4; 2024: 3; 2025: 4.

15 papers.

Sort:

  1. 2022Gradient Norm Minimization of Nesterov Acceleration: o(1/k3)cited by 8
  2. 2022Proximal Subgradient Norm Minimization of ISTA and FISTAcited by 6
  3. 2023Sublinear Convergence Rates of Extragradient-Type Methods: A Survey on Classical and Recent Developmentscited by 5
  4. 2023A qualitative difference between gradient flows of convex functions in finite- and infinite-dimensional Hilbert spacescited by 3
  5. 2024Variance-Reduced Fast Krasnoselkii-Mann Methods for Finite-Sum Root-Finding Problemscited by 3
  6. 2021Faster Convergence in Deep-Predictive-Coding Networks to Learn Deeper Representationscited by 2
  7. 2025Towards understanding Accelerated Stein Variational Gradient Flow -- Analysis of Generalized Bilinear Kernels for Gaussian target distributionscited by 2
  8. 2022A globally convergent fast iterative shrinkage-thresholding algorithm with a new momentum factor for single and multi-objective convex optimizationcited by 1
  9. 2023On Underdamped Nesterov's Accelerationcited by 1
  10. 2023Linear convergence of forward-backward accelerated algorithms without knowledge of the modulus of strong convexitycited by 1
  11. 2025A Class of Accelerated Fixed-Point-Based Methods with Delayed Inexact Oracles and Its Applicationscited by 1
  12. 2024FolkTalent: Enhancing Classification and Tagging of Indian Folk Paintingscited by 0
3 more
  1. 2024Lyapunov Analysis For Monotonically Forward-Backward Accelerated Algorithmscited by 0
  2. 2025Sequential Regression Learning with Randomized Algorithmscited by 0
  3. 2025Convexity of Optimization Curves: Local Sharp Thresholds, Robustness Impossibility, and New Counterexamplescited by 0