mlsanityData to 7 Oct 2026

Barzilai-Borwein Fails Superlinear Convergence on an Open Set of Quadratics for Every Dimension n≥ 4

arXiv 2607.21579 ↗First posted 23 Jul 2026math.OC cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Barzilai--Borwein (BB) method has shown strong practical performance in continuous optimization, yet its convergence dynamics remains poorly understood. In particular, a central unresolved question is whether BB converges superlinearly for almost every strictly convex quadratic problem and initialization. We provide a negative answer to this question. Specifically, for every finite dimension n≥4, we construct a nonempty open, hence positive-Lebesgue-measure, family of strictly convex quadratic problems and initial points for which the long Barzilai--Borwein method (BB1) converges but cannot converge root-superlinearly. More precisely, with the explicit constants ρmin=10-6,ρmax=0.61, every spectral component of the gradient is bounded above and below by the corresponding geometric sequence. Consequently, the gradient norm and the energy norm of the error satisfy two-sided geometric estimates with the same rates, while the objective gap satisfies the corresponding estimates with squared rates. In particular, all three quantities are bounded below by geometric sequences, ruling out superlinear convergence. The construction is highly nontrivial, based on a computer-assisted proof of a nonresonant, attracting seven-cycle of the projectivized BB dynamics in dimension four.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 48 references that are in the map. First posted on arXiv 23 Jul 2026.

Builds on

7 of 48 references.

References · 7

  1. 2016Barzilai-Borwein Step Size for Stochastic Gradient Descentcited by 33
  2. 2019Stabilized Barzilai-Borwein methodcited by 10
  3. 2024AdaBB: Adaptive Barzilai-Borwein Method for Convex Optimizationcited by 8
  4. 2025New Results on the Polyak Stepsize: Tight Convergence Analysis and Universal Function Classescited by 4
  5. 2018A family of spectral gradient methods for optimizationcited by 3
  6. 2021On a Faster R-Linear Convergence Rate of the Barzilai-Borwein Methodcited by 2
  7. 2019On the asymptotic convergence and acceleration of gradient methodscited by 1

Built on by

Not cited yet.