Optimal Complexity and Certification of Bregman First-Order Methods
Not on the map. Why?
Abstract (arXiv)
We provide a lower bound showing that the O(1/k) convergence rate of the NoLips method (a.k.a. Bregman Gradient) is optimal for the class of functions satisfying the h-smoothness assumption. This assumption, also known as relative smoothness, appeared in the recent developments around the Bregman Gradient method, where acceleration remained an open issue. On the way, we show how to constructively obtain the corresponding worst-case functions by extending the computer-assisted performance estimation framework of Drori and Teboulle (Mathematical Programming, 2014) to Bregman first-order methods, and to handle the classes of differentiable and strictly convex functions.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 3; 2023: 1; 2024: 1; 2025: 2; 2026: 4.
16 papers.
Sort:
- 2023Provably Faster Gradient Descent via Long Stepscited by 20
- 2022Tight Last-Iterate Convergence of the Extragradient and the Optimistic Gradient Descent-Ascent Algorithm for Constrained Monotone Variational Inequalitiescited by 19
- 2021Acceleration in Distributed Optimization under Similaritycited by 17
- 2022Sharper Rates for Separable Minimax and Finite Sum Optimization via Primal-Dual Extragradient Methodscited by 15
- 2024Taming Nonconvex Stochastic Mirror Descent with General Bregman Divergencecited by 11
- 2021Complementary Composite Minimization, Small Gradients in General Norms, and Applicationscited by 9
- 2022Bregman Proximal Langevin Monte Carlo via Bregman--Moreau Envelopescited by 7
- 2021First-Order Methods for Convex Optimizationcited by 4
- 2021Concentration of Non-Isotropic Random Tensors with Applications to Learning and Empirical Risk Minimizationcited by 4
- 2021Adaptive first-order methods revisited: Convex optimization without Lipschitz requirementscited by 4
- 2025On exploration of an interior mirror descent flow for stochastic nonconvex constrained problemcited by 3
- 2026In-Expectation Convergence of Stochastic Gradient Methods under Heavy-Tailed Noisecited by 3
4 more
- 2025Several Performance Bounds on Decentralized Online Optimization are Highly Conservative and Potentially Misleadingcited by 2
- 2026Beyond Averaging in John Ellipsoid Approximation: High-Accuracy Algorithms in the Leverage-Score Modelcited by 0
- 2026Entropy-Smooth Convex Optimization Cannot Be Acceleratedcited by 0
- 2026Mirror descent algorithms with logarithmic barrierscited by 0
- 2026Mirror descent algorithms with logarithmic barriers24 Aug 2026
- 2026Entropy-Smooth Convex Optimization Cannot Be Accelerated29 Jul 2026
- 2026Beyond Averaging in John Ellipsoid Approximation: High-Accuracy Algorithms in the Leverage-Score Model18 Jun 2026
- 2026In-Expectation Convergence of Stochastic Gradient Methods under Heavy-Tailed Noise30 May 2026
- 2025Several Performance Bounds on Decentralized Online Optimization are Highly Conservative and Potentially Misleading8 Sep 2025
- 2025On exploration of an interior mirror descent flow for stochastic nonconvex constrained problem21 Jul 2025
- 2024Taming Nonconvex Stochastic Mirror Descent with General Bregman Divergence27 Feb 2024
- 2023Provably Faster Gradient Descent via Long Steps12 Jul 2023
- 2022Bregman Proximal Langevin Monte Carlo via Bregman--Moreau Envelopes10 Jul 2022
- 2022Tight Last-Iterate Convergence of the Extragradient and the Optimistic Gradient Descent-Ascent Algorithm for Constrained Monotone Variational Inequalities20 Apr 2022
- 2022Sharper Rates for Separable Minimax and Finite Sum Optimization via Primal-Dual Extragradient Methods9 Feb 2022
- 2021Acceleration in Distributed Optimization under Similarity24 Oct 2021
4 more
- 2021Adaptive first-order methods revisited: Convex optimization without Lipschitz requirements16 Jul 2021
- 2021Concentration of Non-Isotropic Random Tensors with Applications to Learning and Empirical Risk Minimization4 Feb 2021
- 2021Complementary Composite Minimization, Small Gradients in General Norms, and Applications26 Jan 2021
- 2021First-Order Methods for Convex Optimization4 Jan 2021
- 2023Provably Faster Gradient Descent via Long Stepscited by 20
- 2022Tight Last-Iterate Convergence of the Extragradient and the Optimistic Gradient Descent-Ascent Algorithm for Constrained Monotone Variational Inequalitiescited by 19
- 2021Acceleration in Distributed Optimization under Similaritycited by 17
- 2022Sharper Rates for Separable Minimax and Finite Sum Optimization via Primal-Dual Extragradient Methodscited by 15
- 2024Taming Nonconvex Stochastic Mirror Descent with General Bregman Divergencecited by 11
- 2021Complementary Composite Minimization, Small Gradients in General Norms, and Applicationscited by 9
- 2022Bregman Proximal Langevin Monte Carlo via Bregman--Moreau Envelopescited by 7
- 2021First-Order Methods for Convex Optimizationcited by 4
- 2021Concentration of Non-Isotropic Random Tensors with Applications to Learning and Empirical Risk Minimizationcited by 4
- 2021Adaptive first-order methods revisited: Convex optimization without Lipschitz requirementscited by 4
- 2025On exploration of an interior mirror descent flow for stochastic nonconvex constrained problemcited by 3
- 2026In-Expectation Convergence of Stochastic Gradient Methods under Heavy-Tailed Noisecited by 3
12 most cited of 16 All 16 (JSON)
- 2026Mirror descent algorithms with logarithmic barriers24 Aug 2026
- 2026Entropy-Smooth Convex Optimization Cannot Be Accelerated29 Jul 2026
- 2026Beyond Averaging in John Ellipsoid Approximation: High-Accuracy Algorithms in the Leverage-Score Model18 Jun 2026
- 2026In-Expectation Convergence of Stochastic Gradient Methods under Heavy-Tailed Noise30 May 2026
- 2025Several Performance Bounds on Decentralized Online Optimization are Highly Conservative and Potentially Misleading8 Sep 2025
- 2025On exploration of an interior mirror descent flow for stochastic nonconvex constrained problem21 Jul 2025
- 2024Taming Nonconvex Stochastic Mirror Descent with General Bregman Divergence27 Feb 2024
- 2023Provably Faster Gradient Descent via Long Steps12 Jul 2023
- 2022Bregman Proximal Langevin Monte Carlo via Bregman--Moreau Envelopes10 Jul 2022
- 2022Tight Last-Iterate Convergence of the Extragradient and the Optimistic Gradient Descent-Ascent Algorithm for Constrained Monotone Variational Inequalities20 Apr 2022
- 2022Sharper Rates for Separable Minimax and Finite Sum Optimization via Primal-Dual Extragradient Methods9 Feb 2022
- 2021Acceleration in Distributed Optimization under Similarity24 Oct 2021
12 newest of 16 All 16 (JSON)