Exact Optimal Accelerated Complexity for Fixed-Point Iterations
Not on the map. Why?
Abstract (arXiv)
Despite the broad use of fixed-point iterations throughout applied mathematics, the optimal convergence rate of general fixed-point problems with nonexpansive nonlinear operators has not been established. This work presents an acceleration mechanism for fixed-point iterations with nonexpansive operators, contractive operators, and nonexpansive operators satisfying a H"older-type growth condition. We then provide matching complexity lower bounds to establish the exact optimality of the acceleration mechanisms in the nonexpansive and contractive setups. Finally, we provide experiments with CT imaging, optimal transport, and decentralized optimization to demonstrate the practical effectiveness of the acceleration mechanism.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Jan 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 5; 2025: 5; 2026: 8.
23 papers.
Sort:
By area:
- 2024PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compressioncited by 59
- 2022Accelerated Algorithms for Constrained Nonconvex-Nonconcave Min-Max Optimization and Comonotone Inclusioncited by 19
- 2025Towards Weaker Variance Assumptions for Stochastic Optimizationcited by 13
- 2024Stochastic Halpern iteration in normed spaces and applications to reinforcement learningcited by 11
- 2023Accelerating Value Iteration with Anchoringcited by 10
- 2023Variance Reduced Halpern Iteration for Finite-Sum Monotone Inclusionscited by 10
- 2024Fundamental Benefit of Alternating Updates in Minimax Optimizationcited by 9
- 2023Sublinear Convergence Rates of Extragradient-Type Methods: A Survey on Classical and Recent Developmentscited by 5
- 2026Direct Acceleration of Stochastic Root-Finding Without Variance Reduction and Regularizationcited by 3
- 2024Variance-Reduced Fast Krasnoselkii-Mann Methods for Finite-Sum Root-Finding Problemscited by 2
- 2025Model-Free Robust Average-Reward Reinforcement Learning with Sample Complexity Analysiscited by 2
- 2025Faster Fixed-Point Methods for Multichain MDPscited by 2
11 more
- 2025Finite-Time Bounds for Average-Reward Fitted Q-Iterationcited by 1
- 2025A Class of Accelerated Fixed-Point-Based Methods with Delayed Inexact Oracles and Its Applicationscited by 1
- 2026Learning Policy from a Single Trajectory in Average-Reward Markov Decision Processcited by 1
- 2023Extragradient-Type Methods with O (1/k) Last-Iterate Convergence Rates for Co-Hypomonotone Inclusionscited by 0
- 2024HPPP: Halpern-type Preconditioned Proximal Point Algorithms and Applications to Image Restorationcited by 0
- 2026RAMPAGE: RAndomized Mid-Point for debiAsed Gradient Extrapolationcited by 0
- 2026A Unifying View of Anchoring via Operator-Side Tikhonov Regularizationcited by 0
- 2026Provable Parameter-Free Fixed-Point Algorithms with Linear Convergence Ratescited by 0
- 2026Oracle Complexity of Stochastic Fixed-Point Equations with Nonexpansive Mapscited by 0
- 2026Stochastic Inertial Krasnosel'skii-Mann Iteration Achieves Near-Optimal Sample Complexitycited by 0
- 2026Dual-Anchor Acceleration Is Near-Optimal for Stochastic Monotone Root-Findingcited by 0
- 2026Dual-Anchor Acceleration Is Near-Optimal for Stochastic Monotone Root-Finding28 Sep 2026
- 2026Stochastic Inertial Krasnosel'skii-Mann Iteration Achieves Near-Optimal Sample Complexity22 Sep 2026
- 2026Oracle Complexity of Stochastic Fixed-Point Equations with Nonexpansive Maps8 Sep 2026
- 2026Direct Acceleration of Stochastic Root-Finding Without Variance Reduction and Regularization12 Aug 2026
- 2026Provable Parameter-Free Fixed-Point Algorithms with Linear Convergence Rates10 Aug 2026
- 2026Learning Policy from a Single Trajectory in Average-Reward Markov Decision Process15 Jun 2026
- 2026A Unifying View of Anchoring via Operator-Side Tikhonov Regularization29 May 2026
- 2026RAMPAGE: RAndomized Mid-Point for debiAsed Gradient Extrapolation23 Mar 2026
- 2025A Class of Accelerated Fixed-Point-Based Methods with Delayed Inexact Oracles and Its Applications15 Dec 2025
- 2025Finite-Time Bounds for Average-Reward Fitted Q-Iteration20 Oct 2025
- 2025Faster Fixed-Point Methods for Multichain MDPs26 Jun 2025
- 2025Model-Free Robust Average-Reward Reinforcement Learning with Sample Complexity Analysis18 May 2025
11 more
- 2025Towards Weaker Variance Assumptions for Stochastic Optimization14 Apr 2025
- 2024HPPP: Halpern-type Preconditioned Proximal Point Algorithms and Applications to Image Restoration18 Jul 2024
- 2024Variance-Reduced Fast Krasnoselkii-Mann Methods for Finite-Sum Root-Finding Problems4 Jun 2024
- 2024PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression23 May 2024
- 2024Stochastic Halpern iteration in normed spaces and applications to reinforcement learning19 Mar 2024
- 2024Fundamental Benefit of Alternating Updates in Minimax Optimization16 Feb 2024
- 2023Variance Reduced Halpern Iteration for Finite-Sum Monotone Inclusions4 Oct 2023
- 2023Accelerating Value Iteration with Anchoring26 May 2023
- 2023Sublinear Convergence Rates of Extragradient-Type Methods: A Survey on Classical and Recent Developments30 Mar 2023
- 2023Extragradient-Type Methods with O (1/k) Last-Iterate Convergence Rates for Co-Hypomonotone Inclusions8 Feb 2023
- 2022Accelerated Algorithms for Constrained Nonconvex-Nonconcave Min-Max Optimization and Comonotone Inclusion10 Jun 2022
- 2025Finite-Time Bounds for Average-Reward Fitted Q-Iterationcited by 1
- 2025Finite-Time Bounds for Average-Reward Fitted Q-Iteration20 Oct 2025
- 2024PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compressioncited by 59
- 2022Accelerated Algorithms for Constrained Nonconvex-Nonconcave Min-Max Optimization and Comonotone Inclusioncited by 19
- 2025Towards Weaker Variance Assumptions for Stochastic Optimizationcited by 13
- 2024Stochastic Halpern iteration in normed spaces and applications to reinforcement learningcited by 11
- 2023Accelerating Value Iteration with Anchoringcited by 10
- 2023Variance Reduced Halpern Iteration for Finite-Sum Monotone Inclusionscited by 10
- 2024Fundamental Benefit of Alternating Updates in Minimax Optimizationcited by 9
- 2023Sublinear Convergence Rates of Extragradient-Type Methods: A Survey on Classical and Recent Developmentscited by 5
- 2026Direct Acceleration of Stochastic Root-Finding Without Variance Reduction and Regularizationcited by 3
- 2024Variance-Reduced Fast Krasnoselkii-Mann Methods for Finite-Sum Root-Finding Problemscited by 2
- 2025Model-Free Robust Average-Reward Reinforcement Learning with Sample Complexity Analysiscited by 2
- 2025Faster Fixed-Point Methods for Multichain MDPscited by 2
12 most cited of 22 All 22 (JSON)
- 2026Dual-Anchor Acceleration Is Near-Optimal for Stochastic Monotone Root-Finding28 Sep 2026
- 2026Stochastic Inertial Krasnosel'skii-Mann Iteration Achieves Near-Optimal Sample Complexity22 Sep 2026
- 2026Oracle Complexity of Stochastic Fixed-Point Equations with Nonexpansive Maps8 Sep 2026
- 2026Direct Acceleration of Stochastic Root-Finding Without Variance Reduction and Regularization12 Aug 2026
- 2026Provable Parameter-Free Fixed-Point Algorithms with Linear Convergence Rates10 Aug 2026
- 2026Learning Policy from a Single Trajectory in Average-Reward Markov Decision Process15 Jun 2026
- 2026A Unifying View of Anchoring via Operator-Side Tikhonov Regularization29 May 2026
- 2026RAMPAGE: RAndomized Mid-Point for debiAsed Gradient Extrapolation23 Mar 2026
- 2025A Class of Accelerated Fixed-Point-Based Methods with Delayed Inexact Oracles and Its Applications15 Dec 2025
- 2025Faster Fixed-Point Methods for Multichain MDPs26 Jun 2025
- 2025Model-Free Robust Average-Reward Reinforcement Learning with Sample Complexity Analysis18 May 2025
- 2025Towards Weaker Variance Assumptions for Stochastic Optimization14 Apr 2025
12 newest of 22 All 22 (JSON)