mlsanityData to 7 Oct 2026

Regularized Nonlinear Acceleration

arXiv 1606.04133 ↗First posted 13 Jun 2016math.OCcited by 18

Not on the map. Why?

Abstract (arXiv)

We describe a convergence acceleration technique for unconstrained optimization problems. Our scheme computes estimates of the optimum from a nonlinear average of the iterates produced by any optimization method. The weights in this average are computed via a simple linear system, whose solution can be updated online. This acceleration scheme runs in parallel to the base algorithm, providing improved estimates of the solution on the fly, while the original optimization method is running. Numerical experiments are detailed on classical classification problems.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Jun 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 4; 2023: 4; 2024: 3; 2025: 1; 2026: 2.

18 papers.

Sort:

By area:

  1. 2023On Efficient Training of Large-Scale Deep Learning Models: A Literature Reviewcited by 26
  2. 2022Faster Unbalanced Optimal Transport: Translation invariant Sinkhorn and 1-D Frank-Wolfecited by 22
  3. 2025Multivariate Conformal Prediction using Optimal Transportcited by 21
  4. 2022Beyond L1: Faster and Better Sparse Models with skglmcited by 16
  5. 2022Proof-of-Learning is Currently More Broken Than You Thinkcited by 12
  6. 2023Accelerating Value Iteration with Anchoringcited by 10
  7. 2021Stochastic Anderson Mixing for Nonconvex Stochastic Optimizationcited by 6
  8. 2022Riemannian accelerated gradient methods via extrapolationcited by 5
  9. 2021Stable Anderson Acceleration for Deep Learningcited by 2
  10. 2021Fast symplectic integrator for Nesterov-type acceleration methodcited by 1
  11. 2024Function Extrapolation with Neural Networks and Its Application for Manifoldscited by 1
  12. 2021Anderson Acceleration as a Krylov Method with Application to Asymptotic Convergence Analysiscited by 0
6 more
  1. 2023Optimization using Parallel Gradient Evaluations on Multiple Parameterscited by 0
  2. 2023Improved Convergence Factor of Windowed Anderson Acceleration for Symmetric Fixed-Point Iterationscited by 0
  3. 2024Anderson acceleration for iteratively reweighted ℓ1 algorithmcited by 0
  4. 2024Anderson Acceleration in Nonsmooth Problems: Local Convergence via Active Manifold Identificationcited by 0
  5. 2026HyDRA: Hybrid Denoising Regularization for Measurement-Only DEQ Trainingcited by 0
  6. 2026Gradient Extrapolation-Based Policy Optimizationcited by 0