mlsanityData to 14 Oct 2026

Newton-CG methods for nonconvex unconstrained optimization with H"older continuous Hessian

arXiv 2311.13094 ↗First posted 22 Nov 2023math.OC cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper we consider a nonconvex unconstrained optimization problem minimizing a twice differentiable objective function with H"older continuous Hessian. Specifically, we first propose a Newton-conjugate gradient (Newton-CG) method for finding an approximate first- and second-order stationary point of this problem, assuming the associated the H"older parameters are explicitly known. Then we develop a parameter-free Newton-CG method without requiring any prior knowledge of these parameters. To the best of our knowledge, this method is the first parameter-free second-order method achieving the best-known iteration and operation complexity for finding an approximate first- and second-order stationary point of this problem. Finally, we present preliminary numerical results to demonstrate the superior practical performance of our parameter-free Newton-CG method over a well-known regularized Newton method.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 32 references that are in the map. First posted on arXiv 22 Nov 2023.

Builds on

17 of 32 references.

References · 17

  1. 2017Accelerated Gradient Descent Escapes Saddle Points Faster than Gradient Descentcited by 66
  2. 2017"Convex Until Proven Guilty": Dimension-Free Acceleration of Gradient Descent on Non-Convex Functionscited by 46
  3. 2017Neon2: Finding Local Minima via First-Order Oraclescited by 36
  4. 2018A Newton-CG Algorithm with Complexity Guarantees for Smooth Unconstrained Optimizationcited by 23
  5. 2016Gradient Descent Finds the Cubic-Regularized Non-Convex Newton Stepcited by 18
  6. 2022Restarted Nonconvex Accelerated Gradient Descent: No More Polylogarithmic Factor in the O(ε-7/4) Complexitycited by 17
  7. 2017Complexity analysis of second-order line-search algorithms for smooth nonconvex optimizationcited by 16
  8. 2019Trust-Region Newton-CG with Strong Second-Order Complexity Guarantees for Nonconvex Optimizationcited by 10
  9. 2017NEON+: Accelerated Gradient Methods for Extracting Negative Curvature for Non-Convex Optimizationcited by 9
  10. 2022Parameter-free accelerated gradient descent for nonconvex minimizationcited by 7
  11. 2017Worst-case evaluation complexity and optimality of second-order methods for nonconvex smooth optimizationcited by 6
  12. 2023A Newton-CG based augmented Lagrangian method for finding a second-order stationary point of nonconvex equality constrained optimization with complexity guaranteescited by 6
5 more
  1. 2023A Parameter-Free Conditional Gradient Method for Composite Minimization under H"older Conditioncited by 5
  2. 2017Gradient Method With Inexact Oracle for Composite Non-Convex Optimizationcited by 4
  3. 2018Sharp worst-case evaluation complexity bounds for arbitrary-order nonconvex optimization with inexpensive constraintscited by 4
  4. 2018Universal regularization methods - varying the power, the smoothness and the accuracycited by 4
  5. 2023Riemannian Adaptive Regularized Newton Methods with H"older Continuous Hessianscited by 2

Built on by

Not cited yet.