mlsanityData to 7 Oct 2026

Gauss-Newton Accuracy and Indefinite Hessians: Uniform Coexistence in Low-Cost Sets

arXiv 2610.09675 ↗First posted 7 Oct 2026cs.LG stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

We study the accuracy of Gauss-Newton curvature in ridge-regularized nonlinear least squares. Under local regularity and persistence of level-set curvature magnitude along an exact-fit section, we prove uniform coexistence of two curvature regimes. Global minimizers exist, and every global minimizer has relative Hessian error below (1+√2)/8, while the same low-cost set contains a point with an indefinite Hessian and relative error at least 15/8. One positive ridge cap works for all independent center and label perturbations in fixed neighborhoods and every positive ridge weight up to the cap. These neighborhoods do not shrink as the ridge weight tends to zero. A pointwise certificate based on the current prediction level set controls the normal, mixed, and tangent parts of the Hessian correction. We prove a sharp relative-error bound over the stated pointwise class when the prediction map and ridge vary. Analytic examples describe the roles of output alignment, curvature orientation, and persistence. A separate structural result gives full Jacobian row rank throughout low-cost sets and exact interpolation near a rank-deficient reference.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 2 of its 16 references that are in the map. First posted on arXiv 7 Oct 2026.

Builds on

2 of 16 references.

References · 2

  1. 2026Select-then-differentiate: Solving Bilevel Optimization with Manifold Lower-level Solution Setscited by 2
  2. 2026Generalization in Nonlinear Least Squares via Learned Feature Geometrycited by 1

Built on by

Not cited yet.