mlsanityData to 14 Oct 2026

Estimating Population-Risk Curves Along Nonconvex Gradient Flows from the Training Sample

arXiv 2608.30261 ↗First posted 31 Aug 2026stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We estimate the conditional population-risk curve of a realized smooth nonconvex gradient flow from the training sample. Flow approximate leave-one-out (Flow-ALO) propagates a deletion response and evaluates omitted observations at approximate deleted paths. The risk-curve error decomposes into response approximation, exact-LOO fluctuation, and deletion-to-full risk transfer. On each fixed finite horizon, bounded centered training-loss gradients, a one-sided Hessian lower bound, locally Lipschitz Hessians, and a strict tube-closure condition yield an explicit (n-1)-2 bound for the deletion-response error. Bounded evaluation-loss gradients transfer the deletion-response bound to the score without requiring the Hessian to be invertible. Direct first-order jackknife cancellation and exact-LOO concentration control deletion-to-full risk transfer and fluctuation, respectively, completing recovery of the conditional population-risk curve. For bounded smooth two-layer mean-field networks training both layers, the score-error bound is uniform in width.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 41 references that are in the map. First posted on arXiv 31 Aug 2026.

Builds on

9 of 41 references.

References · 9

  1. 2019A Higher-Order Swiss Army Infinitesimal Jackknifecited by 14
  2. 2025Precise gradient descent training dynamics for finite-width multi-layer neural networkscited by 5
  3. 2022Concentration inequalities for leave-one-out cross validationcited by 3
  4. 2026A Theory of Generalization in Deep Learningcited by 2
  5. 2026From Cross-Validation to SURE: Asymptotic Risk of Tuned Regularized Estimatorscited by 1
  6. 2026Optimal Confidence Band for Kernel Gradient Flow Estimatorcited by 1
  7. 2026A Dual Representation of Influence Functions for Linearizable Modelscited by 1
  8. 2026Gradient-Flow Optimization as Dynamic Random-Effects Inference: Testing and Early Stopping with Applications to Deep Learningcited by 1
  9. 2026Statistical Inference on Gradient Flowscited by 1

Built on by

Not cited yet.