mlsanityData to 14 Oct 2026

Generalization as a robust performance property of learning-enabled dynamical systems

arXiv 2608.30431 ↗First posted 31 Aug 2026eess.SY cs.LG cs.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

By focusing on algorithmic stability as a means of establishing out-of-sample bounds, we provide a system-theoretic interpretation of generalization in learning-enabled dynamical systems arising in data-driven optimization and feedback control approximation. Given two neighboring datasets, we specifically model sample replacement as an exogenous disturbance acting on a sensitivity system, while the incremental behavior of the data-dependent operator is encoded through an integral quadratic constraint. By relying on dissipativity arguments, we establish a matrix inequality-based certificate and a uniform stability bound that separates the one-sample sensitivity of the learned operator, and an algorithm-dependent dynamical gain. The latter can then be optimized, offering a tractable tool for certifying and comparing generalization capabilities of learning dynamics. We show that our results recover classical ones for gradient descent, apply naturally to momentum-based methods such as heavy-ball and Nesterov acceleration, and extend to data-driven control.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 26 references that are in the map. First posted on arXiv 31 Aug 2026.

Builds on

14 of 26 references.

References · 14

  1. 2015Train faster, generalize better: Stability of stochastic gradient descentcited by 552
  2. 2014Analysis and Design of Optimization Algorithms via Integral Quadratic Constraintscited by 105
  3. 2017Stability and Generalization of Learning Algorithms that Converge to Global Optimacited by 100
  4. 2017Generalization Bounds of SGLD for Non-convex Learning: Two Theoretical Viewpointscited by 82
  5. 2018Stability and Convergence Trade-off of Iterative Optimization Algorithmscited by 53
  6. 2020Train simultaneously, generalize better: Stability of gradient-based minimax learnerscited by 44
  7. 2021Algorithmic Instabilities of Accelerated Gradient Descentcited by 16
  8. 2021Reliably-stabilizing piecewise-affine neural network controllerscited by 13
  9. 2020Instability, Computational Efficiency and Statistical Accuracycited by 12
  10. 2021Dissipativity and Integral Quadratic Constraints, Tailored computational robustness tests for complex interconnectionscited by 5
  11. 2022The Analysis of Optimization Algorithms, A Dissipativity Approachcited by 5
  12. 2025Concentration inequalities for semidefinite least squares based on datacited by 1
2 more
  1. 2025Finite-sample guarantees for data-driven forward-backward operator methodscited by 1
  2. 2026A Unified Lyapunov-IQC Framework for Uniform Stability of Smooth Quadratic First-Order Accelerated Optimizerscited by 1

Built on by

Not cited yet.