A Learning Stability Profile for Finite-Dimensional Learning Dynamics
Not on the map. Why?
Abstract (arXiv)
We develop a finite-dimensional sensitivity framework for studying stability in learning systems whose states include representations, parameters, and update variables. The central object is the Learning Stability Profile, a collection of directional sensitivity operators that records how perturbations in inputs, parameter initialization, and update mechanisms propagate along a specified learning trajectory. The main result is a Lyapunov criterion for controlling this profile. Under explicit regularity, coercivity, and dissipation assumptions, an incremental Lyapunov energy yields uniform or exponentially decaying bounds on the associated linearized transition operators. The result is stated as a sufficient stability criterion, not as an unconditional converse theorem. The framework also distinguishes terminal decay, profile-wise boundedness, and subexponential growth, avoiding the identification of nonpositive growth exponents with uniform boundedness. The profile is then specialized to several standard learning mechanisms. Spectral bounds give forward sensitivity estimates for feedforward networks. Dissipativity and step-size restrictions give stability bounds for residual architectures. Mean-square contraction assumptions yield parameter and update sensitivity bounds for stochastic gradient methods. Locally Lipschitz systems, including piecewise-linear networks, proximal maps, projected updates, and recurrent or state-space recursions, are handled through Clarke generalized Jacobians and variational Lyapunov inequalities. The resulting framework provides a common stability language for architecture, optimization, stochasticity, and nonsmoothness. Its role is structural: it organizes known stability mechanisms within one perturbation calculus while keeping the hypotheses needed for each guarantee explicit.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 21 references that are in the map. First posted on arXiv 24 Dec 2025.
Builds on
6 of 21 references.
References · 6
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016Optimization Methods for Large-Scale Machine Learningcited by 1,140
- 2015Train faster, generalize better: Stability of stochastic gradient descentcited by 547
- 2017Stable Architectures for Deep Neural Networkscited by 340
- 2018Deep Neural Networks Motivated by Partial Differential Equationscited by 187
- 2020How Good is your Explanation? Algorithmic Stability Measures to Assess the Quality of Explanations for Deep Neural Networkscited by 27
Built on by
Not cited yet.