A Unified Matrix-Spectral Framework for Stability and Interpretability in Deep Learning
Not on the map. Why?
Abstract (arXiv)
We develop a unified matrix-spectral framework for analyzing stability and interpretability in deep neural networks. Representing networks as data-dependent products of linear operators reveals spectral quantities governing sensitivity to input perturbations, label noise, and training dynamics. We introduce a Global Matrix Stability Index that aggregates spectral information from Jacobians, parameter gradients, Neural Tangent Kernel operators, and loss Hessians into a single stability scale controlling forward sensitivity, attribution robustness, and optimization conditioning. We further show that spectral entropy refines classical operator-norm bounds by capturing typical, rather than purely worst-case, sensitivity. These quantities yield computable diagnostics and stability-oriented regularization principles. Synthetic experiments and controlled studies on MNIST, CIFAR-10, and CIFAR-100 confirm that modest spectral regularization substantially improves attribution stability even when global spectral summaries change little. The results establish a precise connection between spectral concentration and analytic stability, providing practical guidance for robustness-aware model design and training.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 21 references that are in the map. First posted on arXiv 1 Feb 2026.
Builds on
14 of 21 references.
References · 14
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
- 2016Pruning Filters for Efficient ConvNetscited by 1,129
- 2017SmoothGrad: removing noise by adding noisecited by 1,097
- 2019Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descentcited by 732
- 2015Train faster, generalize better: Stability of stochastic gradient descentcited by 547
- 2018On the Robustness of Interpretability Methodscited by 310
- 2017Empirical Analysis of the Hessian of Over-Parametrized Neural Networkscited by 283
- 2018Implicit Self-Regularization in Deep Neural Networks: Evidence from Random Matrix Theory and Implications for Learningcited by 211
- 2016Deep Information Propagationcited by 194
- 2017Bounding and Counting Linear Regions of Deep Neural Networkscited by 161
- 2017Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practicecited by 132
Built on by
Not cited yet.