mlsanityData to 7 Oct 2026

A Unified Matrix-Spectral Framework for Stability and Interpretability in Deep Learning

arXiv 2602.01136 ↗First posted 1 Feb 2026cs.LG math.DS math.OCcited by 0

Not on the map. Why?

Abstract (arXiv)

We develop a unified matrix-spectral framework for analyzing stability and interpretability in deep neural networks. Representing networks as data-dependent products of linear operators reveals spectral quantities governing sensitivity to input perturbations, label noise, and training dynamics. We introduce a Global Matrix Stability Index that aggregates spectral information from Jacobians, parameter gradients, Neural Tangent Kernel operators, and loss Hessians into a single stability scale controlling forward sensitivity, attribution robustness, and optimization conditioning. We further show that spectral entropy refines classical operator-norm bounds by capturing typical, rather than purely worst-case, sensitivity. These quantities yield computable diagnostics and stability-oriented regularization principles. Synthetic experiments and controlled studies on MNIST, CIFAR-10, and CIFAR-100 confirm that modest spectral regularization substantially improves attribution stability even when global spectral summaries change little. The results establish a precise connection between spectral concentration and analytic stability, providing practical guidance for robustness-aware model design and training.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 21 references that are in the map. First posted on arXiv 1 Feb 2026.

Builds on

14 of 21 references.

References · 14

  1. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  2. 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
  3. 2016Pruning Filters for Efficient ConvNetscited by 1,129
  4. 2017SmoothGrad: removing noise by adding noisecited by 1,097
  5. 2019Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descentcited by 732
  6. 2015Train faster, generalize better: Stability of stochastic gradient descentcited by 547
  7. 2018On the Robustness of Interpretability Methodscited by 310
  8. 2017Empirical Analysis of the Hessian of Over-Parametrized Neural Networkscited by 283
  9. 2018Implicit Self-Regularization in Deep Neural Networks: Evidence from Random Matrix Theory and Implications for Learningcited by 211
  10. 2016Deep Information Propagationcited by 194
  11. 2017Bounding and Counting Linear Regions of Deep Neural Networkscited by 161
  12. 2017Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practicecited by 132
2 more
  1. 2018Rethinking the Smaller-Norm-Less-Informative Assumption in Channel Pruning of Convolution Layerscited by 112
  2. 2020Traces of Class/Cross-Class Structure Pervade Deep Learning Spectracited by 94

Built on by

Not cited yet.