Geometric and Spectral Alignment for Deep Neural Network I
Not on the map. Why?
Abstract (arXiv)
Deep residual architectures are modeled as products of near-identity Jacobians. This paper proves deterministic quotient-geometric estimates for singular spectra of Frobenius-normalized layer factors, emphasizing a normalized top-radial Cartan coordinate and fitted power-law chart. Full-rank factors are mapped from GL(d) to the positive cone by Amapsto A^top A, then to ordered eigenvalue data. Under Frobenius normalization, exact power-law spectra form a trace-normalized Cartan orbit. This orbit is a Gibbs family on ranks, a Fisher information line, and a Bures--Wasserstein curve with line element d/4 times Fisher information. The main rigidity theorem is a slack-aware margin inequality: interface radial amplitude, non-backtracking slack, and signed residual variation control displacement of the fitted Cartan coordinate. In the exact-chart zero-slack case, a depth-L budget gives exponent drift of order (log M)/L; generally, slack and residual increments augment the bound. We separate scalar top-radial from full-Cartan spectral control, which also needs Bures/Hellinger residual variation. We prove approximate-power-law and metric-chart versions, converse lower bounds, Fisher--KL/Bures action estimates, and near-identity expansions for normalized residual chains. Near-identity results verify transport budgets; chart quality remains measurable. Effective rank is a spectral-energy quantile, giving finite-width power-law tail bounds and robust rank-window transition estimates. Empirical static-weight exponent profiles serve as diagnostics; full verification also requires interface budgets, slacks, and residuals for the same operator chain.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 8 of its 15 references that are in the map. First posted on arXiv 4 May 2026.
Builds on
8 of 15 references.
References · 8
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019Implicit Regularization in Deep Matrix Factorizationcited by 402
- 2018On the Optimization of Deep Networks: Implicit Acceleration by Overparameterizationcited by 280
- 2019Fixup Initialization: Residual Learning Without Normalizationcited by 194
- 2020Predicting trends in the quality of state-of-the-art neural networks without access to training or testing datacited by 113
- 2022Scaling ResNets in the Large-depth Regimecited by 18
- 2025An entropy formula for the Deep Linear Networkcited by 8
Built on by
Citing papers per year: 2026: 1.
1 paper.