mlsanityData to 7 Oct 2026

Geometric and Spectral Alignment for Deep Neural Network I

arXiv 2605.02108 ↗First posted 4 May 2026cs.LG math.DGcited by 1

Not on the map. Why?

Abstract (arXiv)

Deep residual architectures are modeled as products of near-identity Jacobians. This paper proves deterministic quotient-geometric estimates for singular spectra of Frobenius-normalized layer factors, emphasizing a normalized top-radial Cartan coordinate and fitted power-law chart. Full-rank factors are mapped from GL(d) to the positive cone by Amapsto A^top A, then to ordered eigenvalue data. Under Frobenius normalization, exact power-law spectra form a trace-normalized Cartan orbit. This orbit is a Gibbs family on ranks, a Fisher information line, and a Bures--Wasserstein curve with line element d/4 times Fisher information. The main rigidity theorem is a slack-aware margin inequality: interface radial amplitude, non-backtracking slack, and signed residual variation control displacement of the fitted Cartan coordinate. In the exact-chart zero-slack case, a depth-L budget gives exponent drift of order (log M)/L; generally, slack and residual increments augment the bound. We separate scalar top-radial from full-Cartan spectral control, which also needs Bures/Hellinger residual variation. We prove approximate-power-law and metric-chart versions, converse lower bounds, Fisher--KL/Bures action estimates, and near-identity expansions for normalized residual chains. Near-identity results verify transport budgets; chart quality remains measurable. Effective rank is a spectral-energy quantile, giving finite-width power-law tail bounds and robust rank-window transition estimates. Empirical static-weight exponent profiles serve as diagnostics; full verification also requires interface budgets, slacks, and residuals for the same operator chain.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 8 of its 15 references that are in the map. First posted on arXiv 4 May 2026.

Builds on

8 of 15 references.

References · 8

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2019Implicit Regularization in Deep Matrix Factorizationcited by 402
  4. 2018On the Optimization of Deep Networks: Implicit Acceleration by Overparameterizationcited by 280
  5. 2019Fixup Initialization: Residual Learning Without Normalizationcited by 194
  6. 2020Predicting trends in the quality of state-of-the-art neural networks without access to training or testing datacited by 113
  7. 2022Scaling ResNets in the Large-depth Regimecited by 18
  8. 2025An entropy formula for the Deep Linear Networkcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.