mlsanityData to 7 Oct 2026

Geometric and Spectral Alignment for Deep Neural Network II

arXiv 2605.02111 ↗First posted 4 May 2026cs.LG math.DGcited by 2

Not on the map. Why?

Abstract (arXiv)

This paper develops the angular and static-channel component of Geometric and Spectral Alignment for residual Jacobian chains. Starting from Cartan-coordinate rigidity and fitted effective-rank windows, we study how dominant singular subspaces are transported across adjacent layers and how the resulting finite matrices can be displayed in physical channel coordinates. The main results are deterministic, margin-verified results. We bound the error between full interface transport and its dominant-window truncation, add fitted-tail errors so that empirical spectra can be certified against the Gibbs--Cartan tail model, and distinguish source-mode incidence from fully physical input-output channel incidence. Given row groups and active supports, the Physical Alignment Matrix decomposes orthogonally as core plus overlap plus noise. Active-column gaps, pairwise overlap margins, and noise bounds combine into a static certificate radius under which the full transport and the truncated transport induce the same active supports, pairwise incidence graph, SRS sets, hub columns, and core/overlap/noise masks. The finer SC/SA/ST labels of the Invariant Channel Mapping require additional row-energy and profile-correlation margins, stated as explicit perturbation tests. The empirical section reports the matrices and block-energy heatmaps that measure these certificate quantities across CNNs, language models, and vision/diffusion backbones. The figures are interpreted as finite-dimensional measurements; complete membership in the Physical GSA certificate domain requires checking the numerical margin protocol stated in Section 10.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 May 2026.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Flag Varieties: A Geometric Framework for Deep Network Alignment
  2. 2025Spectral Alignment as Predictor of Loss Explosion in Neural Network Training
  3. 2026The Geometric Alignment Tax: Tokenization vs. Continuous Geometry in Scientific Foundation Models
  4. 2026Preserving Continuous Symmetry in Discrete Spaces: Geometric-Aware Quantization for SO(3)-Equivariant GNNs
  5. 2025U-REPA: Aligning Diffusion U-Nets to ViTs
  6. 2025Representational Alignment Across Model Layers and Brain Regions with Multi-Level Optimal Transport
  7. 2023Random Feedback Alignment Algorithms to train Neural Networks: Why do they Align?
  8. 2026Symmetry-Compatible Principle for Optimizer Design: Embeddings, LM Heads, SwiGLU MLPs, and MoE Routers