mlsanityData to 7 Oct 2026

Kohn-Sham Spectral Embedding on Sparse Graphs at the Nishimori Temperature for Image Classification

arXiv 2607.28428 ↗First posted 30 Jul 2026cs.LG cs.CV cs.ITcited by 0

Not on the map. Why?

Abstract (arXiv)

We propose Kohn-Sham Spectral Embedding (KSSE), an energy-based model replacing the top-layer classifier of convolutional networks with a sparse-graph spectral embedding at the Nishimori temperature of an associated Random-Bond Ising Model the spectral detectability threshold where class structure becomes marginally distinguishable from disorder. Mapping pre-trained features onto quasi-cyclic low-density parity-check graphs, we construct a regularized Laplacian (Bethe-Hessian) as an effective Kohn-Sham Hamiltonian, yielding D independent spectral problems-one per feature channel-solvable in O(N log N + kmode2 N) time by FFT on circulant blocks (Pontryagin self-duality), with low-mode Rayleigh-Ritz refinement (kmode=5). Physically, this is a k.p effective-mass reduction on a one-dimensional ring crystal: the circulant support is the perfect crystal, the data weights a slowly varying impurity potential, and the Nishimori crossing a Fermi level at the band edge. Star-domain surgery optimizes the graph: instead of eliminating all frustrated cycles impossible without destroying the codewords-edge shifts create certified convexity around codewords with bounded residual frustration, with multi-scale fractal certification (basins D2<1 vs rough landscapes D2>3). The theory includes a generalized Ihara-Bass identity with a sharp spectral threshold, a non-backtracking growth trichotomy with frustration as a gauge-invariant Z2 flux, a trapping-set spectral test, exact channel separability with a cup-product obstruction, plus loop-series, convexity, surgery, and quasi-stationarity bounds. On ImageNet-1000 with frozen EfficientNet-B4 features (D=1792) under a transductive protocol, KSSE achieves 88.93% Top-1 accuracy with ~21.24M parameters-beating Swin-L (197M, 86.4-87.3%) and matching the lower end of ViT-H/14 (632M, 88.0-89.5%) with 10x and 30x fewer parameters.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 32 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

9 of 32 references.

References · 9

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  4. 2016Unreasonable Effectiveness of Learning Neural Networks: From Accessible States and Robust Ensembles to Basic Algorithmic Schemescited by 40
  5. 2014Spectral Clustering of Graphs with the Bethe Hessiancited by 22
  6. 2024The boundary of neural network trainability is fractalcited by 12
  7. 2021Nishimori meets Bethe: a spectral method for node classification in sparse weighted graphscited by 6
  8. 2025Natural Image Classification via Quasi-Cyclic Graph Ensembles and Random-Bond Ising Models at the Nishimori Temperaturecited by 2
  9. 2024Cyclic Group Projection for Enumerating Quasi-Cyclic Codes Trapping Setscited by 1

Built on by

Not cited yet.