Kohn-Sham Spectral Embedding on Sparse Graphs at the Nishimori Temperature for Image Classification
Not on the map. Why?
Abstract (arXiv)
We propose Kohn-Sham Spectral Embedding (KSSE), an energy-based model replacing the top-layer classifier of convolutional networks with a sparse-graph spectral embedding at the Nishimori temperature of an associated Random-Bond Ising Model the spectral detectability threshold where class structure becomes marginally distinguishable from disorder. Mapping pre-trained features onto quasi-cyclic low-density parity-check graphs, we construct a regularized Laplacian (Bethe-Hessian) as an effective Kohn-Sham Hamiltonian, yielding D independent spectral problems-one per feature channel-solvable in O(N log N + kmode2 N) time by FFT on circulant blocks (Pontryagin self-duality), with low-mode Rayleigh-Ritz refinement (kmode=5). Physically, this is a k.p effective-mass reduction on a one-dimensional ring crystal: the circulant support is the perfect crystal, the data weights a slowly varying impurity potential, and the Nishimori crossing a Fermi level at the band edge. Star-domain surgery optimizes the graph: instead of eliminating all frustrated cycles impossible without destroying the codewords-edge shifts create certified convexity around codewords with bounded residual frustration, with multi-scale fractal certification (basins D2<1 vs rough landscapes D2>3). The theory includes a generalized Ihara-Bass identity with a sharp spectral threshold, a non-backtracking growth trichotomy with frustration as a gauge-invariant Z2 flux, a trapping-set spectral test, exact channel separability with a cup-product obstruction, plus loop-series, convexity, surgery, and quasi-stationarity bounds. On ImageNet-1000 with frozen EfficientNet-B4 features (D=1792) under a transductive protocol, KSSE achieves 88.93% Top-1 accuracy with ~21.24M parameters-beating Swin-L (197M, 86.4-87.3%) and matching the lower end of ViT-H/14 (632M, 88.0-89.5%) with 10x and 30x fewer parameters.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 32 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
9 of 32 references.
References · 9
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2016Unreasonable Effectiveness of Learning Neural Networks: From Accessible States and Robust Ensembles to Basic Algorithmic Schemescited by 40
- 2014Spectral Clustering of Graphs with the Bethe Hessiancited by 22
- 2024The boundary of neural network trainability is fractalcited by 12
- 2021Nishimori meets Bethe: a spectral method for node classification in sparse weighted graphscited by 6
- 2025Natural Image Classification via Quasi-Cyclic Graph Ensembles and Random-Bond Ising Models at the Nishimori Temperaturecited by 2
- 2024Cyclic Group Projection for Enumerating Quasi-Cyclic Codes Trapping Setscited by 1
Built on by
Not cited yet.