mlsanityData to 7 Oct 2026

HybSpecNet: A Critical Analysis of Architectural Instability in Hybrid-Domain Spectral GNNs

arXiv 2511.16101 ↗First posted 20 Nov 2025cs.LG eess.SPcited by 0

Not on the map. Why?

Abstract (arXiv)

Spectral Graph Neural Networks offer a principled approach to graph filtering but face a fundamental "Stability-vs-Adaptivity" trade-off. This trade-off is dictated by the choice of spectral domain. Filters in the finite [-1, 1] domain (e.g., ChebyNet) are numerically stable at high polynomial degrees (K) but are static and low-pass, causing them to fail on heterophilic graphs. Conversely, filters in the semi-infinite [0, infty) domain (e.g., KrawtchoukNet) are highly adaptive and achieve SOTA results on heterophily by learning non-low-pass responses. However, as we demonstrate, these adaptive filters can also suffer from numerical instability, leading to catastrophic performance collapse at high K. In this paper, we propose to resolve this trade-off by designing a hybrid-domain GNN, HybSpecNet, which combines a stable `ChebyNet` branch with an adaptive `KrawtchoukNet` branch. We first demonstrate that a "naive" hybrid architecture, which fuses the branches via concatenation, successfully unifies performance at low K, achieving strong results on both homophilic and heterophilic benchmarks. However, we then prove that this naive architecture fails the stability test. Our K-ablation experiments show that this architecture catastrophically collapses at K=25, exactly mirroring the collapse of its unstable `KrawtchoukNet` branch. We identify this critical finding as "Instability Poisoning," where `NaN`/`Inf` gradients from the adaptive branch destroy the training of the model. Finally, we propose and validate an advanced architecture that uses "Late Fusion" to completely isolate the gradient pathways. We demonstrate that this successfully solves the instability problem, remaining perfectly stable up to K=30 while retaining its SOTA performance across all graph types. This work identifies a critical architectural pitfall in hybrid GNN design and provides the robust architectural solution.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 20 references that are in the map. First posted on arXiv 20 Nov 2025.

Builds on

12 of 20 references.

References · 12

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  3. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
  4. 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
  5. 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 875
  6. 2020Simple and Deep Graph Convolutional Networkscited by 857
  7. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 821
  8. 2019Multi-scale Attributed Node Embeddingcited by 543
  9. 2022How Powerful are Spectral Graph Neural Networkscited by 169
  10. 2025MeixnerNet: Adaptive and Robust Spectral Graph Neural Networks with Discrete Orthogonal Polynomialscited by 5
  11. 2025KrawtchoukNet: A Unified GNN Solution for Heterophily and Over-smoothing with Adaptive Bounded Polynomialscited by 3
  12. 2025LaguerreNet: Advancing a Unified Solution for Heterophily and Over-smoothing with Adaptive Continuous Polynomialscited by 2

Built on by

Not cited yet.