Sheaf Graph Neural Networks via PAC-Bayes Spectral Optimization
Not on the map. Why?
Abstract (arXiv)
Over-smoothing in Graph Neural Networks (GNNs) causes collapse in distinct node features, particularly on heterophilic graphs where adjacent nodes often have dissimilar labels. Although sheaf neural networks partially mitigate this problem, they typically rely on static or heavily parameterized sheaf structures that hinder generalization and scalability. Existing sheaf-based models either predefine restriction maps or introduce excessive complexity, yet fail to provide rigorous stability guarantees. In this paper, we introduce a novel scheme called SGPC (Sheaf GNNs with PAC-Bayes Calibration), a unified architecture that combines cellular-sheaf message passing with several mechanisms, including optimal transport-based lifting, variance-reduced diffusion, and PAC-Bayes spectral regularization for robust semi-supervised node classification. We establish performance bounds theoretically and demonstrate that end-to-end training in linear computational complexity can achieve the resulting bound-aware objective. Experiments on nine homophilic and heterophilic benchmarks show that SGPC outperforms state-of-the-art spectral and sheaf-based GNNs while providing certified confidence intervals on unseen nodes. The code and proofs are in https://github.com/ChoiYoonHyuk/SGPC.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 21 of its 32 references that are in the map. First posted on arXiv 1 Aug 2025.
Builds on
21 of 32 references.
References · 21
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
- 2020Simple and Deep Graph Convolutional Networkscited by 860
- 2021How Attentive are Graph Attention Networks?cited by 835
- 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
- 2019Graph Neural Networks for Social Recommendationcited by 714
- 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
- 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 362
- 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 214
- 2022Finding Global Homophily in Graph Neural Networks When Meeting Heterophilycited by 179
9 more
- 2018Non-Vacuous Generalization Bounds at the ImageNet Scale: A PAC-Bayesian Compression Approachcited by 126
- 2020Sheaf Neural Networkscited by 84
- 2018GEMSEC: Graph Embedding with Self Clusteringcited by 61
- 2019Dichotomize and Generalize: PAC-Bayesian Binary Activated Deep Neural Networkscited by 38
- 2023Sheaf Hypergraph Networkscited by 34
- 2023Auto-HeG: Automated Graph Neural Network on Heterophilic Graphscited by 23
- 2023SimCalib: Graph Neural Network Calibration based on Similarity between Nodescited by 10
- 2024Joint Diffusion Processes as an Inductive Bias in Sheaf Neural Networkscited by 9
- 2024Heterophilic Graph Neural Networks Optimization with Causal Message-passingcited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.