Benchmarking Sheaf Neural Networks for Inductive Tasks
Not on the map. Why?
Abstract (arXiv)
Sheaf Neural Networks (SNNs) generalize message passing by replacing scalar edge weights of standard Graph Neural Networks (GNNs) with learnable, edge-dependent restriction maps between node stalks. Despite their strong theoretical foundations and promising transductive results, SNNs have been evaluated almost exclusively on transductive node classification, leaving their behaviour under inductive protocols unknown. We address this gap through the first systematic benchmark of the sheaf design space, evaluating three diffusion mechanisms (neural sheaf diffusion, sheaf attention, and sheaf attention with Graph Attention Network v2), three restriction-map parameterizations, three stalk dimensions, and six modern GNN architectural components, within a message-passing reformulation that never assembles the heavy sheaf Laplacian, making the full design space trainable under cross-graph batching. Across 1,890 controlled experiments on 14 inductive datasets, multiple insights emerge: restriction maps are the dominant design choice and general maps are preferable, larger stalks add capacity but not long-range reach, architectural components explain more performance variation than the entire sheaf-specific design space itself. Under a matched protocol, SNNs transfer to inductive settings but do not reach the strongest baselines, with gaps being dataset-dependent. Practically, a single sheaf configuration can generalize across datasets, so effort is better spent tuning the surrounding architectural recipe than the sheaf operator itself.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 34 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
25 of 34 references.
References · 25
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,102
- 2021How Attentive are Graph Attention Networks?cited by 835
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
- 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 631
- 2019A Fair Comparison of Graph Neural Networks for Graph Classificationcited by 244
- 2021Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networkscited by 221
- 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 214
- 2023Graph Inductive Biases in Transformers without Message Passingcited by 153
- 2024Graph-Mamba: Towards Long-Range Graph Sequence Modeling with Selective State Spacescited by 134
13 more
- 2021Global Self-Attention as a Replacement for Graph Convolutioncited by 114
- 2023Specformer: Spectral Graph Neural Networks Meet Transformerscited by 102
- 2022A Generalization of ViT/MLP-Mixer to Graphscited by 93
- 2023Where Did the Gap Go? Reassessing the Long-Range Graph Benchmarkcited by 85
- 2020Sheaf Neural Networkscited by 84
- 2022Sheaf Neural Networks with Connection Laplacianscited by 65
- 2022Understanding convolution on graphs via energiescited by 59
- 2020A Large-Scale Database for Graph Representation Learningcited by 55
- 2025Can Classic GNNs Be Strong Baselines for Graph-level Tasks? Simple Architectures Meet Excellencecited by 26
- 2024What Can We Learn from State Space Models for Machine Learning on Graphs?cited by 13
- 2024Heterogeneous Sheaf Neural Networkscited by 10
- 2024A Scalable and Effective Alternative to Graph Transformerscited by 4
- 2025Sheaves Reloaded: A Directional Awakeningcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Let the Heads Talk: Beyond Diagonal Graph Attentioncited by 0
- 2026Let the Heads Talk: Beyond Diagonal Graph Attention1 Oct 2026