Do Sheaf Neural Networks Use Holonomy? A Measure--Intervene--Control Study
Not on the map. Why?
Abstract (arXiv)
Geometric architectures are often motivated by internal mechanisms, but accuracy alone does not show whether predictions use them. In Sheaf Neural Networks (SNNs), edge transports form a connection whose cycle products define holonomy. We ask whether training changes triangle holonomy, whether predictions rely on the learned connection, and whether holonomy drives triangle counting. We use basis-independent loop readouts with identity interventions and shortcut controls. On high-homophily GraphUniverse graphs, triangle counting increases the mean SO(2) triangle rotation in Neural Sheaf Propagation (NSP) from 0.010 to 0.388 radians, while community detection ends at 0.029 radians. With more data, learned SO(2)--NSP outperforms Identity NSP, and replacing its transports after training increases error further. However, ridge regression is more accurate, diagonal maps improve without continuous rotation, and fixed-degree models develop rotation without improved counting. Thus, NSP can learn and rely on a nontrivial connection, but our experiments do not show that triangle holonomy drives its predictions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 21 references that are in the map. First posted on arXiv 21 Jul 2026.
Builds on
12 of 21 references.
References · 12
- 2020Shortcut Learning in Deep Neural Networkscited by 1,969
- 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 881
- 2020Can Graph Neural Networks Count Substructures?cited by 236
- 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 214
- 2020The Surprising Power of Graph Neural Networks with Random Node Initializationcited by 198
- 2020Sheaf Neural Networkscited by 84
- 2022Sheaf Neural Networks with Connection Laplacianscited by 65
- 2024TopoBench: A Framework for Benchmarking Topological Deep Learningcited by 24
- 2025Copresheaf Topological Neural Networks: A Generalized Deep Learning Frameworkcited by 12
- 2026Gauge-invariant representation holonomycited by 7
- 2026On the Necessity of Learnable Sheaf Laplacianscited by 5
- 2025GraphUniverse: Synthetic Graph Generation for Evaluating Inductive Generalizationcited by 2
Built on by
Not cited yet.