Temporal Sheaf Neural Networks with Dynamic Orthogonal Transport
Not on the map. Why?
Abstract (arXiv)
We introduce Temporal Sheaf Neural Networks (TSNN), a temporal link prediction framework that equips each node with a time-varying orthogonal frame and compares node states only after explicit transport between local coordinate systems. In contrast to existing continuous-time graph models that operate in a shared global embedding space, TSNN models node-specific and evolving interaction semantics through dynamic local frames. The model parameterizes per-node frames via efficient low-rank Householder products, preserves stored hidden states exactly under frame updates, and uses a geometric-residual decoder that anchors predictions on transported distances while learning residual corrections. All computations are strictly causal and use only the pre-event history. We show that the symmetric degree-normalized sheaf Laplacian is orthogonally similar to the symmetric normalized graph Laplacian, with the random-walk normalized form similar in the corresponding degree metric; the full-active, feature-scaled diffusion used by TSNN is exactly a metric-gradient step on the combinatorial sheaf Dirichlet energy, with a degree-free monotone-descent and non-expansiveness guarantee. Frame drift perturbs updates only linearly. Across TGB v2 link-prediction and temporal-heterogeneous leaderboards, together with the DGB benchmark suite, TSNN matches or surpasses the strongest prior methods on most benchmarks, with the largest improvements on graphs exhibiting strong node-role heterogeneity. Ablations confirm the distinct benefit of dynamic frames, orthogonal transport, and geometric-residual decoding.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 39 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
27 of 39 references.
References · 27
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 530
- 2020Inductive Representation Learning on Temporal Graphscited by 462
- 2019Predicting Dynamic Embedding Trajectory in Temporal Interaction Networkscited by 448
- 2021Inductive Representation Learning in Temporal Networks via Causal Anonymous Walkscited by 193
- 2023Towards Better Dynamic Graph Learning: New Architecture and Unified Librarycited by 157
- 2023Do We Really Need Complicated Model Architectures For Temporal Networks?cited by 143
- 2023Temporal Graph Benchmark for Machine Learning on Temporal Graphscited by 138
- 2022Towards Better Evaluation for Dynamic Link Predictioncited by 122
- 2020Gauge Equivariant Mesh CNNs: Anisotropic convolutions on geometric graphscited by 92
- 2020Sheaf Neural Networkscited by 84
- 2021SE(3) Equivariant Graph Neural Networks with Complete Local Framescited by 76
15 more
- 2021TCL: Transformer-based Dynamic Graph Modelling via Contrastive Learningcited by 68
- 2022Sheaf Neural Networks with Connection Laplacianscited by 65
- 2022Provably expressive temporal graph networkscited by 56
- 2022Neighborhood-aware Scalable Temporal Network Representation Learningcited by 54
- 2024TGB 2.0: A Benchmark for Learning on Temporal Knowledge Graphs and Heterogeneous Graphscited by 36
- 2024Long Range Propagation on Continuous-Time Dynamic Graphscited by 28
- 2021Roto-translated Local Coordinate Frames For Interacting Dynamical Systemscited by 24
- 2024Improving Temporal Link Prediction via Temporal Walk Matrix Projectioncited by 21
- 2024DyG-Mamba: Continuous State Space Modeling on Dynamic Graphscited by 17
- 2024Bundle Neural Networks for message diffusion on graphscited by 14
- 2025Cooperative Sheaf Neural Networkscited by 12
- 2025Polynomial Neural Sheaf Diffusion: A Spectral Filtering Approach on Cellular Sheavescited by 9
- 2021ConTIG: Continuous Representation Learning on Temporal Interaction Graphscited by 5
- 2023Modeling Dynamics over Meshes with Gauge Equivariant Nonlinear Message Passingcited by 3
- 2025Sheaf Graph Neural Networks via PAC-Bayes Spectral Optimizationcited by 2
Built on by
Not cited yet.