Understanding and Improving Laplacian Positional Encodings For Temporal GNNs
Not on the map. Why?
Abstract (arXiv)
Temporal graph learning has applications in recommendation systems, traffic forecasting, and social network analysis. Although multiple architectures have been introduced, progress in positional encoding for temporal graphs remains limited. Extending static Laplacian eigenvector approaches to temporal graphs through the supra-Laplacian has shown promise, but also poses key challenges: high eigendecomposition costs, limited theoretical understanding, and ambiguity about when and how to apply these encodings. In this paper, we address these issues by (1) offering a theoretical framework that connects supra-Laplacian encodings to per-time-slice encodings, highlighting the benefits of leveraging additional temporal connectivity, (2) introducing novel methods to reduce the computational overhead, achieving up to 56x faster runtimes while scaling to graphs with 50,000 active nodes, and (3) conducting an extensive experimental study to identify which models, tasks, and datasets benefit most from these encodings. Our findings reveal that while positional encodings can significantly boost performance in certain scenarios, their effectiveness varies across different models.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 33 of its 45 references that are in the map. First posted on arXiv 2 Jun 2025.
Builds on
33 of 45 references.
References · 33
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
- 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 521
- 2020Inductive Representation Learning on Temporal Graphscited by 454
- 2019EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphscited by 443
- 2019Predicting Dynamic Embedding Trajectory in Temporal Interaction Networkscited by 443
- 2016Structured Sequence Modeling with Graph Convolutional Recurrent Networkscited by 273
- 2019Representation Learning for Dynamic Graphs: A Surveycited by 260
- 2024Rotary Position Embedding for Vision Transformercited by 226
- 2020The Surprising Power of Graph Neural Networks with Random Node Initializationcited by 190
21 more
- 2021Inductive Representation Learning in Temporal Networks via Causal Anonymous Walkscited by 188
- 2022Sign and Basis Invariant Networks for Spectral Graph Representation Learningcited by 176
- 2023Towards Better Dynamic Graph Learning: New Architecture and Unified Librarycited by 154
- 2023Do We Really Need Complicated Model Architectures For Temporal Networks?cited by 141
- 2023Temporal Graph Benchmark for Machine Learning on Temporal Graphscited by 137
- 2020Foundations and modelling of dynamic networks using Dynamic Graph Neural Networks: A surveycited by 123
- 2021Discrete-time Temporal Network Embedding via Implicit Hierarchical Learning in Hyperbolic Spacecited by 67
- 2022Provably expressive temporal graph networkscited by 56
- 2023On the Stability of Expressive Positional Encodings for Graphscited by 31
- 2023Graph Positional Encoding via Random Feature Propagationcited by 30
- 2022Generalized Laplacian Positional Encoding for Graph Representation Learningcited by 21
- 2022Temporal Link Prediction: A Unified Framework, Taxonomy, and Reviewcited by 20
- 2024Efficient Neural Common Neighbor for Temporal Graph Link Predictioncited by 18
- 2023Dynamic Graph Representation Learning with Neural Networks: A Surveycited by 15
- 2024UTG: Towards a Unified View of Snapshot and Event Based Models for Temporal Graphscited by 9
- 2013Spectral properties of the Laplacian of multiplex networkscited by 7
- 2019DyANE: Dynamics-aware node embedding for temporal networkscited by 7
- 2024Dynamic Graph Transformer with Correlated Spatial-Temporal Positional Encodingcited by 6
- 2024Supra-Laplacian Encoding for Transformer on Dynamic Graphscited by 6
- 2024Temporal Link Prediction Using Graph Embedding Dynamicscited by 4
- 2022Dynamic Graph Node Classification via Time Augmentationcited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.