Dynamic Graph Transformer with Correlated Spatial-Temporal Positional Encoding
Not on the map. Why?
Abstract (arXiv)
Learning effective representations for Continuous-Time Dynamic Graphs (CTDGs) has garnered significant research interest, largely due to its powerful capabilities in modeling complex interactions between nodes. A fundamental and crucial requirement for representation learning in CTDGs is the appropriate estimation and preservation of proximity. However, due to the sparse and evolving characteristics of CTDGs, the spatial-temporal properties inherent in high-order proximity remain largely unexplored. Despite its importance, this property presents significant challenges due to the computationally intensive nature of personalized interaction intensity estimation and the dynamic attributes of CTDGs. To this end, we propose a novel Correlated Spatial-Temporal Positional encoding that incorporates a parameter-free personalized interaction intensity estimation under the weak assumption of the Poisson Point Process. Building on this, we introduce the Dynamic Graph Transformer with Correlated Spatial-Temporal Positional Encoding (CorDGT), which efficiently retains the evolving spatial-temporal high-order proximity for effective node representation learning in CTDGs. Extensive experiments on seven small and two large-scale datasets demonstrate the superior performance and scalability of the proposed CorDGT. The code is available at: https://github.com/wangz3066/CorDGT.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 29 of its 54 references that are in the map. First posted on arXiv 24 Jul 2024.
Builds on
29 of 54 references.
References · 29
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2016Layer Normalizationcited by 5,579
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2020On Layer Normalization in the Transformer Architecturecited by 906
- 2015LINE: Large-scale Information Network Embeddingcited by 582
- 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 521
- 2021Rethinking Graph Transformers with Spectral Attentioncited by 468
- 2020Inductive Representation Learning on Temporal Graphscited by 454
17 more
- 2019EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphscited by 443
- 2019Predicting Dynamic Embedding Trajectory in Temporal Interaction Networkscited by 443
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
- 2021Graph Neural Networks with Learnable Structural and Positional Representationscited by 326
- 2020Bias and Debias in Recommender System: A Survey and Future Directionscited by 239
- 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
- 2020Spatial-Temporal Transformer Networks for Traffic Flow Forecastingcited by 179
- 2023Towards Better Dynamic Graph Learning: New Architecture and Unified Librarycited by 154
- 2023Do We Really Need Complicated Model Architectures For Temporal Networks?cited by 141
- 2022ROLAND: Graph Learning Framework for Dynamic Graphscited by 131
- 2020APAN: Asynchronous Propagation Attention Network for Real-time Temporal Graph Embeddingcited by 78
- 2021Continuous-Time Sequential Recommendation with Temporal Graph Collaborative Transformercited by 69
- 2022TREND: TempoRal Event and Node Dynamics for Graph Representation Learningcited by 50
- 2020On the Equivalence of Decoupled Graph Convolution Network and Label Propagationcited by 49
- 2022DyTed: Disentangled Representation Learning for Discrete-time Dynamic Graphcited by 21
- 2024Distributionally Robust Graph-based Recommendation Systemcited by 17
- 2020Graph Convolution Machine for Context-aware Recommender Systemcited by 13
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 2.
6 papers.
- 2025HOPSE: Scalable Higher-Order Positional and Structural Encoder for Combinatorial Representationscited by 5
- 2025Understanding and Improving Laplacian Positional Encodings For Temporal GNNscited by 3
- 2024Towards Dynamic Graph Neural Networks with Provably High-Order Expressive Powercited by 0
- 2025MP-GFormer: A 3D-Geometry-Aware Dynamic Graph Transformer Approach for Machining Process Planningcited by 0
- 2026CoDCL: Counterfactual-Inspired Augmentation Contrastive Learning for Temporal Link Prediction in Social Networkscited by 0
- 2026TFWaveFormer: Temporal-Frequency Collaborative Multi-level Wavelet Transformer for Dynamic Link Predictioncited by 0
- 2026TFWaveFormer: Temporal-Frequency Collaborative Multi-level Wavelet Transformer for Dynamic Link Prediction4 Mar 2026
- 2026CoDCL: Counterfactual-Inspired Augmentation Contrastive Learning for Temporal Link Prediction in Social Networks30 Jan 2026
- 2025MP-GFormer: A 3D-Geometry-Aware Dynamic Graph Transformer Approach for Machining Process Planning14 Nov 2025
- 2025Understanding and Improving Laplacian Positional Encodings For Temporal GNNs2 Jun 2025
- 2025HOPSE: Scalable Higher-Order Positional and Structural Encoder for Combinatorial Representations21 May 2025
- 2024Towards Dynamic Graph Neural Networks with Provably High-Order Expressive Power2 Oct 2024