mlsanityData to 7 Oct 2026

Dynamic Graph Transformer with Correlated Spatial-Temporal Positional Encoding

arXiv 2407.16959 ↗First posted 24 Jul 2024cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

Learning effective representations for Continuous-Time Dynamic Graphs (CTDGs) has garnered significant research interest, largely due to its powerful capabilities in modeling complex interactions between nodes. A fundamental and crucial requirement for representation learning in CTDGs is the appropriate estimation and preservation of proximity. However, due to the sparse and evolving characteristics of CTDGs, the spatial-temporal properties inherent in high-order proximity remain largely unexplored. Despite its importance, this property presents significant challenges due to the computationally intensive nature of personalized interaction intensity estimation and the dynamic attributes of CTDGs. To this end, we propose a novel Correlated Spatial-Temporal Positional encoding that incorporates a parameter-free personalized interaction intensity estimation under the weak assumption of the Poisson Point Process. Building on this, we introduce the Dynamic Graph Transformer with Correlated Spatial-Temporal Positional Encoding (CorDGT), which efficiently retains the evolving spatial-temporal high-order proximity for effective node representation learning in CTDGs. Extensive experiments on seven small and two large-scale datasets demonstrate the superior performance and scalability of the proposed CorDGT. The code is available at: https://github.com/wangz3066/CorDGT.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 29 of its 54 references that are in the map. First posted on arXiv 24 Jul 2024.

Builds on

29 of 54 references.

References · 29

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2017Graph Attention Networkscited by 8,854
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2016Layer Normalizationcited by 5,579
  6. 2018How Powerful are Graph Neural Networks?cited by 4,355
  7. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  8. 2020On Layer Normalization in the Transformer Architecturecited by 906
  9. 2015LINE: Large-scale Information Network Embeddingcited by 582
  10. 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 521
  11. 2021Rethinking Graph Transformers with Spectral Attentioncited by 468
  12. 2020Inductive Representation Learning on Temporal Graphscited by 454
17 more
  1. 2019EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphscited by 443
  2. 2019Predicting Dynamic Embedding Trajectory in Temporal Interaction Networkscited by 443
  3. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
  4. 2021Graph Neural Networks with Learnable Structural and Positional Representationscited by 326
  5. 2020Bias and Debias in Recommender System: A Survey and Future Directionscited by 239
  6. 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
  7. 2020Spatial-Temporal Transformer Networks for Traffic Flow Forecastingcited by 179
  8. 2023Towards Better Dynamic Graph Learning: New Architecture and Unified Librarycited by 154
  9. 2023Do We Really Need Complicated Model Architectures For Temporal Networks?cited by 141
  10. 2022ROLAND: Graph Learning Framework for Dynamic Graphscited by 131
  11. 2020APAN: Asynchronous Propagation Attention Network for Real-time Temporal Graph Embeddingcited by 78
  12. 2021Continuous-Time Sequential Recommendation with Temporal Graph Collaborative Transformercited by 69
  13. 2022TREND: TempoRal Event and Node Dynamics for Graph Representation Learningcited by 50
  14. 2020On the Equivalence of Decoupled Graph Convolution Network and Label Propagationcited by 49
  15. 2022DyTed: Disentangled Representation Learning for Discrete-time Dynamic Graphcited by 21
  16. 2024Distributionally Robust Graph-based Recommendation Systemcited by 17
  17. 2020Graph Convolution Machine for Context-aware Recommender Systemcited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 2.

6 papers.