Temporal Graph Pattern Machine
Not on the map. Why?
Abstract (arXiv)
Temporal graph learning is pivotal for deciphering dynamic systems, where the core challenge lies in explicitly modeling the underlying evolving patterns that govern network transformation. However, prevailing methods are predominantly task-centric and rely on restrictive assumptions -- such as short-term dependency modeling, static neighborhood semantics, and retrospective time usage. These constraints hinder the discovery of transferable temporal evolution mechanisms. To address this, we propose the Temporal Graph Pattern Machine (TGPM), a foundation framework that shifts the focus toward directly learning generalized evolving patterns. TGPM conceptualizes each interaction as an interaction patch synthesized via temporally-biased random walks, thereby capturing multi-scale structural semantics and long-range dependencies that extend beyond immediate neighborhoods. These patches are processed by a Transformer-based backbone designed to capture global temporal regularities while adapting to context-specific interaction dynamics. To further empower the model, we introduce a suite of self-supervised pre-training tasks -- specifically masked token modeling and next-time prediction -- to explicitly encode the fundamental laws of network evolution. Extensive experiments on temporal link prediction and temporal node classification show that TGPM consistently ranks among the top-performing methods, demonstrating exceptional cross-domain transferability. Our code has been released in https://github.com/antman9914/TGPM.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 49 of its 70 references that are in the map. First posted on arXiv 30 Jan 2026.
Builds on
49 of 70 references.
References · 49
- 2017Attention Is All You Needcited by 60,361
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
- 2019Strategies for Pre-training Graph Neural Networkscited by 971
- 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 530
- 2020Inductive Representation Learning on Temporal Graphscited by 462
- 2019Predicting Dynamic Embedding Trajectory in Temporal Interaction Networkscited by 448
- 2021Graph Self-Supervised Learning: A Surveycited by 289
- 2019Representation Learning for Dynamic Graphs: A Surveycited by 265
- 2022Structure-Aware Transformer for Graph Representation Learningcited by 194
- 2021Inductive Representation Learning in Temporal Networks via Causal Anonymous Walkscited by 193
- 2023Towards Better Dynamic Graph Learning: New Architecture and Unified Librarycited by 157
- 2021From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awarenesscited by 155
37 more
- 2023Do We Really Need Complicated Model Architectures For Temporal Networks?cited by 143
- 2022NAGphormer: A Tokenized Graph Transformer for Node Classification in Large Graphscited by 137
- 2024Graph-Mamba: Towards Long-Range Graph Sequence Modeling with Selective State Spacescited by 134
- 2021Accurate Learning of Graph Representations with Graph Multiset Poolingcited by 120
- 2022A Generalization of ViT/MLP-Mixer to Graphscited by 93
- 2018Streaming Graph Neural Networkscited by 91
- 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 85
- 2020APAN: Asynchronous Propagation Attention Network for Real-time Temporal Graph Embeddingcited by 78
- 2021TCL: Transformer-based Dynamic Graph Modelling via Contrastive Learningcited by 68
- 2023Graph Neural Networks for temporal graphs: State of the art, open challenges, and opportunitiescited by 61
- 2022Neighborhood-aware Scalable Temporal Network Representation Learningcited by 54
- 2022TREND: TempoRal Event and Node Dynamics for Graph Representation Learningcited by 50
- 2024Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Treescited by 32
- 2024A Survey on Temporal Knowledge Graph: Representation Learning and Applicationscited by 30
- 2024A Comprehensive Survey of Dynamic Graph Neural Networks: Models, Frameworks, Benchmarks, Experiments and Challengescited by 30
- 2024DTGB: A Comprehensive Benchmark for Dynamic Text-Attributed Graphscited by 27
- 2022A Self-supervised Riemannian GNN with Time Varying Curvature for Temporal Graph Learningcited by 24
- 2024A survey of dynamic graph neural networkscited by 24
- 2024On the Feasibility of Simple Transformer for Dynamic Graph Modelingcited by 22
- 2022Self-Supervised Graph Structure Refinement for Graph Neural Networkscited by 20
- 2024Can LLMs Convert Graphs to Text-Attributed Graphs?cited by 19
- 2025Beyond Message Passing: Neural Graph Pattern Machinecited by 17
- 2021Adaptive Kernel Graph Neural Networkcited by 15
- 2022Heterogeneous Graph Contrastive Multi-view Learningcited by 14
- 2021Pre-Training on Dynamic Graph Neural Networkscited by 11
- 2024Node-Time Conditional Prompt Learning In Dynamic Graphscited by 11
- 2025Generative Graph Pattern Machinecited by 11
- 2015An Introduction to Temporal Graphs: An Algorithmic Perspectivecited by 10
- 2021Time-Aware Neighbor Sampling for Temporal Graph Networkscited by 9
- 2024Leveraging Contrastive Learning for Enhanced Node Representations in Tokenized Graph Transformerscited by 9
- 2024Training MLPs on Graphs without Supervisioncited by 8
- 2024Enhancing Cross-domain Link Prediction via Evolution Process Modelingcited by 7
- 2025Controllable Graph Generation with Diffusion Models via Inference-Time Tree Search Guidancecited by 7
- 2023Modeling Events and Interactions through Temporal Processes -- A Surveycited by 6
- 2024Retrieval Augmented Generation for Dynamic Graph Modelingcited by 6
- 2025Semantic Refinement with LLMs for Graph Representationscited by 6
- 2025TIDFormer: Exploiting Temporal and Interactive Dynamics Makes A Great Dynamic Graph Transformercited by 5
Built on by
Citing papers per year: 2026: 3.
3 papers.