Forget Less, Generalize More: Unifying Temporal and Structural Adaptation for Dynamic Graphs
Not on the map. Why?
Abstract (arXiv)
Representation learning on dynamic graphs requires capturing complex dependencies that evolve across both time and structure. Existing approaches typically adopt fixed temporal decay schemes or predetermined structural propagation depths, limiting their ability to generalize across graphs with diverse interaction frequencies and topological characteristics. We propose Dual-Scale Retentive Dynamics (DSRD), a unified framework that maintains a retentive representation state encoding both temporal memory and structural context. DSRD introduces two key components: (i) a retentive state with dual-scale adaptation that jointly models temporal dynamics and structural propagation within a single recurrent formulation, and (ii) adaptive decay kernels with learnable time-sensitivity parameters that automatically balance short-term responsiveness and long-term retention based on the underlying interaction patterns. We provide theoretical analysis establishing the equivalence between event-wise parallel aggregation and efficient recurrent state updates, as well as stability and boundedness guarantees for the learned dynamics. Extensive experiments on 14 real-world benchmarks demonstrate that DSRD consistently achieves state-of-the-art performance on both link prediction and node classification tasks, with strong generalization across transductive and inductive settings.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 33 of its 43 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
33 of 43 references.
References · 33
- 2017Attention Is All You Needcited by 60,361
- 2017Graph Attention Networkscited by 8,923
- 2016Layer Normalizationcited by 5,669
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2023RWKV: Reinventing RNNs for the Transformer Eracited by 827
- 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 613
- 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 530
- 2020Inductive Representation Learning on Temporal Graphscited by 462
- 2019Predicting Dynamic Embedding Trajectory in Temporal Interaction Networkscited by 448
- 2015Bilinear CNNs for Fine-grained Visual Recognitioncited by 228
- 2021Inductive Representation Learning in Temporal Networks via Causal Anonymous Walkscited by 193
21 more
- 2023Towards Better Dynamic Graph Learning: New Architecture and Unified Librarycited by 157
- 2023Do We Really Need Complicated Model Architectures For Temporal Networks?cited by 143
- 2025RWKV-7 "Goose" with Expressive Dynamic State Evolutioncited by 141
- 2022Towards Better Evaluation for Dynamic Link Predictioncited by 122
- 2021An Attention Free Transformercited by 112
- 2015Compact Bilinear Poolingcited by 97
- 2021TCL: Transformer-based Dynamic Graph Modelling via Contrastive Learningcited by 68
- 2022Provably expressive temporal graph networkscited by 56
- 2022Neighborhood-aware Scalable Temporal Network Representation Learningcited by 54
- 2023Causal Discovery from Temporal Data: An Overview and New Perspectivescited by 43
- 2024Large Language Models-guided Dynamic Adaptation for Temporal Knowledge Graph Reasoningcited by 41
- 2024A Comprehensive Survey of Dynamic Graph Neural Networks: Models, Frameworks, Benchmarks, Experiments and Challengescited by 30
- 2023Self-Supervised Temporal Graph learning with Temporal and Structural Intensity Alignmentcited by 25
- 2024Improving Temporal Link Prediction via Temporal Walk Matrix Projectioncited by 21
- 2023Deep learning for dynamic graphs: models and benchmarkscited by 19
- 2017Deep Learning with Dynamic Computation Graphscited by 15
- 2024Expressive Power of Temporal Message Passingcited by 7
- 2024A Primer on Temporal Graph Learningcited by 5
- 2022TPGNN: Learning High-order Information in Dynamic Graphs via Temporal Propagationcited by 2
- 2024Graph Retention Networks for Dynamic Graphscited by 2
- 2025Between Linear and Sinusoidal: Rethinking the Time Encoder in Dynamic Graph Learningcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.