mlsanityData to 14 Oct 2026

Future Link Prediction Without Memory or Aggregation

arXiv 2505.19408 ↗First posted 26 May 2025cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

Future link prediction on temporal graphs is a fundamental task with wide applicability in real-world dynamic systems. These scenarios often involve both recurring (seen) and novel (unseen) interactions, requiring models to generalize effectively across both types of edges. However, existing methods typically rely on complex memory and aggregation modules, yet struggle to handle unseen edges. In this paper, we revisit the architecture of existing temporal graph models and identify two essential but overlooked modeling requirements for future link prediction: representing nodes with unique identifiers and performing target-aware matching between source and destination nodes. To this end, we propose Cross-Attention based Future Link Predictor on Temporal Graphs (CRAFT), a simple yet effective architecture that discards memory and aggregation modules and instead builds on two components: learnable node embeddings and cross-attention between the destination and the source's recent interactions. This design provides strong expressive power and enables target-aware modeling of the compatibility between candidate destinations and the source's interaction patterns. Extensive experiments on diverse datasets demonstrate that CRAFT consistently achieves superior performance with high efficiency, making it well-suited for large-scale real-world applications.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 32 of its 48 references that are in the map. First posted on arXiv 26 May 2025.

Builds on

32 of 48 references.

References · 32

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  3. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
  4. 2018Self-Attentive Sequential Recommendationcited by 1,184
  5. 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 530
  6. 2020Inductive Representation Learning on Temporal Graphscited by 462
  7. 2019Predicting Dynamic Embedding Trajectory in Temporal Interaction Networkscited by 448
  8. 2019Representation Learning for Dynamic Graphs: A Surveycited by 265
  9. 2019What graph neural networks cannot learn: depth vs widthcited by 201
  10. 2020The Surprising Power of Graph Neural Networks with Random Node Initializationcited by 198
  11. 2021Inductive Representation Learning in Temporal Networks via Causal Anonymous Walkscited by 193
  12. 2023Towards Better Dynamic Graph Learning: New Architecture and Unified Librarycited by 157
20 more
  1. 2023Do We Really Need Complicated Model Architectures For Temporal Networks?cited by 143
  2. 2023Temporal Graph Benchmark for Machine Learning on Temporal Graphscited by 138
  3. 2020Foundations and modelling of dynamic networks using Dynamic Graph Neural Networks: A surveycited by 124
  4. 2022Towards Better Evaluation for Dynamic Link Predictioncited by 122
  5. 2018Streaming Graph Neural Networkscited by 91
  6. 2021TCL: Transformer-based Dynamic Graph Modelling via Contrastive Learningcited by 68
  7. 2022Neighborhood-aware Scalable Temporal Network Representation Learningcited by 54
  8. 2022TREND: TempoRal Event and Node Dynamics for Graph Representation Learningcited by 50
  9. 2023Revisiting Link Prediction: A Data Perspectivecited by 29
  10. 2024A survey of dynamic graph neural networkscited by 24
  11. 2024On the Feasibility of Simple Transformer for Dynamic Graph Modelingcited by 22
  12. 2025TGB-Seq Benchmark: Challenging Temporal GNNs with Complex Sequential Dynamicscited by 15
  13. 2017Stream Graphs and Link Streams for the Modeling of Interactions over Timecited by 14
  14. 2019Learning Temporal Attention in Dynamic Graphs with Bilinear Interactionscited by 11
  15. 2023HOT: Higher-Order Dynamic Graph Representation Learning with Efficient Transformerscited by 10
  16. 2023An Empirical Evaluation of Temporal Graph Benchmarkcited by 8
  17. 2023Revisiting Recommendation Loss Functions through Contrastive Learning (Technical Report)cited by 5
  18. 2024Machine Learning on Dynamic Graphs: A Survey on Applicationscited by 4
  19. 2025Towards Invariance to Node Identifiers in Graph Neural Networkscited by 4
  20. 2024Towards Ideal Temporal Graph Neural Networks: Evaluations and Conclusions after 10,000 GPU Hourscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.