mlsanityData to 7 Oct 2026

A Survey of Deep Graph Learning under Distribution Shifts: from Graph Out-of-Distribution Generalization to Adaptation

arXiv 2410.19265 ↗First posted 25 Oct 2024cs.LGcited by 16

Not on the map. Why?

Abstract (arXiv)

Distribution shifts on graphs -- the discrepancies in data distribution between training and employing a graph machine learning model -- are ubiquitous and often unavoidable in real-world scenarios. These shifts may severely deteriorate model performance, posing significant challenges for reliable graph machine learning. Consequently, there has been a surge in research on graph machine learning under distribution shifts, aiming to train models to achieve satisfactory performance on out-of-distribution (OOD) test data. In our survey, we provide an up-to-date and forward-looking review of deep graph learning under distribution shifts. Specifically, we cover three primary scenarios: graph OOD generalization, training-time graph OOD adaptation, and test-time graph OOD adaptation. We begin by formally formulating the problems and discussing various types of distribution shifts that can affect graph learning, such as covariate shifts and concept shifts. To provide a better understanding of the literature, we introduce a systematic taxonomy that classifies existing methods into model-centric and data-centric approaches, investigating the techniques used in each category. We also summarize commonly used datasets in this research area to facilitate further investigation. Finally, we point out promising research directions and the corresponding challenges to encourage further study in this vital domain. We also provide a continuously updated reading list at https://github.com/kaize0409/Awesome-Graph-OOD.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 138 of its 200 references that are in the map. First posted on arXiv 25 Oct 2024.

Builds on

138 of 200 references.

References · 138

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Inductive Representation Learning on Large Graphscited by 6,284
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  4. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  5. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  6. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
  7. 2019Invariant Risk Minimizationcited by 1,832
  8. 2019Simplifying Graph Convolutional Networkscited by 1,470
  9. 2016Variational Graph Auto-Encoderscited by 1,373
  10. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  11. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  12. 2019A Comprehensive Survey on Transfer Learningcited by 1,154
38 more
  1. 2018Deep Graph Infomaxcited by 1,101
  2. 2020In Search of Lost Domain Generalizationcited by 1,042
  3. 2019An Introduction to Variational Autoencoderscited by 997
  4. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  5. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  6. 2015Deep Learning and the Information Bottleneck Principlecited by 793
  7. 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
  8. 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
  9. 2013Domain Generalization via Invariant Feature Representationcited by 622
  10. 2019Multi-scale Attributed Node Embeddingcited by 543
  11. 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 521
  12. 2019EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphscited by 443
  13. 2020Explainability in Graph Neural Networks: A Taxonomic Surveycited by 383
  14. 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 353
  15. 2017Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Rankingcited by 332
  16. 2020Environment Inference for Invariant Learningcited by 306
  17. 2017struc2vec: Learning Node Representations from Structural Identitycited by 214
  18. 2020How Does Mixup Help With Robustness and Generalization?cited by 193
  19. 2020Invariant Risk Minimization Gamescited by 188
  20. 2022Discovering Invariant Rationales for Graph Neural Networkscited by 186
  21. 2022Interpretable and Generalizable Graph Learning via Stochastic Attention Mechanismcited by 171
  22. 2019Understanding Attention and Generalization in Graph Neural Networkscited by 169
  23. 2020Graph Information Bottleneckcited by 168
  24. 2022Handling Distribution Shifts on Graphs: An Invariance Perspectivecited by 163
  25. 2022G-Mixup: Graph Data Augmentation for Graph Classificationcited by 145
  26. 2022Learning Causally Invariant Representations for Out-of-Distribution Generalization on Graphscited by 144
  27. 2022GOOD: A Graph Out-of-Distribution Benchmarkcited by 140
  28. 2018DeepInf: Social Influence Prediction with Deep Learningcited by 128
  29. 2020From Local Structures to Size Generalization in Graph Neural Networkscited by 119
  30. 2020Graphon Neural Networks and the Transferability of Graph Neural Networkscited by 117
  31. 2021Learning Debiased Representation via Disentangled Feature Augmentationcited by 116
  32. 2019DIVA: Domain Invariant Variational Autoencoderscited by 114
  33. 2021Causal Attention for Interpretable and Generalizable Graph Classificationcited by 108
  34. 2022Universal Prompt Tuning for Graph Neural Networkscited by 100
  35. 2022Out-Of-Distribution Generalization on Graphs: A Surveycited by 97
  36. 2023Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluationscited by 96
  37. 2019Graph Adversarial Training: Dynamically Regularizing Based on Graph Structurecited by 93
  38. 2020Transfer Learning of Graph Neural Networks with Ego-graph Information Maximizationcited by 93

50 most cited of 138 All 138 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 7; 2026: 8.

16 papers.

Sort:

By area: