Out-of-Distribution Generalization in Graph Foundation Models
Not on the map. Why?
Abstract (arXiv)
Graphs are a fundamental data structure for representing relational information in domains such as social networks, molecular systems, and knowledge graphs. However, graph learning models often suffer from limited generalization when applied beyond their training distributions. In practice, distribution shifts may arise from changes in graph structure, domain semantics, available modalities, or task formulations. To address these challenges, graph foundation models (GFMs) have recently emerged, aiming to learn general-purpose representations through large-scale pretraining across diverse graphs and tasks. In this survey, we review recent progress on GFMs from the perspective of out-of-distribution (OOD) generalization. We first discuss the main challenges posed by distribution shifts in graph learning and outline a unified problem setting. We then organize existing approaches based on whether they are designed to operate under a fixed task specification or to support generalization across heterogeneous task formulations, and summarize the corresponding OOD handling strategies and pretraining objectives. Finally, we review common evaluation protocols and discuss open directions for future research. To the best of our knowledge, this paper is the first survey for OOD generalization in GFMs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 62 references that are in the map. First posted on arXiv 28 Jan 2026.
Builds on
45 of 62 references.
References · 45
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2019Invariant Risk Minimizationcited by 1,854
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
- 2020Graph Neural Networks in Recommender Systems: A Surveycited by 494
- 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 368
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
- 2024LLaGA: Large Language and Graph Assistantcited by 181
- 2023All in One: Multi-task Prompting for Graph Neural Networkscited by 148
33 more
- 2022GOOD: A Graph Out-of-Distribution Benchmarkcited by 141
- 2023Graph Foundation Models: Concepts, Opportunities and Challengescited by 103
- 2022Out-Of-Distribution Generalization on Graphs: A Surveycited by 97
- 2023A Survey of Graph Meets Large Language Model: Progress and Future Directionscited by 85
- 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 85
- 2021OOD-GNN: Out-of-Distribution Generalized Graph Neural Networkcited by 78
- 2024OpenGraph: Towards Open Graph Foundation Modelscited by 78
- 2024UniGraph: Learning a Unified Cross-Domain Foundation Model for Text-Attributed Graphscited by 66
- 2025SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptationcited by 62
- 2024GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphscited by 58
- 2024GOFA: A Generative One-For-All Model for Joint Graph Language Modelingcited by 57
- 2024AnyGraph: Graph Foundation Model in the Wildcited by 53
- 2025UniGraph2: Learning a Unified Embedding Space to Bind Multimodal Graphscited by 49
- 2024Can LLM Graph Reasoning Generalize beyond Pattern Memorization?cited by 47
- 2025Graph Foundation Models: A Comprehensive Surveycited by 44
- 2024Text-Free Multi-domain Graph Pre-training: Toward Graph Foundation Modelscited by 42
- 2025Multi-Domain Graph Foundation Models: Robust Knowledge Transfer via Topology Alignmentcited by 42
- 2024Fully-inductive Node Classification on Arbitrary Graphscited by 39
- 2025RiemannGFM: Learning a Graph Foundation Model from Riemannian Geometrycited by 35
- 2024Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Treescited by 32
- 2024GraphLoRA: Structure-Aware Contrastive Low-Rank Adaptation for Cross-Graph Transfer Learningcited by 21
- 2025GraphPFN: A Prior-Data Fitted Graph Foundation Modelcited by 21
- 2023Curriculum Graph Machine Learning: A Surveycited by 15
- 2024GraphFM: A generalist graph transformer that learns transferable representations across diverse domainscited by 14
- 2024Towards Neural Scaling Laws on Graphscited by 13
- 2025GRAVER: Generative Graph Vocabularies for Robust Graph Foundation Models Fine-tuningcited by 13
- 2025Graph2text or Graph2token: A Perspective of Large Language Models for Graph Learningcited by 12
- 2025GRAPHMOE: Amplifying Cognitive Depth of Mixture-of-Experts Network via Introducing Self-Rethinking Mechanismcited by 7
- 2024Future Directions in the Theory of Graph Machine Learningcited by 6
- 2025Graph Foundation Models for Recommendation: A Comprehensive Surveycited by 4
- 2025Modular Machine Learning: An Indispensable Path towards New-Generation Large Language Modelscited by 4
- 2025Invariant Graph Transformer for Out-of-Distribution Generalizationcited by 2
- 2025Multi-task parallelism for robust pre-training of graph foundation models on multi-source, multi-fidelity atomistic modeling datacited by 1
Built on by
Not cited yet.