Unified Multi-Domain Graph Pre-training for Homogeneous and Heterogeneous Graphs via Domain-Specific Expert Encoding
Not on the map. Why?
Abstract (arXiv)
Graph pre-training has achieved remarkable success in recent years, delivering transferable representations for downstream adaptation. However, most existing methods are designed for either homogeneous or heterogeneous graphs, thereby hindering unified graph modeling across diverse graph types. This separation contradicts real-world applications, where mixed homogeneous and heterogeneous graphs are ubiquitous, and distribution shifts between upstream pre-training and downstream deployment are common. In this paper, we empirically demonstrate that a balanced mixture of homogeneous and heterogeneous graph pre-training benefits downstream tasks and propose a unified multi-domain Graph Pre-training method across Homogeneous and Heterogeneous graphs (mathbfGPH2). To address the lack of a unified encoder for homogeneous and heterogeneous graphs, we propose a Unified Multi-View Graph Construction that simultaneously encodes both without explicit graph-type-specific designs. To cope with the increased cross-domain distribution discrepancies arising from mixed graphs, we introduce domain-specific expert encoding. Each expert is independently pre-trained on a single graph to capture domain-specific knowledge, thereby shielding the pre-training encoder from the adverse effects of cross-domain discrepancies. For downstream tasks, we further design a Task-oriented Expert Fusion Strategy that adaptively integrates multiple experts based on their discriminative strengths. Extensive experiments on mixed graphs demonstrate that GPH2 enables stable transfer across graph types and domains, significantly outperforming existing graph pre-training methods.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 41 of its 70 references that are in the map. First posted on arXiv 13 Feb 2026.
Builds on
41 of 70 references.
References · 41
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,318
- 2017Graph Attention Networkscited by 8,888
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,911
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,574
- 2019Simplifying Graph Convolutional Networkscited by 1,474
- 2016Variational Graph Auto-Encoderscited by 1,379
- 2020Graph Contrastive Learning with Augmentationscited by 1,207
- 2018Deep Graph Infomaxcited by 1,104
- 2018Pitfalls of Graph Neural Network Evaluationcited by 1,003
- 2019Heterogeneous Graph Attention Networkcited by 733
- 2015Image-based Recommendations on Styles and Substitutescited by 703
- 2020Contrastive Multi-View Representation Learning on Graphscited by 652
29 more
- 2020Deep Graph Contrastive Representation Learningcited by 537
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 462
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 446
- 2017Few-Shot Learning with Graph Neural Networkscited by 324
- 2020MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embeddingcited by 304
- 2020GPT-GNN: Generative Pre-Training of Graph Neural Networkscited by 303
- 2021Graph Self-Supervised Learning: A Surveycited by 289
- 2021Self-Supervised Learning of Graph Neural Networks: A Unified Reviewcited by 184
- 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 167
- 2023All in One: Multi-task Prompting for Graph Neural Networkscited by 148
- 2023GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learnercited by 131
- 2021Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learningcited by 130
- 2023Graph Foundation Models: Concepts, Opportunities and Challengescited by 101
- 2024All in One and One for All: A Simple yet Effective Method towards Cross-domain Graph Pretrainingcited by 84
- 2022Rethinking and Scaling Up Graph Contrastive Learning: An Extremely Efficient Approach with Group Discriminationcited by 68
- 2023Graph Mixture of Experts: Learning on Large-Scale Graphs with Explicit Diversity Modelingcited by 63
- 2023Graph Prompt Learning: A Comprehensive Survey and Beyondcited by 61
- 2025SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptationcited by 61
- 2025PyG 2.0: Scalable Learning on Real World Graphscited by 51
- 2022Heterogeneous Graph Masked Autoencoderscited by 47
- 2023HGPROMPT: Bridging Homogeneous and Heterogeneous Graphs for Few-shot Prompt Learningcited by 45
- 2024Text-Free Multi-domain Graph Pre-training: Toward Graph Foundation Modelscited by 41
- 2025Multi-Domain Graph Foundation Models: Robust Knowledge Transfer via Topology Alignmentcited by 41
- 2023MultiGPrompt for Multi-Task Pre-Training and Prompting on Graphscited by 40
- 2023SGL-PT: A Strong Graph Learner with Graph Prompt Tuningcited by 35
- 2023HetGPT: Harnessing the Power of Prompt Tuning in Pre-Trained Heterogeneous Graph Neural Networkscited by 32
- 2024ProG: A Graph Prompt Learning Benchmarkcited by 29
- 2021Zero-shot and Few-shot Learning with Knowledge Graphs: A Comprehensive Surveycited by 23
Built on by
Citing papers per year: 2026: 1.
1 paper.