Towards Effective Federated Graph Foundation Model via Mitigating Knowledge Entanglement
Not on the map. Why?
Abstract (arXiv)
Recent advances in graph machine learning have shifted to data-centric paradigms, driven by two emerging fields: (1) Federated graph learning (FGL) enables multi-client collaboration but faces challenges from data and task heterogeneity, limiting its practicality; (2) Graph foundation models (GFM) offer strong domain generalization but are usually trained on single machines, missing out on cross-silo data and resources. These paradigms are complementary, and their integration brings notable benefits. Motivated by this, we propose FedGFM, a novel decentralized GFM training paradigm. However, a key challenge is knowledge entanglement, where multi-domain knowledge merges into indistinguishable representations, hindering downstream adaptation. To address this, we present FedGFM+, an enhanced framework with two core modules to reduce knowledge entanglement: (1) AncDAI: A global anchor-based domain-aware initialization strategy. Before pre-training, each client encodes its local graph into domain-specific prototypes that serve as semantic anchors. Synthetic embeddings around these anchors initialize the global model. We theoretically prove these prototypes are distinguishable across domains, providing a strong inductive bias to disentangle domain-specific knowledge. (2) AdaDPP: A local adaptive domain-sensitive prompt pool. Each client learns a lightweight graph prompt capturing domain semantics during pre-training. During fine-tuning, prompts from all clients form a pool from which the GFM selects relevant prompts to augment target graph attributes, improving downstream adaptation. FedGFM+ is evaluated on 8 diverse benchmarks across multiple domains and tasks, outperforming 20 baselines from supervised learning, FGL, and federated GFM variants.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 55 of its 66 references that are in the map. First posted on arXiv 19 May 2025.
Builds on
55 of 66 references.
References · 55
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2017Graph Attention Networkscited by 8,923
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
38 more
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
- 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,102
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
- 2021Model-Contrastive Federated Learningcited by 766
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
- 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 260
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
- 2021Subgraph Federated Learning with Missing Neighbor Generationcited by 132
- 2021Federated Graph Classification over Non-IID Graphscited by 114
- 2022Federated Learning on Non-IID Graphs via Structural Knowledge Sharingcited by 88
- 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 85
- 2024OpenGraph: Towards Open Graph Foundation Modelscited by 78
- 2024UniGraph: Learning a Unified Cross-Domain Foundation Model for Text-Attributed Graphscited by 66
- 2023Augmenting Low-Resource Text Classification with Graph-Grounded Pre-training and Promptingcited by 62
- 2025SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptationcited by 62
- 2024GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphscited by 58
- 2022Personalized Subgraph Federated Learningcited by 54
- 2024AnyGraph: Graph Foundation Model in the Wildcited by 53
- 2025UniGraph2: Learning a Unified Embedding Space to Bind Multimodal Graphscited by 49
- 2024FedGTA: Topology-aware Averaging for Federated Graph Learningcited by 44
- 2022FederatedScope-GNN: Towards a Unified, Comprehensive and Efficient Package for Federated Graph Learningcited by 43
- 2024Text-Free Multi-domain Graph Pre-training: Toward Graph Foundation Modelscited by 42
- 2025Multi-Domain Graph Foundation Models: Robust Knowledge Transfer via Topology Alignmentcited by 42
- 2025GFM-RAG: Graph Foundation Model for Retrieval Augmented Generationcited by 40
- 2021Federated Graph Learning -- A Position Papercited by 35
- 2025RiemannGFM: Learning a Graph Foundation Model from Riemannian Geometrycited by 35
- 2021FedGL: Federated Graph Learning Framework with Global Self-Supervisioncited by 34
- 2024Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Treescited by 32
- 2024Federated Graph Semantic and Structural Learningcited by 30
- 2024FedTAD: Topology-aware Data-free Knowledge Distillation for Subgraph Federated Learningcited by 27
- 2024AdaFGL: A New Paradigm for Federated Node Classification with Topology Heterogeneitycited by 25
- 2022FedGCN: Convergence-Communication Tradeoffs in Federated Training of Graph Convolutional Networkscited by 24
- 2024RAGraph: A General Retrieval-Augmented Graph Learning Frameworkcited by 24
- 2025LLM as GNN: Graph Vocabulary Learning for Text-Attributed Graph Foundation Modelscited by 22
- 2024Learning Graph Quantized Tokenizerscited by 19
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 12.
14 papers.
Sort:
By area:
- 2025FedBook: A Unified Federated Graph Foundation Codebook with Intra-domain and Inter-domain Knowledge Modelingcited by 8
- 2025A Comprehensive Data-centric Overview of Federated Graph Learningcited by 7
- 2026TMTE: Effective Multimodal Graph Learning with Task-aware Modality and Topology Co-evolutioncited by 3
- 2026Rethinking Federated Graph Foundation Models: A Graph-Language Alignment-based Approachcited by 2
- 2026GRM: Utility-Aware Jailbreak Attacks on Audio LLMs via Gradient-Ratio Maskingcited by 2
- 2026Riemannian Geometry Speaks Louder Than Words: From Graph Foundation Model to Next-Generation Graph Intelligencecited by 1
- 2026FedLAB: Traceable Semantic Codebooks for Federated Multimodal Graph Foundation Learningcited by 1
- 2026Toward Federated Multimodal Graph Foundation Models: A Topology-Aware Multimodal Alignment Frameworkcited by 1
- 2026Towards Effective Federated Multimodal Graph Learning via Navigating Multifaceted Heterogeneitycited by 1
- 2026DANCE: Dynamic, Available, Neighbor-gated Condensation for Federated Text-Attributed Graphscited by 0
- 2026A Unified Graph Language Model for Multi-Domain Multi-Task Graph Alignment Instruction Tuningcited by 0
- 2026MMFGU: Multimodal Federated Graph Unlearningcited by 0
- 2026Coupling Perception and Reasoning in Federated Multimodal Graph Foundation Models24 Sep 2026
- 2026Towards Adaptive Federated Graph Clustering: A Global Community-aware Contrastive Learning-based Approach1 Aug 2026
- 2026Towards Effective Federated Multimodal Graph Learning via Navigating Multifaceted Heterogeneity1 Aug 2026
- 2026MMFGU: Multimodal Federated Graph Unlearning30 Jul 2026
- 2026Toward Federated Multimodal Graph Foundation Models: A Topology-Aware Multimodal Alignment Framework17 Jul 2026
- 2026FedLAB: Traceable Semantic Codebooks for Federated Multimodal Graph Foundation Learning30 Jun 2026
- 2026A Unified Graph Language Model for Multi-Domain Multi-Task Graph Alignment Instruction Tuning12 May 2026
- 2026GRM: Utility-Aware Jailbreak Attacks on Audio LLMs via Gradient-Ratio Masking10 Apr 2026
- 2026TMTE: Effective Multimodal Graph Learning with Task-aware Modality and Topology Co-evolution29 Mar 2026
- 2026Riemannian Geometry Speaks Louder Than Words: From Graph Foundation Model to Next-Generation Graph Intelligence23 Mar 2026
- 2026Rethinking Federated Graph Foundation Models: A Graph-Language Alignment-based Approach29 Jan 2026
- 2026DANCE: Dynamic, Available, Neighbor-gated Condensation for Federated Text-Attributed Graphs23 Jan 2026
- 2025FedBook: A Unified Federated Graph Foundation Codebook with Intra-domain and Inter-domain Knowledge Modelingcited by 8
- 2025A Comprehensive Data-centric Overview of Federated Graph Learningcited by 7
- 2026TMTE: Effective Multimodal Graph Learning with Task-aware Modality and Topology Co-evolutioncited by 3
- 2026Riemannian Geometry Speaks Louder Than Words: From Graph Foundation Model to Next-Generation Graph Intelligencecited by 1
- 2026FedLAB: Traceable Semantic Codebooks for Federated Multimodal Graph Foundation Learningcited by 1
- 2026Toward Federated Multimodal Graph Foundation Models: A Topology-Aware Multimodal Alignment Frameworkcited by 1
- 2026Towards Effective Federated Multimodal Graph Learning via Navigating Multifaceted Heterogeneitycited by 1
- 2026DANCE: Dynamic, Available, Neighbor-gated Condensation for Federated Text-Attributed Graphscited by 0
- 2026A Unified Graph Language Model for Multi-Domain Multi-Task Graph Alignment Instruction Tuningcited by 0
- 2026Towards Adaptive Federated Graph Clustering: A Global Community-aware Contrastive Learning-based Approachcited by 0
- 2026Coupling Perception and Reasoning in Federated Multimodal Graph Foundation Modelscited by 0
- 2026Coupling Perception and Reasoning in Federated Multimodal Graph Foundation Models24 Sep 2026
- 2026Towards Adaptive Federated Graph Clustering: A Global Community-aware Contrastive Learning-based Approach1 Aug 2026
- 2026Towards Effective Federated Multimodal Graph Learning via Navigating Multifaceted Heterogeneity1 Aug 2026
- 2026Toward Federated Multimodal Graph Foundation Models: A Topology-Aware Multimodal Alignment Framework17 Jul 2026
- 2026FedLAB: Traceable Semantic Codebooks for Federated Multimodal Graph Foundation Learning30 Jun 2026
- 2026A Unified Graph Language Model for Multi-Domain Multi-Task Graph Alignment Instruction Tuning12 May 2026
- 2026TMTE: Effective Multimodal Graph Learning with Task-aware Modality and Topology Co-evolution29 Mar 2026
- 2026Riemannian Geometry Speaks Louder Than Words: From Graph Foundation Model to Next-Generation Graph Intelligence23 Mar 2026
- 2026DANCE: Dynamic, Available, Neighbor-gated Condensation for Federated Text-Attributed Graphs23 Jan 2026
- 2025FedBook: A Unified Federated Graph Foundation Codebook with Intra-domain and Inter-domain Knowledge Modeling9 Oct 2025
- 2025A Comprehensive Data-centric Overview of Federated Graph Learning22 Jul 2025