mlsanityData to 14 Oct 2026

Towards Effective Federated Graph Foundation Model via Mitigating Knowledge Entanglement

arXiv 2505.12684 ↗First posted 19 May 2025cs.LG cs.AI cs.DBcited by 14

Not on the map. Why?

Abstract (arXiv)

Recent advances in graph machine learning have shifted to data-centric paradigms, driven by two emerging fields: (1) Federated graph learning (FGL) enables multi-client collaboration but faces challenges from data and task heterogeneity, limiting its practicality; (2) Graph foundation models (GFM) offer strong domain generalization but are usually trained on single machines, missing out on cross-silo data and resources. These paradigms are complementary, and their integration brings notable benefits. Motivated by this, we propose FedGFM, a novel decentralized GFM training paradigm. However, a key challenge is knowledge entanglement, where multi-domain knowledge merges into indistinguishable representations, hindering downstream adaptation. To address this, we present FedGFM+, an enhanced framework with two core modules to reduce knowledge entanglement: (1) AncDAI: A global anchor-based domain-aware initialization strategy. Before pre-training, each client encodes its local graph into domain-specific prototypes that serve as semantic anchors. Synthetic embeddings around these anchors initialize the global model. We theoretically prove these prototypes are distinguishable across domains, providing a strong inductive bias to disentangle domain-specific knowledge. (2) AdaDPP: A local adaptive domain-sensitive prompt pool. Each client learns a lightweight graph prompt capturing domain semantics during pre-training. During fine-tuning, prompts from all clients form a pool from which the GFM selects relevant prompts to augment target graph attributes, improving downstream adaptation. FedGFM+ is evaluated on 8 diverse benchmarks across multiple domains and tasks, outperforming 20 baselines from supervised learning, FGL, and federated GFM variants.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 55 of its 66 references that are in the map. First posted on arXiv 19 May 2025.

Builds on

55 of 66 references.

References · 55

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  6. 2017Graph Attention Networkscited by 8,923
  7. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  8. 2017Inductive Representation Learning on Large Graphscited by 6,320
  9. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  10. 2018How Powerful are Graph Neural Networks?cited by 4,393
  11. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
  12. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
38 more
  1. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  2. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
  3. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
  4. 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,102
  5. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
  6. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
  7. 2021Model-Contrastive Federated Learningcited by 766
  8. 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
  9. 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 260
  10. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
  11. 2021Subgraph Federated Learning with Missing Neighbor Generationcited by 132
  12. 2021Federated Graph Classification over Non-IID Graphscited by 114
  13. 2022Federated Learning on Non-IID Graphs via Structural Knowledge Sharingcited by 88
  14. 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 85
  15. 2024OpenGraph: Towards Open Graph Foundation Modelscited by 78
  16. 2024UniGraph: Learning a Unified Cross-Domain Foundation Model for Text-Attributed Graphscited by 66
  17. 2023Augmenting Low-Resource Text Classification with Graph-Grounded Pre-training and Promptingcited by 62
  18. 2025SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptationcited by 62
  19. 2024GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphscited by 58
  20. 2022Personalized Subgraph Federated Learningcited by 54
  21. 2024AnyGraph: Graph Foundation Model in the Wildcited by 53
  22. 2025UniGraph2: Learning a Unified Embedding Space to Bind Multimodal Graphscited by 49
  23. 2024FedGTA: Topology-aware Averaging for Federated Graph Learningcited by 44
  24. 2022FederatedScope-GNN: Towards a Unified, Comprehensive and Efficient Package for Federated Graph Learningcited by 43
  25. 2024Text-Free Multi-domain Graph Pre-training: Toward Graph Foundation Modelscited by 42
  26. 2025Multi-Domain Graph Foundation Models: Robust Knowledge Transfer via Topology Alignmentcited by 42
  27. 2025GFM-RAG: Graph Foundation Model for Retrieval Augmented Generationcited by 40
  28. 2021Federated Graph Learning -- A Position Papercited by 35
  29. 2025RiemannGFM: Learning a Graph Foundation Model from Riemannian Geometrycited by 35
  30. 2021FedGL: Federated Graph Learning Framework with Global Self-Supervisioncited by 34
  31. 2024Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Treescited by 32
  32. 2024Federated Graph Semantic and Structural Learningcited by 30
  33. 2024FedTAD: Topology-aware Data-free Knowledge Distillation for Subgraph Federated Learningcited by 27
  34. 2024AdaFGL: A New Paradigm for Federated Node Classification with Topology Heterogeneitycited by 25
  35. 2022FedGCN: Convergence-Communication Tradeoffs in Federated Training of Graph Convolutional Networkscited by 24
  36. 2024RAGraph: A General Retrieval-Augmented Graph Learning Frameworkcited by 24
  37. 2025LLM as GNN: Graph Vocabulary Learning for Text-Attributed Graph Foundation Modelscited by 22
  38. 2024Learning Graph Quantized Tokenizerscited by 19

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 12.

14 papers.

Sort:

By area: