mlsanityData to 14 Oct 2026

FedGKD: Unleashing the Power of Collaboration in Federated Graph Neural Networks

arXiv 2309.09517 ↗First posted 18 Sep 2023cs.LG cs.AI cs.DCcited by 7

Not on the map. Why?

Abstract (arXiv)

Federated training of Graph Neural Networks (GNN) has become popular in recent years due to its ability to perform graph-related tasks under data isolation scenarios while preserving data privacy. However, graph heterogeneity issues in federated GNN systems continue to pose challenges. Existing frameworks address the problem by representing local tasks using different statistics and relating them through a simple aggregation mechanism. However, these approaches suffer from limited efficiency from two aspects: low quality of task-relatedness quantification and inefficacy of exploiting the collaboration structure. To address these issues, we propose FedGKD, a novel federated GNN framework that utilizes a novel client-side graph dataset distillation method to extract task features that better describe task-relatedness, and introduces a novel server-side aggregation mechanism that is aware of the global collaboration structure. We conduct extensive experiments on six real-world datasets of different scales, demonstrating our framework's outperformance.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 40 of its 55 references that are in the map. First posted on arXiv 18 Sep 2023.

Builds on

40 of 55 references.

References · 40

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  4. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  5. 2018How Powerful are Graph Neural Networks?cited by 4,393
  6. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  7. 2019Advances and Open Problems in Federated Learningcited by 3,046
  8. 2018Federated Optimization in Heterogeneous Networkscited by 2,987
  9. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
  10. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
  11. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  12. 2020Rethinking Attention with Performerscited by 1,601
28 more
  1. 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,148
  2. 2018Pitfalls of Graph Neural Network Evaluationcited by 1,007
  3. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
  4. 2017Federated Multi-Task Learningcited by 672
  5. 2020Ditto: Fair and Robust Federated Learning Through Personalizationcited by 672
  6. 2019Federated Learning with Personalization Layerscited by 541
  7. 2019Clustered Federated Learning: Model-Agnostic Distributed Multi-Task Optimization under Privacy Constraintscited by 503
  8. 2019Transformer Dissection: A Unified Understanding of Transformer's Attention via the Lens of Kernelcited by 213
  9. 2022Structure-Aware Transformer for Graph Representation Learningcited by 194
  10. 2020Is Local SGD Better than Minibatch SGD?cited by 151
  11. 2021Graph Condensation for Graph Neural Networkscited by 150
  12. 2021Subgraph Federated Learning with Missing Neighbor Generationcited by 132
  13. 2022Privacy for Free: How does Dataset Condensation Help Privacy?cited by 120
  14. 2021Federated Graph Classification over Non-IID Graphscited by 114
  15. 2022Federated Learning with Partial Model Personalizationcited by 114
  16. 2021Multi-Center Federated Learning: Clients Clustering for Better Personalizationcited by 113
  17. 2020Distilled One-Shot Federated Learningcited by 109
  18. 2022Condensing Graphs via One-Step Gradient Matchingcited by 100
  19. 2023Understanding Oversquashing in GNNs through the Lens of Effective Resistancecited by 97
  20. 2023Personalized Federated Learning with Feature Alignment and Classifier Collaborationcited by 97
  21. 2022Federated Learning on Non-IID Graphs via Structural Knowledge Sharingcited by 88
  22. 2022Personalized Subgraph Federated Learningcited by 54
  23. 2022Adaptive and Robust Multi-Task Learningcited by 34
  24. 2022Personalized Federated Learning With Graphcited by 29
  25. 2020A No-Free-Lunch Theorem for MultiTask Learningcited by 28
  26. 2021Learn Locally, Correct Globally: A Distributed Algorithm for Training Graph Neural Networkscited by 24
  27. 2023Optimizing the Collaboration Structure in Cross-Silo Federated Learningcited by 19
  28. 2021Minimax Estimation for Personalized Federated Learning: An Alternative between FedAvg and Local Training?cited by 15

Built on by

Cited by year

Citing papers per year: 2024: 6; 2025: 1.

7 papers.