FedGCN: Convergence-Communication Tradeoffs in Federated Training of Graph Convolutional Networks
Not on the map. Why?
Abstract (arXiv)
Methods for training models on graphs distributed across multiple clients have recently grown in popularity, due to the size of these graphs as well as regulations on keeping data where it is generated. However, the cross-client edges naturally exist among clients. Thus, distributed methods for training a model on a single graph incur either significant communication overhead between clients or a loss of available information to the training. We introduce the Federated Graph Convolutional Network (FedGCN) algorithm, which uses federated learning to train GCN models for semi-supervised node classification with fast convergence and little communication. Compared to prior methods that require extra communication among clients at each training round, FedGCN clients only communicate with the central server in one pre-training step, greatly reducing communication costs and allowing the use of homomorphic encryption to further enhance privacy. We theoretically analyze the tradeoff between FedGCN's convergence rate and communication cost under different data distributions. Experimental results show that our FedGCN algorithm achieves better model accuracy with 51.7% faster convergence on average and at least 100X less communication compared to prior work.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 30 of its 43 references that are in the map. First posted on arXiv 28 Jan 2022.
Builds on
30 of 43 references.
References · 30
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2019Simplifying Graph Convolutional Networkscited by 1,470
- 2019On the Convergence of FedAvg on Non-IID Datacited by 1,220
- 2018Federated Learning with Non-IID Datacited by 1,099
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
- 2020Adaptive Federated Optimizationcited by 1,036
- 2019Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classificationcited by 836
- 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 566
18 more
- 2019Federated Learning with Differential Privacy: Algorithms and Performance Analysiscited by 528
- 2019DeepGCNs: Can GCNs Go as Deep as CNNs?cited by 527
- 2017Community Detection and Stochastic Block Modelscited by 317
- 2020SIGN: Scalable Inception Graph Neural Networkscited by 283
- 2018Parallel Restarted SGD with Faster Convergence and Less Communication: Demystifying Why Model Averaging Works for Deep Learningcited by 277
- 2021Achieving Linear Speedup with Partial Worker Participation in Non-IID Federated Learningcited by 192
- 2020Scaling Graph Neural Networks with Approximate PageRankcited by 174
- 2021Subgraph Federated Learning with Missing Neighbor Generationcited by 132
- 2013Consistency of spectral clustering in stochastic block modelscited by 128
- 2020Convergence and Stability of Graph Convolutional Networks on Large Random Graphscited by 75
- 2021Cross-Node Federated Graph Neural Network for Spatio-Temporal Data Modelingcited by 69
- 2020GraphFL: A Federated Learning Framework for Semi-Supervised Node Classification on Graphscited by 64
- 2020ASFGNN: Automated Separated-Federated Graph Neural Networkcited by 36
- 2019Semi-Supervised Hierarchical Recurrent Graph Neural Network for City-Wide Parking Availability Predictioncited by 30
- 2021SpreadGNN: Serverless Multi-task Federated Learning for Graph Neural Networkscited by 30
- 2021Learn Locally, Correct Globally: A Distributed Algorithm for Training Graph Neural Networkscited by 24
- 2018Analysis of spectral clustering algorithms for community detection: the general bipartite settingcited by 20
- 2020Sparse and Smooth: improved guarantees for Spectral Clustering in the Dynamic Stochastic Block Modelcited by 5
Built on by
Citing papers per year: 2022: 2; 2023: 0; 2024: 7; 2025: 12; 2026: 3.
24 papers.
Sort:
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 88
- 2024A Survey of Graph Neural Networks in Real world: Imbalance, Noise, Privacy and OOD Challengescited by 54
- 2022Federated Graph Neural Networks: Overview, Techniques and Challengescited by 52
- 2025Towards Effective Federated Graph Foundation Model via Mitigating Knowledge Entanglementcited by 14
- 2025A Comprehensive Data-centric Overview of Federated Graph Learningcited by 7
- 2025Subgraph Federated Learning for Local Generalizationcited by 6
- 2025Subgraph Federated Learning via Spectral Methodscited by 6
- 2024Decoupled Subgraph Federated Learningcited by 3
- 2024FedGraph: A Research Library and Benchmark for Federated Graph Learningcited by 3
- 2024Edge Graph Intelligence: Reciprocally Empowering Edge Networks with Graph Intelligencecited by 2
- 2025FedDAG: Federated Domain Adversarial Generation Towards Generalizable Medical Image Analysiscited by 2
- 2024FedGIG: Graph Inversion from Gradient in Federated Learningcited by 1
12 more
- 2025Deal: Distributed End-to-End GNN Inference for All Nodescited by 1
- 2025Federated Prototype Graph Learningcited by 1
- 2025Personalized Subgraph Federated Learning with Differentiable Auxiliary Projectionscited by 1
- 2024Federated Hypergraph Learning with Local Differential Privacy: Toward Privacy-Aware Hypergraph Structure Completioncited by 0
- 2024Enhancing Federated Graph Learning via Adaptive Fusion of Structural and Node Characteristicscited by 0
- 2025Federated Spectral Graph Transformers Meet Neural Ordinary Differential Equations for Non-IID Graphscited by 0
- 2025Optimizing Federated Learning using Remote Embeddings for Graph Neural Networkscited by 0
- 2025PassREfinder-FL: Privacy-Preserving Credential Stuffing Risk Prediction via Graph-Based Federated Learning for Representing Password Reuse between Websitescited by 0
- 2025FairGFL: Privacy-Preserving Fairness-Aware Federated Learning with Overlapping Subgraphscited by 0
- 2026Federated Cross-Client Subgraph Pattern Detectioncited by 0
- 2026Provably Communication-Efficient and Privacy-Preserving Federated Graph Neural Networkscited by 0
- 2026DG-CoLearn: An Efficient Collaborative Learning Framework for Dynamic Graphscited by 0
- 2026DG-CoLearn: An Efficient Collaborative Learning Framework for Dynamic Graphs29 May 2026
- 2026Provably Communication-Efficient and Privacy-Preserving Federated Graph Neural Networks25 May 2026
- 2026Federated Cross-Client Subgraph Pattern Detection7 May 2026
- 2025FairGFL: Privacy-Preserving Fairness-Aware Federated Learning with Overlapping Subgraphs29 Dec 2025
- 2025Subgraph Federated Learning via Spectral Methods29 Oct 2025
- 2025PassREfinder-FL: Privacy-Preserving Credential Stuffing Risk Prediction via Graph-Based Federated Learning for Representing Password Reuse between Websites17 Oct 2025
- 2025A Comprehensive Data-centric Overview of Federated Graph Learning22 Jul 2025
- 2025Optimizing Federated Learning using Remote Embeddings for Graph Neural Networks14 Jun 2025
- 2025Personalized Subgraph Federated Learning with Differentiable Auxiliary Projections29 May 2025
- 2025Towards Effective Federated Graph Foundation Model via Mitigating Knowledge Entanglement19 May 2025
- 2025Federated Spectral Graph Transformers Meet Neural Ordinary Differential Equations for Non-IID Graphs16 Apr 2025
- 2025Federated Prototype Graph Learning13 Apr 2025
12 more
- 2025Subgraph Federated Learning for Local Generalization6 Mar 2025
- 2025Deal: Distributed End-to-End GNN Inference for All Nodes4 Mar 2025
- 2025FedDAG: Federated Domain Adversarial Generation Towards Generalizable Medical Image Analysis22 Jan 2025
- 2024Enhancing Federated Graph Learning via Adaptive Fusion of Structural and Node Characteristics25 Dec 2024
- 2024FedGIG: Graph Inversion from Gradient in Federated Learning24 Dec 2024
- 2024FedGraph: A Research Library and Benchmark for Federated Graph Learning8 Oct 2024
- 2024Federated Hypergraph Learning with Local Differential Privacy: Toward Privacy-Aware Hypergraph Structure Completion9 Aug 2024
- 2024Edge Graph Intelligence: Reciprocally Empowering Edge Networks with Graph Intelligence7 Jul 2024
- 2024A Survey of Graph Neural Networks in Real world: Imbalance, Noise, Privacy and OOD Challenges7 Mar 2024
- 2024Decoupled Subgraph Federated Learning29 Feb 2024
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trends16 May 2022
- 2022Federated Graph Neural Networks: Overview, Techniques and Challenges15 Feb 2022
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 88
- 2024A Survey of Graph Neural Networks in Real world: Imbalance, Noise, Privacy and OOD Challengescited by 54
- 2022Federated Graph Neural Networks: Overview, Techniques and Challengescited by 52
- 2025Towards Effective Federated Graph Foundation Model via Mitigating Knowledge Entanglementcited by 14
- 2025A Comprehensive Data-centric Overview of Federated Graph Learningcited by 7
- 2025Subgraph Federated Learning for Local Generalizationcited by 6
- 2025Subgraph Federated Learning via Spectral Methodscited by 6
- 2024Decoupled Subgraph Federated Learningcited by 3
- 2024FedGraph: A Research Library and Benchmark for Federated Graph Learningcited by 3
- 2024Edge Graph Intelligence: Reciprocally Empowering Edge Networks with Graph Intelligencecited by 2
- 2025FedDAG: Federated Domain Adversarial Generation Towards Generalizable Medical Image Analysiscited by 2
- 2024FedGIG: Graph Inversion from Gradient in Federated Learningcited by 1
12 most cited of 24 All 24 (JSON)
- 2026DG-CoLearn: An Efficient Collaborative Learning Framework for Dynamic Graphs29 May 2026
- 2026Provably Communication-Efficient and Privacy-Preserving Federated Graph Neural Networks25 May 2026
- 2026Federated Cross-Client Subgraph Pattern Detection7 May 2026
- 2025FairGFL: Privacy-Preserving Fairness-Aware Federated Learning with Overlapping Subgraphs29 Dec 2025
- 2025Subgraph Federated Learning via Spectral Methods29 Oct 2025
- 2025PassREfinder-FL: Privacy-Preserving Credential Stuffing Risk Prediction via Graph-Based Federated Learning for Representing Password Reuse between Websites17 Oct 2025
- 2025A Comprehensive Data-centric Overview of Federated Graph Learning22 Jul 2025
- 2025Optimizing Federated Learning using Remote Embeddings for Graph Neural Networks14 Jun 2025
- 2025Personalized Subgraph Federated Learning with Differentiable Auxiliary Projections29 May 2025
- 2025Towards Effective Federated Graph Foundation Model via Mitigating Knowledge Entanglement19 May 2025
- 2025Federated Spectral Graph Transformers Meet Neural Ordinary Differential Equations for Non-IID Graphs16 Apr 2025
- 2025Federated Prototype Graph Learning13 Apr 2025
12 newest of 24 All 24 (JSON)