Provably Communication-Efficient and Privacy-Preserving Federated Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
Graph neural networks (GNNs) achieve strong performance on relational data, but real-world graphs are often distributed across organizations that cannot share raw data due to privacy and policy constraints. Existing federated GNN methods either ignore cross-client links, leading to degraded accuracy, or require frequent embedding exchanges, incurring substantial communication and privacy costs. We propose CE-FedGNN, a communication-efficient and privacy-preserving federated GNN framework for learning over such coupled graphs. Our approach avoids sharing raw data or per-round embeddings by infrequently exchanging aggregated node representations. To handle cross-client dependency and staleness, we introduce a moving-average estimator that continuously tracks node representations and enables their stable reuse across rounds. To provide formal privacy guarantees for the released representations, we adopt the metric differential privacy (metric-DP) framework, which measures privacy with respect to distances in the learned embedding space rather than worst-case input perturbations. This yields meaningful guarantees at noise levels where standard differential privacy becomes overly conservative. We establish convergence to a stationary point at a rate of O(1/√T) with O(T3/4) communication complexity. In addition, we derive (varepsilon,δ)-metric-DP guarantees via R'enyi differential privacy composition under a public-cohort threat model. Experiments on synthetic interbank anti-money laundering benchmarks and citation networks demonstrate that CE-FedGNN achieves strong performance while significantly reducing communication and maintaining robustness under privacy-preserving noise.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 72 of its 94 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
72 of 94 references.
References · 72
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2019Advances and Open Problems in Federated Learningcited by 3,021
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2016Deep Learning with Differential Privacycited by 2,682
- 2019Deep Leakage from Gradientscited by 1,004
- 2018Pitfalls of Graph Neural Network Evaluationcited by 994
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
- 2018A Convergence Theory for Deep Learning via Over-Parameterizationcited by 784
- 2017Renyi Differential Privacycited by 643
38 more
- 2018Local SGD Converges Fast and Communicates Littlecited by 595
- 2016Federated Optimization: Distributed Machine Learning for On-Device Intelligencecited by 558
- 2019Federated Learning with Differential Privacy: Algorithms and Performance Analysiscited by 528
- 2020Principal Neighbourhood Aggregation for Graph Netscited by 477
- 2021Opacus: User-Friendly Differential Privacy Library in PyTorchcited by 375
- 2018Parallel Restarted SGD with Faster Convergence and Less Communication: Demystifying Why Model Averaging Works for Deep Learningcited by 277
- 2019Tighter Theory for Local SGD on Identical and Heterogeneous Datacited by 266
- 2019R'enyi Differential Privacy of the Sampled Gaussian Mechanismcited by 199
- 2021Identity-aware Graph Neural Networkscited by 197
- 2019On the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimizationcited by 178
- 2022How Powerful are Spectral Graph Neural Networkscited by 169
- 2018Amplification by Shuffling: From Local to Central Differential Privacy via Anonymitycited by 163
- 2019Anti-Money Laundering in Bitcoin: Experimenting with Graph Convolutional Networks for Financial Forensicscited by 158
- 2020Is Local SGD Better than Minibatch SGD?cited by 151
- 2020Minibatch vs Local SGD for Heterogeneous Distributed Learningcited by 147
- 2020The Discrete Gaussian for Differential Privacycited by 134
- 2021Subgraph Federated Learning with Missing Neighbor Generationcited by 132
- 2021ETA Prediction with Graph Neural Networks in Google Mapscited by 130
- 2020LDP-Fed: Federated Learning with Local Differential Privacycited by 129
- 2019Privacy- and Utility-Preserving Textual Analysis via Calibrated Multivariate Perturbationscited by 115
- 2019Local SGD with Periodic Averaging: Tighter Analysis and Adaptive Synchronizationcited by 106
- 2021Distributionally Robust Federated Averagingcited by 104
- 2021FedGNN: Federated Graph Neural Network for Privacy-Preserving Recommendationcited by 97
- 2020Federated Unsupervised Representation Learningcited by 92
- 2017Beyond News Contents: The Role of Social Context for Fake News Detectioncited by 91
- 2021GNNAutoScale: Scalable and Expressive Graph Neural Networks via Historical Embeddingscited by 90
- 2020Quantifying Privacy Leakage in Graph Embeddingcited by 82
- 2020Molecular graph generation with Graph Neural Networkscited by 79
- 2019Approximation Ratios of Graph Neural Networks for Combinatorial Problemscited by 68
- 2022FedNest: Federated Bilevel, Minimax, and Compositional Optimizationcited by 60
- 2021E-GraphSAGE: A Graph Neural Network based Intrusion Detection System for IoTcited by 55
- 2022Graph Neural Networks are Dynamic Programmerscited by 55
- 2022Personalized Subgraph Federated Learningcited by 54
- 2023Realistic Synthetic Financial Transactions for Anti-Money Laundering Modelscited by 47
- 2022GAP: Differentially Private Graph Neural Networks with Aggregation Perturbationcited by 46
- 2019A Decentralized Parallel Algorithm for Training Generative Adversarial Netscited by 43
- 2021Node-Level Differentially Private Graph Neural Networkscited by 43
- 2020A Differentially Private Text Perturbation Method Using a Regularized Mahalanobis Metriccited by 41
50 most cited of 72 All 72 (JSON)
Built on by
Not cited yet.