mlsanityData to 7 Oct 2026

Federated Graph Learning with Adaptive Importance-based Sampling

arXiv 2409.14655 ↗First posted 23 Sep 2024cs.DC cs.CR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

For privacy-preserving graph learning tasks involving distributed graph datasets, federated learning (FL)-based GCN (FedGCN) training is required. A key challenge for FedGCN is scaling to large-scale graphs, which typically incurs high computation and communication costs when dealing with the explosively increasing number of neighbors. Existing graph sampling-enhanced FedGCN training approaches ignore graph structural information or dynamics of optimization, resulting in high variance and inaccurate node embeddings. To address this limitation, we propose the Federated Adaptive Importance-based Sampling (FedAIS) approach. It achieves substantial computational cost saving by focusing the limited resources on training important nodes, while reducing communication overhead via adaptive historical embedding synchronization. The proposed adaptive importance-based sampling method jointly considers the graph structural heterogeneity and the optimization dynamics to achieve optimal trade-off between efficiency and accuracy. Extensive evaluations against five state-of-the-art baselines on five real-world graph datasets show that FedAIS achieves comparable or up to 3.23% higher test accuracy, while saving communication and computation costs by 91.77% and 85.59%.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 27 references that are in the map. First posted on arXiv 23 Sep 2024.

Builds on

16 of 27 references.

References · 16

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Inductive Representation Learning on Large Graphscited by 6,284
  3. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  4. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  5. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  6. 2019GraphSAINT: Graph Sampling Based Inductive Learning Methodcited by 618
  7. 2018FastGCN: Fast Learning with Graph Convolutional Networks via Importance Samplingcited by 583
  8. 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 566
  9. 2019Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networkscited by 540
  10. 2019Bayesian Nonparametric Federated Learning of Neural Networkscited by 385
  11. 2019Layer-Dependent Importance Sampling for Training Deep and Large Graph Convolutional Networkscited by 177
  12. 2021Subgraph Federated Learning with Missing Neighbor Generationcited by 132
4 more
  1. 2021GNNAutoScale: Scalable and Expressive Graph Neural Networks via Historical Embeddingscited by 90
  2. 2020Minimal Variance Sampling with Provable Guarantees for Fast Training of Graph Neural Networkscited by 54
  3. 2022Federated Graph Neural Networks: Overview, Techniques and Challengescited by 52
  4. 2022FedEgo: Privacy-preserving Personalized Federated Graph Learning with Ego-graphscited by 12

Built on by

Not cited yet.