mlsanityData to 14 Oct 2026

Tackling the Local Bias in Federated Graph Learning

arXiv 2110.12906 ↗First posted 22 Oct 2021cs.LG cs.AI cs.CRcited by 1

Not on the map. Why?

Abstract (arXiv)

Federated graph learning (FGL) has become an important research topic in response to the increasing scale and the distributed nature of graph-structured data in the real world. In FGL, a global graph is distributed across different clients, where each client holds a subgraph. Existing FGL methods often fail to effectively utilize cross-client edges, losing structural information during the training; additionally, local graphs often exhibit significant distribution divergence. These two issues make local models in FGL less desirable than in centralized graph learning, namely the local bias problem in this paper. To solve this problem, we propose a novel FGL framework to make the local models similar to the model trained in a centralized setting. Specifically, we design a distributed learning scheme, fully leveraging cross-client edges to aggregate information from other clients. In addition, we propose a label-guided sampling approach to alleviate the imbalanced local data and meanwhile, distinctly reduce the training overhead. Extensive experiments demonstrate that local bias can compromise the model performance and slow down the convergence during training. Experimental results also verify that our framework successfully mitigates local bias, achieving better performance than other baselines with lower time and memory overhead.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 22 of its 33 references that are in the map. First posted on arXiv 22 Oct 2021.

Builds on

22 of 33 references.

References · 22

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  4. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  5. 2017Inductive Representation Learning on Large Graphscited by 6,320
  6. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  7. 2018How Powerful are Graph Neural Networks?cited by 4,393
  8. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  9. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
  10. 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 993
  11. 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 881
  12. 2019Graph Neural Networks for Social Recommendationcited by 714
10 more
  1. 2019GraphSAINT: Graph Sampling Based Inductive Learning Methodcited by 618
  2. 2019Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networkscited by 541
  3. 2020Graph Neural Networks in Recommender Systems: A Surveycited by 494
  4. 2017Representation Learning on Graphs: Methods and Applicationscited by 457
  5. 2021Subgraph Federated Learning with Missing Neighbor Generationcited by 132
  6. 2021Federated Graph Classification over Non-IID Graphscited by 114
  7. 2020GraphFL: A Federated Learning Framework for Semi-Supervised Node Classification on Graphscited by 64
  8. 2021Structure-aware Interactive Graph Neural Networks for the Prediction of Protein-Ligand Binding Affinitycited by 60
  9. 2020Reducing Communication in Graph Neural Network Trainingcited by 50
  10. 2020Distributed Training of Graph Convolutional Networkscited by 14

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.