Tackling the Local Bias in Federated Graph Learning
Not on the map. Why?
Abstract (arXiv)
Federated graph learning (FGL) has become an important research topic in response to the increasing scale and the distributed nature of graph-structured data in the real world. In FGL, a global graph is distributed across different clients, where each client holds a subgraph. Existing FGL methods often fail to effectively utilize cross-client edges, losing structural information during the training; additionally, local graphs often exhibit significant distribution divergence. These two issues make local models in FGL less desirable than in centralized graph learning, namely the local bias problem in this paper. To solve this problem, we propose a novel FGL framework to make the local models similar to the model trained in a centralized setting. Specifically, we design a distributed learning scheme, fully leveraging cross-client edges to aggregate information from other clients. In addition, we propose a label-guided sampling approach to alleviate the imbalanced local data and meanwhile, distinctly reduce the training overhead. Extensive experiments demonstrate that local bias can compromise the model performance and slow down the convergence during training. Experimental results also verify that our framework successfully mitigates local bias, achieving better performance than other baselines with lower time and memory overhead.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 22 of its 33 references that are in the map. First posted on arXiv 22 Oct 2021.
Builds on
22 of 33 references.
References · 22
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 993
- 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 881
- 2019Graph Neural Networks for Social Recommendationcited by 714
10 more
- 2019GraphSAINT: Graph Sampling Based Inductive Learning Methodcited by 618
- 2019Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networkscited by 541
- 2020Graph Neural Networks in Recommender Systems: A Surveycited by 494
- 2017Representation Learning on Graphs: Methods and Applicationscited by 457
- 2021Subgraph Federated Learning with Missing Neighbor Generationcited by 132
- 2021Federated Graph Classification over Non-IID Graphscited by 114
- 2020GraphFL: A Federated Learning Framework for Semi-Supervised Node Classification on Graphscited by 64
- 2021Structure-aware Interactive Graph Neural Networks for the Prediction of Protein-Ligand Binding Affinitycited by 60
- 2020Reducing Communication in Graph Neural Network Trainingcited by 50
- 2020Distributed Training of Graph Convolutional Networkscited by 14
Built on by
Citing papers per year: 2024: 1.
1 paper.
- 2024Safety in Graph Machine Learning: Threats and Safeguardscited by 11
- 2024Safety in Graph Machine Learning: Threats and Safeguards17 May 2024