mlsanityData to 7 Oct 2026

FedGrAINS: Personalized SubGraph Federated Learning with Adaptive Neighbor Sampling

arXiv 2501.12592 ↗First posted 22 Jan 2025cs.LG cs.AI cs.DCcited by 1

Not on the map. Why?

Abstract (arXiv)

Graphs are crucial for modeling relational and biological data. As datasets grow larger in real-world scenarios, the risk of exposing sensitive information increases, making privacy-preserving training methods like federated learning (FL) essential to ensure data security and compliance with privacy regulations. Recently proposed personalized subgraph FL methods have become the de-facto standard for training personalized Graph Neural Networks (GNNs) in a federated manner while dealing with the missing links across clients' subgraphs due to privacy restrictions. However, personalized subgraph FL faces significant challenges due to the heterogeneity in client subgraphs, such as degree distributions among the nodes, which complicate federated training of graph models. To address these challenges, we propose textitFedGrAINS, a novel data-adaptive and sampling-based regularization method for subgraph FL. FedGrAINS leverages generative flow networks (GFlowNets) to evaluate node importance concerning clients' tasks, dynamically adjusting the message-passing step in clients' GNNs. This adaptation reflects task-optimized sampling aligned with a trajectory balance objective. Experimental results demonstrate that the inclusion of textitFedGrAINS as a regularizer consistently improves the FL performance compared to baselines that do not leverage such regularization.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 38 of its 59 references that are in the map. First posted on arXiv 22 Jan 2025.

Builds on

38 of 59 references.

References · 38

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  3. 2017Inductive Representation Learning on Large Graphscited by 6,284
  4. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  5. 2018Federated Optimization in Heterogeneous Networkscited by 2,971
  6. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  7. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  8. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
  9. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
  10. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  11. 2015Image-based Recommendations on Styles and Substitutescited by 702
  12. 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 679
26 more
  1. 2019Federated Learning with Personalization Layerscited by 533
  2. 2019Clustered Federated Learning: Model-Agnostic Distributed Multi-Task Optimization under Privacy Constraintscited by 499
  3. 2021Flow Network based Generative Models for Non-Iterative Diverse Candidate Generationcited by 384
  4. 2019A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protectioncited by 371
  5. 2021GFlowNet Foundationscited by 286
  6. 2022Trajectory balance: Improved credit assignment in GFlowNetscited by 244
  7. 2019Stochastic Beams and Where to Find Them: The Gumbel-Top-k Trick for Sampling Sequences Without Replacementcited by 205
  8. 2021FjORD: Fair and Accurate Federated Learning under heterogeneous targets with Ordered Dropoutcited by 192
  9. 2021Subgraph Federated Learning with Missing Neighbor Generationcited by 132
  10. 2021Accurate Learning of Graph Representations with Graph Multiset Poolingcited by 120
  11. 2021Federated Graph Classification over Non-IID Graphscited by 113
  12. 2022GFlowNets and variational inferencecited by 103
  13. 2022Federated Learning on Non-IID Graphs via Structural Knowledge Sharingcited by 88
  14. 2021A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learningcited by 82
  15. 2020Bayesian Graph Neural Networks with Adaptive Connection Samplingcited by 81
  16. 2019Reparameterizable Subset Sampling via Continuous Relaxationscited by 69
  17. 2022Personalized Subgraph Federated Learningcited by 54
  18. 2022Generative Augmented Flow Networkscited by 48
  19. 2022FederatedScope-GNN: Towards a Unified, Comprehensive and Efficient Package for Federated Graph Learningcited by 43
  20. 2021Edge Representation Learning with Hypergraphscited by 37
  21. 2021FedGraph: Federated Graph Learning with Intelligent Samplingcited by 34
  22. 2022SIMPLE: A Gradient Estimator for k-Subset Samplingcited by 34
  23. 2021SpreadGNN: Serverless Multi-task Federated Learning for Graph Neural Networkscited by 30
  24. 2022DropMessage: Unifying Random Dropping for Graph Neural Networkscited by 29
  25. 2023FedAIoT: A Federated Learning Benchmark for Artificial Intelligence of Thingscited by 8
  26. 2023Less Can Be More: Unsupervised Graph Pruning for Large-scale Dynamic Graphscited by 7

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.