Asynchronous Multi-Server Federated Learning for Geo-Distributed Clients
Not on the map. Why?
Abstract (arXiv)
Federated learning (FL) systems enable multiple clients to train a machine learning model iteratively through synchronously exchanging the intermediate model weights with a single server. The scalability of such FL systems can be limited by two factors: server idle time due to synchronous communication and the risk of a single server becoming the bottleneck. In this paper, we propose a new FL architecture, to our knowledge, the first multi-server FL system that is entirely asynchronous, and therefore addresses these two limitations simultaneously. Our solution keeps both servers and clients continuously active. As in previous multi-server methods, clients interact solely with their nearest server, ensuring efficient update integration into the model. Differently, however, servers also periodically update each other asynchronously, and never postpone interactions with clients. We compare our solution to three representative baselines - FedAvg, FedAsync and HierFAVG - on the MNIST and CIFAR-10 image classification datasets and on the WikiText-2 language modeling dataset. Our solution converges to similar or higher accuracy levels than previous baselines and requires 61% less time to do so in geo-distributed settings.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 38 references that are in the map. First posted on arXiv 3 Jun 2024.
Builds on
21 of 38 references.
References · 21
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2018Federated Optimization in Heterogeneous Networkscited by 2,971
- 2017Federated Multi-Task Learningcited by 669
- 2020The Future of Digital Health with Federated Learningcited by 625
- 2018Federated Learning for Mobile Keyboard Predictioncited by 565
- 2019Asynchronous Federated Optimizationcited by 264
- 2019Client-Edge-Cloud Hierarchical Federated Learningcited by 202
- 2020Multi-site fMRI Analysis Using Privacy-preserving Federated Learning and Domain Adaptation: ABIDE Resultscited by 122
- 2019Hierarchical Federated Learning Across Heterogeneous Cellular Networkscited by 98
- 2021Heterogeneity for the Win: One-Shot Federated Clusteringcited by 87
- 2014Communication-Efficient Distributed Dual Coordinate Ascentcited by 30
- 2022AsyncFedED: Asynchronous Federated Learning with Euclidean Distance based Adaptive Weight Aggregationcited by 19
9 more
- 2018To Cluster, or Not to Cluster: An Analysis of Clusterability Methodscited by 17
- 2022AGIC: Approximate Gradient Inversion Attack on Federated Learningcited by 15
- 2022On the Convergence of Multi-Server Federated Learning with Overlapping Areacited by 8
- 2022Aergia: Leveraging Heterogeneity in Federated Learning Systemscited by 6
- 2022MUDGUARD: Taming Malicious Majorities in Federated Learning using Privacy-Preserving Byzantine-Robust Clusteringcited by 5
- 2016Towards Geo-Distributed Machine Learningcited by 2
- 2024Share Secrets for Privacy: Confidential Forecasting with Vertical Federated Learningcited by 2
- 2013An efficient distributed learning algorithm based on effective local functional approximationscited by 1
- 2022Sky Computing: Accelerating Geo-distributed Computing in Federated Learningcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.