# On the Convergence of Multi-Server Federated Learning with Overlapping Area

arXiv: https://arxiv.org/abs/2208.07893 · HTML: https://mlsanity.com/paper/2208.07893/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 16 Aug 2022.

## Built on by (most cited first, 8 of 8)

- [Text-driven Prompt Generation for Vision-Language Models in Federated Learning](https://mlsanity.com/paper/2310.06123/) (2023)
- [Conflict-Aware Client Selection for Multi-Server Federated Learning](https://mlsanity.com/paper/2602.02458/) (2026)
- [BlockFUL: Enabling Unlearning in Blockchained Federated Learning](https://mlsanity.com/paper/2402.16294/) (2024)
- [Asynchronous Multi-Server Federated Learning for Geo-Distributed Clients](https://mlsanity.com/paper/2406.01439/) (2024)
- [FedGCA: Global Consistent Augmentation Based Single-Source Federated Domain Generalization](https://mlsanity.com/paper/2409.14671/) (2024)
- [Controlled privacy leakage propagation throughout overlapping grouped learning](https://mlsanity.com/paper/2503.04054/) (2025)
- [FedOC: Multi-Server FL with Overlapping Client Relays in Wireless Edge Networks](https://mlsanity.com/paper/2509.19398/) (2025)
- [SGFusion: Stochastic Geographic Gradient Fusion in Federated Learning](https://mlsanity.com/paper/2510.23455/) (2025)

## Abstract (arXiv)

Multi-server Federated learning (FL) has been considered as a promising solution to address the limited communication resource problem of single-server FL. We consider a typical multi-server FL architecture, where the coverage areas of regional servers may overlap. The key point of this architecture is that the clients located in the overlapping areas update their local models based on the average model of all accessible regional models, which enables indirect model sharing among different regional servers. Due to the complicated network topology, the convergence analysis is much more challenging than single-server FL. In this paper, we firstly propose a novel MS-FedAvg algorithm for this multi-server FL architecture and analyze its convergence on non-iid datasets for general non-convex settings. Since the number of clients located in each regional server is much less than in single-server FL, the bandwidth of each client should be large enough to successfully communicate training models with the server, which indicates that full client participation can work in multi-server FL. Also, we provide the convergence analysis of the partial client participation scheme and develop a new biased partial participation strategy to further accelerate convergence. Our results indicate that the convergence results highly depend on the ratio of the number of clients in each area type to the total number of clients in all three strategies. The extensive experiments show remarkable performance and support our theoretical results.