DynamicFL: Federated Learning with Dynamic Communication Resource Allocation
Not on the map. Why?
Abstract (arXiv)
Federated Learning (FL) is a collaborative machine learning framework that allows multiple users to train models utilizing their local data in a distributed manner. However, considerable statistical heterogeneity in local data across devices often leads to suboptimal model performance compared with independently and identically distributed (IID) data scenarios. In this paper, we introduce DynamicFL, a new FL framework that investigates the trade-offs between global model performance and communication costs for two widely adopted FL methods: Federated Stochastic Gradient Descent (FedSGD) and Federated Averaging (FedAvg). Our approach allocates diverse communication resources to clients based on their data statistical heterogeneity, considering communication resource constraints, and attains substantial performance enhancements compared to uniform communication resource allocation. Notably, our method bridges the gap between FedSGD and FedAvg, providing a flexible framework leveraging communication heterogeneity to address statistical heterogeneity in FL. Through extensive experiments, we demonstrate that DynamicFL surpasses current state-of-the-art methods with up to a 10% increase in model accuracy, demonstrating its adaptability and effectiveness in tackling data statistical heterogeneity challenges.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 50 of its 68 references that are in the map. First posted on arXiv 8 Sep 2024.
Builds on
50 of 68 references.
References · 50
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2016Layer Normalizationcited by 5,579
- 2019Advances and Open Problems in Federated Learningcited by 3,021
- 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,531
- 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,461
- 2019On the Convergence of FedAvg on Non-IID Datacited by 1,220
- 2020Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimizationcited by 897
- 2019Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classificationcited by 836
- 2019Towards Federated Learning at Scale: System Designcited by 826
- 2018LEAF: A Benchmark for Federated Settingscited by 780
38 more
- 2017Federated Multi-Task Learningcited by 669
- 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 566
- 2021Federated Learning Based on Dynamic Regularizationcited by 555
- 2019Federated Learning with Personalization Layerscited by 533
- 2019Federated Learning in Mobile Edge Networks: A Comprehensive Surveycited by 407
- 2019Fair Resource Allocation in Federated Learningcited by 389
- 2021Data-Free Knowledge Distillation for Heterogeneous Federated Learningcited by 380
- 2019FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantizationcited by 349
- 2021Federated Learning on Non-IID Data: A Surveycited by 345
- 2020HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clientscited by 334
- 2019Tighter Theory for Local SGD on Identical and Heterogeneous Datacited by 266
- 2019Asynchronous Federated Optimizationcited by 264
- 2021Federated Learning with Buffered Asynchronous Aggregationcited by 188
- 2022Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learningcited by 172
- 2023Stochastic Controlled Averaging for Federated Learning with Communication Compressioncited by 100
- 2020TiFL: A Tier-based Federated Learning Systemcited by 95
- 2022Layer-wised Model Aggregation for Personalized Federated Learningcited by 95
- 2020From Local SGD to Local Fixed-Point Methods for Federated Learningcited by 74
- 2019Variational Federated Multi-Task Learningcited by 69
- 2020FedAT: A High-Performance and Communication-Efficient Federated Learning System with Asynchronous Tierscited by 64
- 2021SemiFL: Semi-Supervised Federated Learning for Unlabeled Clients with Alternate Trainingcited by 45
- 2020Towards Non-I.I.D. and Invisible Data with FedNAS: Federated Deep Learning via Neural Architecture Searchcited by 30
- 2023Pruning Deep Neural Networks from a Sparsity Perspectivecited by 25
- 2021UAV-assisted Online Machine Learning over Multi-Tiered Networks: A Hierarchical Nested Personalized Federated Learning Approachcited by 20
- 2022Federated Learning Challenges and Opportunities: An Outlookcited by 19
- 2022Self-Aware Personalized Federated Learningcited by 16
- 2021Stragglers Are Not Disaster: A Hybrid Federated Learning Algorithm with Delayed Gradientscited by 13
- 2021SPIDER: Searching Personalized Neural Architecture for Federated Learningcited by 13
- 2021SPATL: Salient Parameter Aggregation and Transfer Learning for Heterogeneous Clients in Federated Learningcited by 11
- 2021Bandwidth Allocation for Multiple Federated Learning Services in Wireless Edge Networkscited by 10
- 2021FedSLD: Federated Learning with Shared Label Distribution for Medical Image Classificationcited by 10
- 2022Auxo: Efficient Federated Learning via Scalable Client Clusteringcited by 8
- 2019Restricted Recurrent Neural Networkscited by 5
- 2018Estimation of the Evolutionary Spectra with Application to Stationarity Testcited by 4
- 2022Personalized Federated Recommender Systems with Private and Partially Federated AutoEncoderscited by 4
- 2016SLANTS: Sequential Adaptive Nonlinear Modeling of Vector Time Seriescited by 2
- 2020Meta Clustering for Collaborative Learningcited by 2
- 2015Key Pre-Distributions From Graph-Based Block Designscited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.