Adaptive Deadline and Batch Layered Synchronized Federated Learning
Not on the map. Why?
Abstract (arXiv)
Federated learning (FL) enables collaborative model training across distributed edge devices while preserving data privacy, and typically operates in a round-based synchronous manner. However, synchronous FL suffers from latency bottlenecks due to device heterogeneity, where slower clients (stragglers) delay or degrade global updates. Prior solutions, such as fixed deadlines, client selection, and layer-wise partial aggregation, alleviate the effect of stragglers, but treat round timing and local workload as static parameters, limiting their effectiveness under strict time constraints. We propose ADEL-FL, a novel framework that jointly optimizes per-round deadlines and user-specific batch sizes for layer-wise aggregation. Our approach formulates a constrained optimization problem minimizing the expected L2 distance to the global optimum under total training time and global rounds. We provide a convergence analysis under exponential compute models and prove that ADEL-FL yields unbiased updates with bounded variance. Extensive experiments demonstrate that ADEL-FL outperforms alternative methods in both convergence rate and final accuracy under heterogeneous conditions.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 36 of its 58 references that are in the map. First posted on arXiv 29 May 2025.
Builds on
36 of 58 references.
References · 36
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2018Federated Optimization in Heterogeneous Networkscited by 2,971
- 2019On the Convergence of FedAvg on Non-IID Datacited by 1,220
- 2018Federated Learning with Non-IID Datacited by 1,099
- 2019Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classificationcited by 836
- 2019Towards Federated Learning at Scale: System Designcited by 826
- 2018Local SGD Converges Fast and Communicates Littlecited by 595
- 2017Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Trainingcited by 471
- 2018Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edgecited by 347
- 2020HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clientscited by 334
- 2019Asynchronous Federated Optimizationcited by 264
24 more
- 2017TernGrad: Ternary Gradients to Reduce Communication in Distributed Deep Learningcited by 253
- 2017Sparse Communication for Distributed Gradient Descentcited by 243
- 2018The Convergence of Sparsified Gradient Methodscited by 228
- 2021Federated Learning with Buffered Asynchronous Aggregationcited by 188
- 2017Revisiting Distributed Synchronous SGDcited by 142
- 2020UVeQFed: Universal Vector Quantization for Federated Learningcited by 103
- 2021Asynchronous Federated Learning on Heterogeneous Devices: A Surveycited by 93
- 2020Adaptive Gradient Sparsification for Efficient Federated Learning: An Online Learning Approachcited by 80
- 2015Speeding Up Distributed Machine Learning Using Codescited by 76
- 2018Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGDcited by 68
- 2020Fast-Convergent Federated Learning with Adaptive Weightingcited by 67
- 2019Understanding Top-k Sparsification in Distributed Deep Learningcited by 56
- 2021Federated Learning: A Signal Processing Perspectivecited by 49
- 2019Device Scheduling with Fast Convergence for Wireless Federated Learningcited by 46
- 2023Federated Learning for Computationally-Constrained Heterogeneous Devices: A Surveycited by 40
- 2018Toward Understanding the Impact of Staleness in Distributed Machine Learningcited by 28
- 2023TimelyFL: Heterogeneity-aware Asynchronous Federated Learning with Adaptive Partial Trainingcited by 27
- 2022Scheduling and Aggregation Design for Asynchronous Federated Learning over Wireless Networkscited by 20
- 2022A General Theory for Federated Optimization with Asynchronous and Heterogeneous Clients Updatescited by 17
- 2020Delay Minimization for Federated Learning Over Wireless Communication Networkscited by 12
- 2021A Survey on Federated Learning and its Applications for Accelerating Industrial Internet of Thingscited by 11
- 2023Efficient Asynchronous Federated Learning with Sparsification and Quantizationcited by 9
- 2024Stragglers-Aware Low-Latency Synchronous Federated Learning via Layer-Wise Model Updatescited by 4
- 2022Stream Iterative Distributed Coded Computing for Learning Applications in Heterogeneous Systemscited by 3
Built on by
Citing papers per year: 2025: 1.
1 paper.