mlsanityData to 7 Oct 2026

Adaptive Deadline and Batch Layered Synchronized Federated Learning

arXiv 2505.23973 ↗First posted 29 May 2025cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Federated learning (FL) enables collaborative model training across distributed edge devices while preserving data privacy, and typically operates in a round-based synchronous manner. However, synchronous FL suffers from latency bottlenecks due to device heterogeneity, where slower clients (stragglers) delay or degrade global updates. Prior solutions, such as fixed deadlines, client selection, and layer-wise partial aggregation, alleviate the effect of stragglers, but treat round timing and local workload as static parameters, limiting their effectiveness under strict time constraints. We propose ADEL-FL, a novel framework that jointly optimizes per-round deadlines and user-specific batch sizes for layer-wise aggregation. Our approach formulates a constrained optimization problem minimizing the expected L2 distance to the global optimum under total training time and global rounds. We provide a convergence analysis under exponential compute models and prove that ADEL-FL yields unbiased updates with bounded variance. Extensive experiments demonstrate that ADEL-FL outperforms alternative methods in both convergence rate and final accuracy under heterogeneous conditions.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 36 of its 58 references that are in the map. First posted on arXiv 29 May 2025.

Builds on

36 of 58 references.

References · 36

  1. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  2. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  3. 2018Federated Optimization in Heterogeneous Networkscited by 2,971
  4. 2019On the Convergence of FedAvg on Non-IID Datacited by 1,220
  5. 2018Federated Learning with Non-IID Datacited by 1,099
  6. 2019Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classificationcited by 836
  7. 2019Towards Federated Learning at Scale: System Designcited by 826
  8. 2018Local SGD Converges Fast and Communicates Littlecited by 595
  9. 2017Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Trainingcited by 471
  10. 2018Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edgecited by 347
  11. 2020HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clientscited by 334
  12. 2019Asynchronous Federated Optimizationcited by 264
24 more
  1. 2017TernGrad: Ternary Gradients to Reduce Communication in Distributed Deep Learningcited by 253
  2. 2017Sparse Communication for Distributed Gradient Descentcited by 243
  3. 2018The Convergence of Sparsified Gradient Methodscited by 228
  4. 2021Federated Learning with Buffered Asynchronous Aggregationcited by 188
  5. 2017Revisiting Distributed Synchronous SGDcited by 142
  6. 2020UVeQFed: Universal Vector Quantization for Federated Learningcited by 103
  7. 2021Asynchronous Federated Learning on Heterogeneous Devices: A Surveycited by 93
  8. 2020Adaptive Gradient Sparsification for Efficient Federated Learning: An Online Learning Approachcited by 80
  9. 2015Speeding Up Distributed Machine Learning Using Codescited by 76
  10. 2018Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGDcited by 68
  11. 2020Fast-Convergent Federated Learning with Adaptive Weightingcited by 67
  12. 2019Understanding Top-k Sparsification in Distributed Deep Learningcited by 56
  13. 2021Federated Learning: A Signal Processing Perspectivecited by 49
  14. 2019Device Scheduling with Fast Convergence for Wireless Federated Learningcited by 46
  15. 2023Federated Learning for Computationally-Constrained Heterogeneous Devices: A Surveycited by 40
  16. 2018Toward Understanding the Impact of Staleness in Distributed Machine Learningcited by 28
  17. 2023TimelyFL: Heterogeneity-aware Asynchronous Federated Learning with Adaptive Partial Trainingcited by 27
  18. 2022Scheduling and Aggregation Design for Asynchronous Federated Learning over Wireless Networkscited by 20
  19. 2022A General Theory for Federated Optimization with Asynchronous and Heterogeneous Clients Updatescited by 17
  20. 2020Delay Minimization for Federated Learning Over Wireless Communication Networkscited by 12
  21. 2021A Survey on Federated Learning and its Applications for Accelerating Industrial Internet of Thingscited by 11
  22. 2023Efficient Asynchronous Federated Learning with Sparsification and Quantizationcited by 9
  23. 2024Stragglers-Aware Low-Latency Synchronous Federated Learning via Layer-Wise Model Updatescited by 4
  24. 2022Stream Iterative Distributed Coded Computing for Learning Applications in Heterogeneous Systemscited by 3

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.