# Accelerating DNN Training in Wireless Federated Edge Learning Systems

arXiv: https://arxiv.org/abs/1905.09712 · HTML: https://mlsanity.com/paper/1905.09712/

## Key facts

- Cited by 34 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 23 May 2019.

## Built on by (most cited first, 30 of 34)

- [Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications](https://mlsanity.com/paper/2111.12444/) (2021)
- [Convergence Analysis and System Design for Federated Learning over Wireless Networks](https://mlsanity.com/paper/2105.00872/) (2021)
- [Decentralized Federated Learning for UAV Networks: Architecture, Challenges, and Opportunities](https://mlsanity.com/paper/2104.07557/) (2021)
- [Decentralized Inference with Graph Neural Networks in Wireless Communication Systems](https://mlsanity.com/paper/2104.09027/) (2021)
- [Scalable and Low-Latency Federated Learning with Cooperative Mobile Edge Networking](https://mlsanity.com/paper/2205.13054/) (2022)
- [Trustworthy Federated Learning via Blockchain](https://mlsanity.com/paper/2209.04418/) (2022)
- [A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Services](https://mlsanity.com/paper/2304.14271/) (2023)
- [DYNAMITE: Dynamic Interplay of Mini-Batch Size and Aggregation Frequency for Federated Learning with Static and Streaming Dataset](https://mlsanity.com/paper/2310.14906/) (2023)
- [Efficient Federated Meta-Learning over Multi-Access Wireless Networks](https://mlsanity.com/paper/2108.06453/) (2021)
- [Edge-Native Intelligence for 6G Communications Driven by Federated Learning: A Survey of Trends and Challenges](https://mlsanity.com/paper/2111.07392/) (2021)
- [Federated Learning and Meta Learning: Approaches, Applications, and Directions](https://mlsanity.com/paper/2210.13111/) (2022)
- [Multi-user Co-inference with Batch Processing Capable Edge Server](https://mlsanity.com/paper/2206.06304/) (2022)
- [Wirelessly Powered Federated Edge Learning: Optimal Tradeoffs Between Convergence and Power Transfer](https://mlsanity.com/paper/2102.12357/) (2021)
- [CSAFL: A Clustered Semi-Asynchronous Federated Learning Framework](https://mlsanity.com/paper/2104.08184/) (2021)
- [Resource-constrained Federated Edge Learning with Heterogeneous Data: Formulation and Analysis](https://mlsanity.com/paper/2110.07567/) (2021)
- [Over-the-Air Federated Learning and Optimization](https://mlsanity.com/paper/2310.10089/) (2023)
- [Towards Efficient Synchronous Federated Training: A Survey on System Optimization Strategies](https://mlsanity.com/paper/2109.03999/) (2021)
- [Collaboration in Participant-Centric Federated Learning: A Game-Theoretical Perspective](https://mlsanity.com/paper/2207.12030/) (2022)
- [Federated Learning with Erroneous Communication Links](https://mlsanity.com/paper/2201.12991/) (2022)
- [Joint Optimization of Energy Consumption and Completion Time in Federated Learning](https://mlsanity.com/paper/2209.14900/) (2022)
- [Personalized Federated Learning with Exact Stochastic Gradient Descent](https://mlsanity.com/paper/2202.09848/) (2022)
- [Client Selection for Federated Bayesian Learning](https://mlsanity.com/paper/2212.05492/) (2022)
- [Adaptive Federated Learning via New Entropy Approach](https://mlsanity.com/paper/2303.14966/) (2023)
- [Adaptive and Parallel Split Federated Learning in Vehicular Edge Computing](https://mlsanity.com/paper/2405.18707/) (2024)
- [Latency Minimization for UAV-Enabled Federated Learning: Trajectory Design and Resource Allocation](https://mlsanity.com/paper/2412.07428/) (2024)
- [Adaptive Scheduling for Machine Learning Tasks over Networks](https://mlsanity.com/paper/2101.10007/) (2021)
- [Over-The-Air Federated Learning Over Scalable Cell-free Massive MIMO](https://mlsanity.com/paper/2212.06482/) (2022)
- [Topology Learning for Heterogeneous Decentralized Federated Learning over Unreliable D2D Networks](https://mlsanity.com/paper/2312.13611/) (2023)
- [Optimal Batch-Size Control for Low-Latency Federated Learning with Device Heterogeneity](https://mlsanity.com/paper/2507.15601/) (2025)
- [Accelerating Wireless Federated Learning via Nesterov's Momentum and Distributed Principle Component Analysis](https://mlsanity.com/paper/2303.17885/) (2023)

## Abstract (arXiv)

Training task in classical machine learning models, such as deep neural networks, is generally implemented at a remote cloud center for centralized learning, which is typically time-consuming and resource-hungry. It also incurs serious privacy issue and long communication latency since a large amount of data are transmitted to the centralized node. To overcome these shortcomings, we consider a newly-emerged framework, namely federated edge learning, to aggregate local learning updates at the network edge in lieu of users' raw data. Aiming at accelerating the training process, we first define a novel performance evaluation criterion, called learning efficiency. We then formulate a training acceleration optimization problem in the CPU scenario, where each user device is equipped with CPU. The closed-form expressions for joint batchsize selection and communication resource allocation are developed and some insightful results are highlighted. Further, we extend our learning framework to the GPU scenario. The optimal solution in this scenario is manifested to have the similar structure as that of the CPU scenario, recommending that our proposed algorithm is applicable in more general systems. Finally, extensive experiments validate the theoretical analysis and demonstrate that the proposed algorithm can reduce the training time and improve the learning accuracy simultaneously.
