# Distributed Deep Reinforcement Learning Based Gradient Quantization for Federated Learning Enabled Vehicle Edge Computing

arXiv: https://arxiv.org/abs/2407.08462 · HTML: https://mlsanity.com/paper/2407.08462/

## Key facts

- Cited by 15 papers in the map (data through 14 Oct 2026).
- Placed in RL for energy, networks and operations, one of 15 directions in Deep reinforcement learning methods.
- Builds on 26 of its 71 references that are in the map.
- First posted on arXiv 11 Jul 2024.

## Placed in

- Deep reinforcement learning methods / [RL for energy, networks and operations](https://mlsanity.com/deeprl/rl-for-energy-networks-and-operations/)

## Builds on (most cited first, 26 of 26)

- [Adaptive Federated Learning in Resource Constrained Edge Computing Systems](https://mlsanity.com/paper/1804.05271/) (2018)
- [Model Pruning Enables Efficient Federated Learning on Edge Devices](https://mlsanity.com/paper/1909.12326/) (2019)
- [Energy Efficient Federated Learning Over Wireless Communication Networks](https://mlsanity.com/paper/1911.02417/) (2019)
- [UVeQFed: Universal Vector Quantization for Federated Learning](https://mlsanity.com/paper/2006.03262/) (2020)
- [Convergence Time Optimization for Federated Learning over Wireless Networks](https://mlsanity.com/paper/2001.07845/) (2020)
- [Adaptive Quantization of Model Updates for Communication-Efficient Federated Learning](https://mlsanity.com/paper/2102.04487/) (2021)
- [Scheduling for Cellular Federated Edge Learning with Importance and Channel Awareness](https://mlsanity.com/paper/2004.00490/) (2020)
- [Multi-Task Federated Learning for Personalised Deep Neural Networks in Edge Computing](https://mlsanity.com/paper/2007.09236/) (2020)
- [DAdaQuant: Doubly-adaptive quantization for communication-efficient Federated Learning](https://mlsanity.com/paper/2111.00465/) (2021)
- [Quantized Federated Learning under Transmission Delay and Outage Constraints](https://mlsanity.com/paper/2106.09397/) (2021)
- [Mobility-Aware Cooperative Caching in Vehicular Edge Computing Based on Asynchronous Federated and Deep Reinforcement Learning](https://mlsanity.com/paper/2208.01219/) (2022)
- [FedAdapt: Adaptive Offloading for IoT Devices in Federated Learning](https://mlsanity.com/paper/2107.04271/) (2021)
- [High stable and accurate vehicle selection scheme based on federated edge learning in vehicular networks](https://mlsanity.com/paper/2208.01890/) (2022)
- [Convergence Analysis and System Design for Federated Learning over Wireless Networks](https://mlsanity.com/paper/2105.00872/) (2021)
- [Generative AI-enabled Vehicular Networks: Fundamentals, Framework, and Case Study](https://mlsanity.com/paper/2304.11098/) (2023)
- [Towards V2I Age-aware Fairness Access: A DQN Based Intelligent Vehicular Node Training and Test Method](https://mlsanity.com/paper/2208.01283/) (2022)
- [Delay-sensitive Task Offloading in Vehicular Fog Computing-Assisted Platoons](https://mlsanity.com/paper/2309.10234/) (2023)
- [URLLC-Awared Resource Allocation for Heterogeneous Vehicular Edge Computing](https://mlsanity.com/paper/2311.18352/) (2023)
- [Fast Federated Learning by Balancing Communication Trade-Offs](https://mlsanity.com/paper/2105.11028/) (2021)
- [Communication-Efficient Federated Learning via Quantized Compressed Sensing](https://mlsanity.com/paper/2111.15071/) (2021)
- [Cooperative Edge Caching Based on Elastic Federated and Multi-Agent Deep Reinforcement Learning in Next-Generation Network](https://mlsanity.com/paper/2401.09886/) (2024)
- [Resource Scheduling in Edge Computing: A Survey](https://mlsanity.com/paper/2108.08059/) (2021)
- [A Swarming Approach to Optimize the One-hop Delay in Smart Driving Inter-platoon Communications](https://mlsanity.com/paper/1807.07301/) (2018)
- [Deep Reinforcement Learning Assisted Federated Learning Algorithm for Data Management of IIoT](https://mlsanity.com/paper/2202.03575/) (2022)
- [Delay Minimization for Federated Learning Over Wireless Communication Networks](https://mlsanity.com/paper/2007.03462/) (2020)
- [Decentralized Power Allocation for MIMO-NOMA Vehicular Edge Computing Based on Deep Reinforcement Learning](https://mlsanity.com/paper/2107.14772/) (2021)

## Built on by (most cited first, 15 of 15)

- [Mobility-Aware Federated Self-supervised Learning in Vehicular Network](https://mlsanity.com/paper/2408.00256/) (2024)
- [DRL-Based Resource Allocation for Motion Blur Resistant Federated Self-Supervised Learning in IoV](https://mlsanity.com/paper/2408.09194/) (2024)
- [DRL-Based Optimization for AoI and Energy Consumption in C-V2X Enabled IoV](https://mlsanity.com/paper/2411.13104/) (2024)
- [Reconfigurable Intelligent Surface Aided Vehicular Edge Computing: Joint Phase-shift Optimization and Multi-User Power Allocation](https://mlsanity.com/paper/2407.13123/) (2024)
- [Semantic-Aware Resource Management for C-V2X Platooning via Multi-Agent Reinforcement Learning](https://mlsanity.com/paper/2411.04672/) (2024)
- [FOVA: Offline Federated Reinforcement Learning with Mixed-Quality Data](https://mlsanity.com/paper/2512.02350/) (2025)
- [A Survey on Semantic Communications in Internet of Vehicles](https://mlsanity.com/paper/2503.03767/) (2025)
- [A Comprehensive Survey on Joint Resource Allocation Strategies in Federated Edge Learning](https://mlsanity.com/paper/2410.07881/) (2024)
- [Blockchain-Enabled Variational Information Bottleneck for Data Extraction Based on Mutual Information in Internet of Vehicles](https://mlsanity.com/paper/2409.17287/) (2024)
- [V2X-Assisted Distributed Computing and Control Framework for Connected and Automated Vehicles under Ramp Merging Scenario](https://mlsanity.com/paper/2410.22987/) (2024)
- [Enhanced SPS Velocity-adaptive Scheme: Access Fairness in 5G NR V2I Networks](https://mlsanity.com/paper/2501.08037/) (2025)
- [HEART: Achieving Timely Multi-Model Training for Vehicle-Edge-Cloud-Integrated Hierarchical Federated Learning](https://mlsanity.com/paper/2501.09934/) (2025)
- [PPO-Based Vehicle Control for Ramp Merging Scheme Assisted by Enhanced C-V2X](https://mlsanity.com/paper/2501.12656/) (2025)
- [Progressive Size-Adaptive Federated Learning: A Comprehensive Framework for Heterogeneous Multi-Modal Data Systems](https://mlsanity.com/paper/2506.20685/) (2025)
- [Accelerating Reinforcement Learning Algorithms Convergence using Pre-trained Large Language Models as Tutors With Advice Reusing](https://mlsanity.com/paper/2509.08329/) (2025)

## Abstract (arXiv)

Federated Learning (FL) can protect the privacy of the vehicles in vehicle edge computing (VEC) to a certain extent through sharing the gradients of vehicles' local models instead of local data. The gradients of vehicles' local models are usually large for the vehicular artificial intelligence (AI) applications, thus transmitting such large gradients would cause large per-round latency. Gradient quantization has been proposed as one effective approach to reduce the per-round latency in FL enabled VEC through compressing gradients and reducing the number of bits, i.e., the quantization level, to transmit gradients. The selection of quantization level and thresholds determines the quantization error, which further affects the model accuracy and training time. To do so, the total training time and quantization error (QE) become two key metrics for the FL enabled VEC. It is critical to jointly optimize the total training time and QE for the FL enabled VEC. However, the time-varying channel condition causes more challenges to solve this problem. In this paper, we propose a distributed deep reinforcement learning (DRL)-based quantization level allocation scheme to optimize the long-term reward in terms of the total training time and QE. Extensive simulations identify the optimal weighted factors between the total training time and QE, and demonstrate the feasibility and effectiveness of the proposed scheme.