A Federated Reinforcement Learning Method with Quantization for Cooperative Edge Caching in Fog Radio Access Networks
Not on the map. Why?
Abstract (arXiv)
In this paper, cooperative edge caching problem is studied in fog radio access networks (F-RANs). Given the non-deterministic polynomial hard (NP-hard) property of the problem, a dueling deep Q network (Dueling DQN) based caching update algorithm is proposed to make an optimal caching decision by learning the dynamic network environment. In order to protect user data privacy and solve the problem of slow convergence of the single deep reinforcement learning (DRL) model training, we propose a federated reinforcement learning method with quantization (FRLQ) to implement cooperative training of models from multiple fog access points (F-APs) in F-RANs. To address the excessive consumption of communications resources caused by model transmission, we prune and quantize the shared DRL models to reduce the number of model transfer parameters. The communications interval is increased and the communications rounds are reduced by periodical model global aggregation. We analyze the global convergence and computational complexity of our policy. Simulation results verify that our policy has better performance in reducing user request delay and improving cache hit rate compared to benchmark schemes. The proposed policy is also shown to have faster training speed and higher communications efficiency with minimal loss of model accuracy.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 37 references that are in the map. First posted on arXiv 23 Jun 2022.
Builds on
10 of 37 references.
References · 10
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
- 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,475
- 2015Dueling Network Architectures for Deep Reinforcement Learningcited by 785
- 2019Robust and Communication-Efficient Federated Learning from Non-IID Datacited by 419
- 2019FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantizationcited by 356
- 2019A Joint Learning and Communications Framework for Federated Learning over Wireless Networkscited by 263
- 2013Predicting Parameters in Deep Learningcited by 224
- 2020When Deep Reinforcement Learning Meets Federated Learning: Intelligent Multi-Timescale Resource Management for Multi-access Edge Computing in 5G Ultra Dense Networkcited by 30
- 2017A Comprehensive Survey on Fog Computing: State-of-the-art and Research Challengescited by 7
- 2019Distributed Edge Caching via Reinforcement Learning in Fog Radio Access Networkscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Cooperative Edge Caching Based on Elastic Federated and Multi-Agent Deep Reinforcement Learning in Next-Generation Network
- 2022Content Popularity Prediction Based on Quantized Federated Bayesian Learning in Fog Radio Access Networks
- 2025Communication-Efficient Federated Learning by Quantized Variance Reduction for Heterogeneous Wireless Edge Networks
- 2024Distributed Deep Reinforcement Learning Based Gradient Quantization for Federated Learning Enabled Vehicle Edge Computing
- 2024FedAQ: Communication-Efficient Federated Edge Learning via Joint Uplink and Downlink Adaptive Quantization
- 2024Latency and Energy Minimization in NOMA-Assisted MEC Network: A Federated Deep Reinforcement Learning Approach ↗
- 2025Federated Multi-Agent Reinforcement Learning for Privacy-Preserving and Energy-Aware Resource Management in 6G Edge Networks
- 2022Optimal Privacy Preserving for Federated Learning in Mobile Edge Computing