mlsanityData to 14 Oct 2026

AQUILA: Communication Efficient Federated Learning with Adaptive Quantization in Device Selection Strategy

arXiv 2308.00258 ↗First posted 1 Aug 2023cs.LG cs.DCcited by 7

Not on the map. Why?

Abstract (arXiv)

The widespread adoption of Federated Learning (FL), a privacy-preserving distributed learning methodology, has been impeded by the challenge of high communication overheads, typically arising from the transmission of large-scale models. Existing adaptive quantization methods, designed to mitigate these overheads, operate under the impractical assumption of uniform device participation in every training round. Additionally, these methods are limited in their adaptability due to the necessity of manual quantization level selection and often overlook biases inherent in local devices' data, thereby affecting the robustness of the global model. In response, this paper introduces AQUILA (adaptive quantization in device selection strategy), a novel adaptive framework devised to effectively handle these issues, enhancing the efficiency and robustness of FL. AQUILA integrates a sophisticated device selection method that prioritizes the quality and usefulness of device updates. Utilizing the exact global model stored by devices, it enables a more precise device selection criterion, reduces model deviation, and limits the need for hyperparameter adjustments. Furthermore, AQUILA presents an innovative quantization criterion, optimized to improve communication efficiency while assuring model convergence. Our experiments demonstrate that AQUILA significantly decreases communication costs compared to existing methods, while maintaining comparable model performance across diverse non-homogeneous FL settings, such as Non-IID data and heterogeneous model architectures.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 22 of its 38 references that are in the map. First posted on arXiv 1 Aug 2023.

Builds on

22 of 38 references.

References · 22

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  5. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  6. 2016Pointer Sentinel Mixture Modelscited by 3,096
  7. 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 815
  8. 2018Federated Learning for Mobile Keyboard Predictioncited by 572
  9. 2018signSGD: Compressed Optimisation for Non-Convex Problemscited by 571
  10. 2019FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantizationcited by 356
  11. 2020HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clientscited by 337
  12. 2020Client Selection in Federated Learning: Convergence Analysis and Power-of-Choice Selection Strategiescited by 198
10 more
  1. 2020FedVision: An Online Visual Object Detection Platform Powered by Federated Learningcited by 124
  2. 2020UVeQFed: Universal Vector Quantization for Federated Learningcited by 107
  3. 2018LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed Learningcited by 96
  4. 2021MARINA: Faster Non-Convex Distributed Learning with Compressioncited by 78
  5. 2021Adaptive Quantization of Model Updates for Communication-Efficient Federated Learningcited by 63
  6. 2021DAdaQuant: Doubly-adaptive quantization for communication-efficient Federated Learningcited by 41
  7. 2021FedDQ: Communication-Efficient Federated Learning with Descending Quantizationcited by 20
  8. 2020Adaptive Federated Learning With Gradient Compression in Uplink NOMAcited by 19
  9. 2022Communication-Efficient Federated Learning for Heterogeneous Edge Devices Based on Adaptive Gradient Quantizationcited by 14
  10. 2021Communication Efficient Federated Learning with Adaptive Quantizationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 2; 2025: 3; 2026: 1.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Quantization in Federated Learning: Methods, Challenges and Future Directions
  2. 2026Enhanced Privacy and Communication Efficiency in Non-IID Federated Learning with Adaptive Quantization and Differential Privacy
  3. 2026Communication-Efficient and Privacy-Adaptable Mechanism -- a Federated Learning Scheme with Convergence Analysis
  4. 2021Federated Learning with Downlink Device Selection
  5. 2024FedAQ: Communication-Efficient Federated Edge Learning via Joint Uplink and Downlink Adaptive Quantization
  6. 2025Enhancing Communication Efficiency in FL with Adaptive Gradient Quantization and Communication Frequency Optimization
  7. 2024A SER-based Device Selection Mechanism in Multi-bits Quantization Federated Learning
  8. 2022Quantization Robust Federated Learning for Efficient Inference on Heterogeneous Devices