mlsanityData to 7 Oct 2026

FedAVO: Improving Communication Efficiency in Federated Learning with African Vultures Optimizer

arXiv 2305.01154 ↗First posted 2 May 2023cs.LG cs.DCcited by 2

Not on the map. Why?

Abstract (arXiv)

Federated Learning (FL), a distributed machine learning technique has recently experienced tremendous growth in popularity due to its emphasis on user data privacy. However, the distributed computations of FL can result in constrained communication and drawn-out learning processes, necessitating the client-server communication cost optimization. The ratio of chosen clients and the quantity of local training passes are two hyperparameters that have a significant impact on FL performance. Due to different training preferences across various applications, it can be difficult for FL practitioners to manually select such hyperparameters. In our research paper, we introduce FedAVO, a novel FL algorithm that enhances communication effectiveness by selecting the best hyperparameters leveraging the African Vulture Optimizer (AVO). Our research demonstrates that the communication costs associated with FL operations can be substantially reduced by adopting AVO for FL hyperparameter adjustment. Through extensive evaluations of FedAVO on benchmark datasets, we show that FedAVO achieves significant improvement in terms of model accuracy and communication round, particularly with realistic cases of Non-IID datasets. Our extensive evaluation of the FedAVO algorithm identifies the optimal hyperparameters that are appropriately fitted for the benchmark datasets, eventually increasing global model accuracy by 6% in comparison to the state-of-the-art FL algorithms (such as FedAvg, FedProx, FedPSO, etc.).

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 34 of its 75 references that are in the map. First posted on arXiv 2 May 2023.

Builds on

34 of 75 references.

References · 34

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  2. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
  3. 2019Advances and Open Problems in Federated Learningcited by 3,021
  4. 2018Federated Optimization in Heterogeneous Networkscited by 2,971
  5. 2020Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimizationcited by 897
  6. 2021Model-Contrastive Federated Learningcited by 762
  7. 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 688
  8. 2020Ensemble Distillation for Robust Model Fusion in Federated Learningcited by 678
  9. 2020Federated Learning with Matched Averagingcited by 564
  10. 2016Federated Optimization: Distributed Machine Learning for On-Device Intelligencecited by 558
  11. 2019FedMD: Heterogenous Federated Learning via Model Distillationcited by 454
  12. 2019Fair Resource Allocation in Federated Learningcited by 389
22 more
  1. 2021Data-Free Knowledge Distillation for Heterogeneous Federated Learningcited by 380
  2. 2015Gradient-based Hyperparameter Optimization through Reversible Learningcited by 357
  3. 2018Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edgecited by 347
  4. 2017Forward and Reverse Gradient-Based Hyperparameter Optimizationcited by 232
  5. 2015Federated Optimization:Distributed Optimization Beyond the Datacentercited by 193
  6. 2019Qsparse-local-SGD: Distributed SGD with Quantization, Sparsification, and Local Computationscited by 179
  7. 2020Mime: Mimicking Centralized Stochastic Algorithms in Federated Learningcited by 152
  8. 2016Fast Bayesian Optimization of Machine Learning Hyperparameters on Large Datasetscited by 131
  9. 2020Client Selection and Bandwidth Allocation in Wireless Federated Learning Networks: A Long-Term Perspectivecited by 102
  10. 2020Robust Federated Learning: The Case of Affine Distribution Shiftscited by 102
  11. 2021Federated Evaluation and Tuning for On-Device Personalization: System Design & Applicationscited by 84
  12. 2020FedDANE: A Federated Newton-Type Methodcited by 76
  13. 2021Federated Hyperparameter Tuning: Challenges, Baselines, and Connections to Weight-Sharingcited by 58
  14. 2021Device Sampling for Heterogeneous Federated Learning: Theory, Algorithms, and Implementationcited by 40
  15. 2014Fractional Max-Poolingcited by 35
  16. 2022Federated Learning for Healthcare Domain - Pipeline, Applications and Challengescited by 34
  17. 2021FedAR: Activity and Resource-Aware Federated Learning Model for Distributed Mobile Robotscited by 18
  18. 2021FLoRA: Single-shot Hyper-parameter Optimization for Federated Learningcited by 14
  19. 2020FedCD: Improving Performance in non-IID Federated Learningcited by 13
  20. 2020Efficient Hyperparameter Optimization in Deep Learning Using a Variable Length Genetic Algorithmcited by 13
  21. 2020Privacy-Preserving Technology to Help Millions of People: Federated Prediction Model for Stroke Preventioncited by 11
  22. 2021Privacy attacks for automatic speech recognition acoustic models in a federated learning frameworkcited by 10

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.