mlsanityData to 14 Oct 2026

Generative AI-Powered Plugin for Robust Federated Learning in Heterogeneous IoT Networks

arXiv 2410.23824 ↗First posted 31 Oct 2024cs.LG eess.SPcited by 0

Not on the map. Why?

Abstract (arXiv)

Federated learning enables edge devices to collaboratively train a global model while maintaining data privacy by keeping data localized. However, the Non-IID nature of data distribution across devices often hinders model convergence and reduces performance. In this paper, we propose a novel plugin for federated optimization methods that approximates Non-IID data distributions to IID through generative AI-enhanced data augmentation and balanced sampling strategy. The key idea is to synthesize additional data for underrepresented classes on each edge device, leveraging generative AI to create a more balanced dataset across the FL network. Additionally, a balanced sampling approach at the central server selectively includes only the most IID-like devices, accelerating convergence while maximizing the global model's performance. Experimental results validate that our approach significantly improves convergence speed and robustness against data imbalance, establishing a flexible, privacy-preserving FL plugin that is applicable even in data-scarce environments.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 31 references that are in the map. First posted on arXiv 31 Oct 2024.

Builds on

20 of 31 references.

References · 20

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  4. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  5. 2019Advances and Open Problems in Federated Learningcited by 3,046
  6. 2018Federated Optimization in Heterogeneous Networkscited by 2,987
  7. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  8. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  9. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  10. 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,538
  11. 2019On the Convergence of FedAvg on Non-IID Datacited by 1,229
  12. 2018Federated Learning with Non-IID Datacited by 1,108
8 more
  1. 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
  2. 2019Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classificationcited by 851
  3. 2020Federated Learning for Internet of Things: Recent Advances, Taxonomy, and Open Challengescited by 139
  4. 2017On the convergence properties of a K-step averaging stochastic gradient descent algorithm for nonconvex optimizationcited by 92
  5. 2022Evaluating Unsupervised Text Classification: Zero-shot and Similarity-based Approachescited by 39
  6. 2022Federated Learning Challenges and Opportunities: An Outlookcited by 19
  7. 2022Fast-Convergent Federated Learning via Cyclic Aggregationcited by 6
  8. 2022Security-Preserving Federated Learning via Byzantine-Sensitive Triplet Distancecited by 5

Built on by

Not cited yet.