Towards Fast and Accurate Federated Learning with non-IID Data for Cloud-Based IoT Applications
Not on the map. Why?
Abstract (arXiv)
As a promising method of central model training on decentralized device data while securing user privacy, Federated Learning (FL)is becoming popular in Internet of Things (IoT) design. However, when the data collected by IoT devices are highly skewed in a non-independent and identically distributed (non-IID) manner, the accuracy of vanilla FL method cannot be guaranteed. Although there exist various solutions that try to address the bottleneck of FL with non-IID data, most of them suffer from extra intolerable communication overhead and low model accuracy. To enable fast and accurate FL, this paper proposes a novel data-based device grouping approach that can effectively reduce the disadvantages of weight divergence during the training of non-IID data. However, since our grouping method is based on the similarity of extracted feature maps from IoT devices, it may incur additional risks of privacy exposure. To solve this problem, we propose an improved version by exploiting similarity information using the Locality-Sensitive Hashing (LSH) algorithm without exposing extracted feature maps. Comprehensive experimental results on well-known benchmarks show that our approach can not only accelerate the convergence rate, but also improve the prediction accuracy for FL with non-IID data.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 36 references that are in the map. First posted on arXiv 29 Jan 2022.
Builds on
13 of 36 references.
References · 13
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2018Federated Optimization in Heterogeneous Networkscited by 2,987
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2018Federated Learning with Non-IID Datacited by 1,108
- 2019Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classificationcited by 851
- 2019Towards Federated Learning at Scale: System Designcited by 832
- 2019Agnostic Federated Learningcited by 456
- 2019Robust and Communication-Efficient Federated Learning from Non-IID Datacited by 419
- 2018Analyzing Federated Learning through an Adversarial Lenscited by 351
- 2019A Joint Learning and Communications Framework for Federated Learning over Wireless Networkscited by 263
- 2020Federated learning with hierarchical clustering of local updates to improve training on non-IID datacited by 223
- 2020FedDANE: A Federated Newton-Type Methodcited by 76
1 more
- 2020Wireless Communications for Collaborative Federated Learningcited by 47
Built on by
Citing papers per year: 2025: 1.
1 paper.