FLIPS: Federated Learning using Intelligent Participant Selection
Not on the map. Why?
Abstract (arXiv)
This paper presents the design and implementation of FLIPS, a middleware system to manage data and participant heterogeneity in federated learning (FL) training workloads. In particular, we examine the benefits of label distribution clustering on participant selection in federated learning. FLIPS clusters parties involved in an FL training job based on the label distribution of their data apriori, and during FL training, ensures that each cluster is equitably represented in the participants selected. FLIPS can support the most common FL algorithms, including FedAvg, FedProx, FedDyn, FedOpt and FedYogi. To manage platform heterogeneity and dynamic resource availability, FLIPS incorporates a straggler management mechanism to handle changing capacities in distributed, smart community applications. Privacy of label distributions, clustering and participant selection is ensured through a trusted execution environment (TEE). Our comprehensive empirical evaluation compares FLIPS with random participant selection, as well as three other "smart" selection mechanisms - Oort, TiFL and gradient clustering using two real-world datasets, two benchmark datasets, two different non-IID distributions and three common FL algorithms (FedYogi, FedProx and FedAvg). We demonstrate that FLIPS significantly improves convergence, achieving higher accuracy by 17 - 20 % with 20 - 60 % lower communication costs, and these benefits endure in the presence of straggler participants.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 54 of its 101 references that are in the map. First posted on arXiv 7 Aug 2023.
Builds on
54 of 101 references.
References · 54
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2019Advances and Open Problems in Federated Learningcited by 3,046
- 2018Federated Optimization in Heterogeneous Networkscited by 2,987
- 2016Deep Learning with Differential Privacycited by 2,728
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2020Adaptive Federated Optimizationcited by 1,046
- 2019Deep Leakage from Gradientscited by 1,021
- 2019Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classificationcited by 851
- 2019Towards Federated Learning at Scale: System Designcited by 832
38 more
- 2018LEAF: A Benchmark for Federated Settingscited by 792
- 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 712
- 2018Byzantine-Robust Distributed Learning: Towards Optimal Statistical Ratescited by 711
- 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 669
- 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 568
- 2020Federated Learning with Matched Averagingcited by 564
- 2021Federated Learning Based on Dynamic Regularizationcited by 562
- 2020An Efficient Framework for Clustered Federated Learningcited by 511
- 2021Towards Personalized Federated Learningcited by 464
- 2019Bayesian Nonparametric Federated Learning of Neural Networkscited by 387
- 2020iDLG: Improved Deep Leakage from Gradientscited by 382
- 2018Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edgecited by 352
- 2021See through Gradients: Image Batch Recovery via GradInversioncited by 326
- 2021Membership Inference Attacks on Machine Learning: A Surveycited by 321
- 2021A Field Guide to Federated Optimizationcited by 315
- 2017EMNIST: an extension of MNIST to handwritten letterscited by 213
- 2018A Hybrid Approach to Privacy-Preserving Federated Learningcited by 210
- 2020Client Selection in Federated Learning: Convergence Analysis and Power-of-Choice Selection Strategiescited by 198
- 2022FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correctioncited by 181
- 2020Mime: Mimicking Centralized Stochastic Algorithms in Federated Learningcited by 154
- 2020Learning from History for Byzantine Robust Optimizationcited by 137
- 2020Byzantine-Robust Learning on Heterogeneous Datasets via Bucketingcited by 128
- 2020A Principled Approach to Data Valuation for Federated Learningcited by 127
- 2020TiFL: A Tier-based Federated Learning Systemcited by 96
- 2021Clustered Sampling: Low-Variance and Improved Representativity for Clients Selection in Federated Learningcited by 93
- 2021Papaya: Practical, Private, and Scalable Federated Learningcited by 90
- 2020FedAT: A High-Performance and Communication-Efficient Federated Learning System with Asynchronous Tierscited by 64
- 2020An Efficiency-boosting Client Selection Scheme for Federated Learning with Fairness Guaranteecited by 62
- 2020IBM Federated Learning: an Enterprise Framework White Paper V0.1cited by 57
- 2020Straggler-Resilient Federated Learning: Leveraging the Interplay Between Statistical Accuracy and System Heterogeneitycited by 56
- 2019HybridAlpha: An Efficient Approach for Privacy-Preserving Federated Learningcited by 51
- 2022Fed-CBS: A Heterogeneity-Aware Client Sampling Mechanism for Federated Learning via Class-Imbalance Reductioncited by 32
- 2021RoFL: Robustness of Secure Federated Learningcited by 25
- 2021CodedPaddedFL and CodedSecAgg: Straggler Mitigation and Secure Aggregation in Federated Learningcited by 20
- 2023Delving into the Adversarial Robustness of Federated Learningcited by 19
- 2022Adaptive Aggregation For Federated Learningcited by 10
- 2021SoK: Fully Homomorphic Encryption Compilerscited by 9
- 2020MYSTIKO : : Cloud-Mediated, Private, Federated Gradient Descentcited by 6
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.