mlsanityData to 14 Oct 2026

FL-GUARD: A Holistic Framework for Run-Time Detection and Recovery of Negative Federated Learning

arXiv 2403.04146 ↗First posted 7 Mar 2024cs.LG cs.AI cs.DCcited by 0

Not on the map. Why?

Abstract (arXiv)

Federated learning (FL) is a promising approach for learning a model from data distributed on massive clients without exposing data privacy. It works effectively in the ideal federation where clients share homogeneous data distribution and learning behavior. However, FL may fail to function appropriately when the federation is not ideal, amid an unhealthy state called Negative Federated Learning (NFL), in which most clients gain no benefit from participating in FL. Many studies have tried to address NFL. However, their solutions either (1) predetermine to prevent NFL in the entire learning life-cycle or (2) tackle NFL in the aftermath of numerous learning rounds. Thus, they either (1) indiscriminately incur extra costs even if FL can perform well without such costs or (2) waste numerous learning rounds. Additionally, none of the previous work takes into account the clients who may be unwilling/unable to follow the proposed NFL solutions when using those solutions to upgrade an FL system in use. This paper introduces FL-GUARD, a holistic framework that can be employed on any FL system for tackling NFL in a run-time paradigm. That is, to dynamically detect NFL at the early stage (tens of rounds) of learning and then to activate recovery measures when necessary. Specifically, we devise a cost-effective NFL detection mechanism, which relies on an estimation of performance gain on clients. Only when NFL is detected, we activate the NFL recovery process, in which each client learns in parallel an adapted model when training the global model. Extensive experiment results confirm the effectiveness of FL-GUARD in detecting NFL and recovering from NFL to a healthy learning state. We also show that FL-GUARD is compatible with previous NFL solutions and robust against clients unwilling/unable to take any recovery measures.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 52 references that are in the map. First posted on arXiv 7 Mar 2024.

Builds on

28 of 52 references.

References · 28

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  2. 2019Advances and Open Problems in Federated Learningcited by 3,046
  3. 2018Federated Optimization in Heterogeneous Networkscited by 2,987
  4. 2020Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimizationcited by 906
  5. 2018LEAF: A Benchmark for Federated Settingscited by 792
  6. 2018How To Backdoor Federated Learningcited by 765
  7. 2018Byzantine-Robust Distributed Learning: Towards Optimal Statistical Ratescited by 711
  8. 2017Federated Multi-Task Learningcited by 672
  9. 2020Ditto: Fair and Robust Federated Learning Through Personalizationcited by 672
  10. 2018Federated Learning for Mobile Keyboard Predictioncited by 572
  11. 2020Federated Learning with Matched Averagingcited by 564
  12. 2021Exploiting Shared Representations for Personalized Federated Learningcited by 541
16 more
  1. 2019Clustered Federated Learning: Model-Agnostic Distributed Multi-Task Optimization under Privacy Constraintscited by 503
  2. 2019Local Model Poisoning Attacks to Byzantine-Robust Federated Learningcited by 493
  3. 2019FedMD: Heterogenous Federated Learning via Model Distillationcited by 459
  4. 2020Adaptive Personalized Federated Learningcited by 358
  5. 2018Analyzing Federated Learning through an Adversarial Lenscited by 351
  6. 2020Three Approaches for Personalization with Applications to Federated Learningcited by 325
  7. 2019A Little Is Enough: Circumventing Defenses For Distributed Learningcited by 288
  8. 2019Improving Federated Learning Personalization via Model Agnostic Meta Learningcited by 269
  9. 2020Federated learning with hierarchical clustering of local updates to improve training on non-IID datacited by 223
  10. 2020Federated Learning of a Mixture of Global and Local Modelscited by 210
  11. 2019FedHealth: A Federated Transfer Learning Framework for Wearable Healthcarecited by 182
  12. 2022FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correctioncited by 181
  13. 2019Federated Evaluation of On-device Personalizationcited by 147
  14. 2020Salvaging Federated Learning by Local Adaptationcited by 142
  15. 2022DisPFL: Towards Communication-Efficient Personalized Federated Learning via Decentralized Sparse Trainingcited by 74
  16. 2019Attack-Resistant Federated Learning with Residual-based Reweightingcited by 40

Built on by

Not cited yet.