mlsanityData to 7 Oct 2026

A Survey on Vulnerability of Federated Learning: A Learning Algorithm Perspective

arXiv 2311.16065 ↗First posted 27 Nov 2023cs.LG cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

This review paper takes a comprehensive look at malicious attacks against FL, categorizing them from new perspectives on attack origins and targets, and providing insights into their methodology and impact. In this survey, we focus on threat models targeting the learning process of FL systems. Based on the source and target of the attack, we categorize existing threat models into four types, Data to Model (D2M), Model to Data (M2D), Model to Model (M2M) and composite attacks. For each attack type, we discuss the defense strategies proposed, highlighting their effectiveness, assumptions and potential areas for improvement. Defense strategies have evolved from using a singular metric to excluding malicious clients, to employing a multifaceted approach examining client models at various phases. In this survey paper, our research indicates that the to-learn data, the learning gradients, and the learned model at different stages all can be manipulated to initiate malicious attacks that range from undermining model performance, reconstructing private local data, and to inserting backdoors. We have also seen these threat are becoming more insidious. While earlier studies typically amplified malicious gradients, recent endeavors subtly alter the least significant weights in local models to bypass defense measures. This literature review provides a holistic understanding of the current FL threat landscape and highlights the importance of developing robust, efficient, and privacy-preserving defenses to ensure the safe and trusted adoption of FL in real-world applications.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 107 of its 150 references that are in the map. First posted on arXiv 27 Nov 2023.

Builds on

107 of 150 references.

References · 107

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  8. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
  9. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  10. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  11. 2019Advances and Open Problems in Federated Learningcited by 3,021
  12. 2017Prototypical Networks for Few-shot Learningcited by 3,001
38 more
  1. 2018Federated Optimization in Heterogeneous Networkscited by 2,971
  2. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
  3. 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,461
  4. 2019On the Convergence of FedAvg on Non-IID Datacited by 1,220
  5. 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
  6. 2019Deep Leakage from Gradientscited by 1,004
  7. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
  8. 2018How To Backdoor Federated Learningcited by 745
  9. 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 707
  10. 2018Byzantine-Robust Distributed Learning: Towards Optimal Statistical Ratescited by 698
  11. 2020Ensemble Distillation for Robust Model Fusion in Federated Learningcited by 678
  12. 2018Exploiting Unintended Feature Leakage in Collaborative Learningcited by 509
  13. 2019Local Model Poisoning Attacks to Byzantine-Robust Federated Learningcited by 479
  14. 2018Certified Robustness to Adversarial Examples with Differential Privacycited by 462
  15. 2019Meta-Learning with Differentiable Convex Optimizationcited by 461
  16. 2020iDLG: Improved Deep Leakage from Gradientscited by 367
  17. 2018Analyzing Federated Learning through an Adversarial Lenscited by 346
  18. 2021Federated Learning on Non-IID Data: A Surveycited by 345
  19. 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 334
  20. 2017Deep Models Under the GAN: Information Leakage from Collaborative Deep Learningcited by 326
  21. 2018The Hidden Vulnerability of Distributed Learning in Byzantiumcited by 324
  22. 2021See through Gradients: Image Batch Recovery via GradInversioncited by 320
  23. 2019Robust Aggregation for Federated Learningcited by 314
  24. 2021Neural Attention Distillation: Erasing Backdoor Triggers from Deep Neural Networkscited by 313
  25. 2020Attack of the Tails: Yes, You Really Can Backdoor Federated Learningcited by 307
  26. 2019A Little Is Enough: Circumventing Defenses For Distributed Learningcited by 285
  27. 2020Data Poisoning Attacks Against Federated Learning Systemscited by 266
  28. 2019Can You Really Backdoor Federated Learning?cited by 250
  29. 2021Federated Learning for Internet of Things: A Comprehensive Surveycited by 247
  30. 2018Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learningcited by 242
  31. 2019The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networkscited by 241
  32. 2017Embedding Watermarks into Deep Neural Networkscited by 227
  33. 2021Federated Learning for Smart Healthcare: A Surveycited by 182
  34. 2020Threats to Federated Learning: A Surveycited by 171
  35. 2018Mitigating Sybils in Federated Learning Poisoningcited by 158
  36. 2018RSA: Byzantine-Robust Stochastic Aggregation Methods for Distributed Learning from Heterogeneous Datasetscited by 148
  37. 2021Federated Learning for Open Bankingcited by 138
  38. 2013Hacking Smart Machines with Smarter Ones: How to Extract Meaningful Data from Machine Learning Classifierscited by 128

50 most cited of 107 All 107 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 3; 2025: 6.

9 papers.