Data Poisoning Attacks Against Federated Learning Systems
Not on the map. Why?
Cited by 32 in LLM safety and security, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Federated learning (FL) is an emerging paradigm for distributed training of large-scale deep neural networks in which participants' data remains on their own devices with only model updates being shared with a central server. However, the distributed nature of FL gives rise to new threats caused by potentially malicious participants. In this paper, we study targeted data poisoning attacks against FL systems in which a malicious subset of the participants aim to poison the global model by sending model updates derived from mislabeled data. We first demonstrate that such data poisoning attacks can cause substantial drops in classification accuracy and recall, even with a small percentage of malicious participants. We additionally show that the attacks can be targeted, i.e., they have a large negative impact only on classes that are under attack. We also study attack longevity in early/late round training, the impact of malicious participant availability, and the relationships between the two. Finally, we propose a defense strategy that can help identify malicious participants in FL to circumvent poisoning attacks, and demonstrate its effectiveness.
Key facts. Cited by 266 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 34; 2022: 36; 2023: 52; 2024: 66; 2025: 54; 2026: 24.
266 papers.
Sort:
By area:
- 2021Federated Learning for Smart Healthcare: A Surveycited by 182
- 2023Heterogeneous Federated Learning: State-of-the-art and Research Challengescited by 160
- 2021Back to the Drawing Board: A Critical Evaluation of Poisoning Attacks on Production Federated Learningcited by 116
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoningcited by 93
- 2023Decentralized Federated Learning: A Survey and Perspectivecited by 86
- 2024Harmful Fine-tuning Attacks and Defenses for Large Language Models: A Surveycited by 86
- 2021Federated Learning: Opportunities and Challengescited by 83
- 2021From Distributed Machine Learning to Federated Learning: A Surveycited by 65
- 2022MPAF: Model Poisoning Attacks to Federated Learning based on Fake Clientscited by 65
- 2021Collaborative Federated Learning For Healthcare: Multi-Modal COVID-19 Diagnosis at the Edgecited by 56
- 2025Commercial LLM Agents Are Already Vulnerable to Simple Yet Dangerous Attackscited by 49
- 2024Byzantine-Robust Decentralized Federated Learningcited by 47
38 more
- 2023Recent Advances on Federated Learning: A Systematic Surveycited by 40
- 2022FLIP: A Provable Defense Framework for Backdoor Mitigation in Federated Learningcited by 37
- 2021Emerging Trends in Federated Learning: From Model Fusion to Federated X Learningcited by 35
- 2023Backdoor Attacks and Defenses in Federated Learning: Survey, Challenges and Future Research Directionscited by 33
- 2022LoMar: A Local Defense Against Poisoning Attack on Federated Learningcited by 29
- 2022FLCert: Provably Secure Federated Learning against Poisoning Attackscited by 29
- 2022Amplifying Membership Exposure via Data Poisoningcited by 29
- 2023Integration of Large Language Models and Federated Learningcited by 28
- 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challengescited by 26
- 2023Selective Knowledge Sharing for Privacy-Preserving Federated Distillation without A Good Teachercited by 25
- 2023A Survey of Trustworthy Federated Learning with Perspectives on Security, Robustness, and Privacycited by 24
- 2021RoFL: Robustness of Secure Federated Learningcited by 23
- 2021Efficient Differentially Private Secure Aggregation for Federated Learning via Hardness of Learning with Errorscited by 23
- 2021Robust Training in High Dimensions via Block Coordinate Geometric Median Descentcited by 20
- 2025Ten Challenging Problems in Federated Foundation Modelscited by 20
- 2025Data Poisoning in Deep Learning: A Surveycited by 20
- 2023FedSecurity: Benchmarking Attacks and Defenses in Federated Learning and Federated LLMscited by 19
- 2024Advances in APPFL: A Comprehensive and Extensible Federated Learning Frameworkcited by 19
- 2021Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligencecited by 18
- 2024Emerging Safety Attack and Defense in Federated Instruction Tuning of Large Language Modelscited by 18
- 2022How to Sift Out a Clean Data Subset in the Presence of Data Poisoning?cited by 17
- 2023Data and Model Poisoning Backdoor Attacks on Wireless Federated Learning, and the Defense Mechanisms: A Comprehensive Surveycited by 17
- 2024AI Risk Management Should Incorporate Both Safety and Securitycited by 17
- 2022Defending against the Label-flipping Attack in Federated Learningcited by 16
- 2023Revisiting Personalized Federated Learning: Robustness Against Backdoor Attackscited by 16
- 2023FedGT: Identification of Malicious Clients in Federated Learning with Secure Aggregationcited by 16
- 2021Decentralized Deep Learning for Multi-Access Edge Computing: A Survey on Communication Efficiency and Trustworthinesscited by 15
- 2021Learning-to-learn non-convex piecewise-Lipschitz functionscited by 15
- 2023FLShield: A Validation Based Federated Learning Framework to Defend Against Poisoning Attackscited by 15
- 2023Fusion of Global and Local Knowledge for Personalized Federated Learningcited by 14
- 2023Fast Adversarial Training with Smooth Convergencecited by 14
- 2024Threats and Defenses in Federated Learning Life Cycle: A Comprehensive Survey and Challengescited by 14
- 2021Get a Model! Model Hijacking Attack Against Machine Learning Modelscited by 13
- 2022Machine Learning with Confidential Computing: A Systematization of Knowledgecited by 13
- 2024Achieving Byzantine-Resilient Federated Learning via Layer-Adaptive Sparsified Model Aggregationcited by 13
- 2025Do We Really Need to Design New Byzantine-robust Aggregation Rules?cited by 13
- 2021Untargeted Poisoning Attack Detection in Federated Learning via Behavior Attestationcited by 12
- 2022Autonomy and Intelligence in the Computing Continuum: Challenges, Enablers, and Future Directions for Orchestrationcited by 12
50 most cited of 266 All 266 (JSON)
- 2026Upholding Robustness in Federated Learning: Trends, Emerging Strategies, and Research Opportunities23 Sep 2026
- 2026When Clients Are Orchestrated: Strategic Gradient Manipulation to Defeat Federated Learning Servers with Efficient Defense22 Sep 2026
- 2026USPLIT-VQA: U-Shaped Split Learning for Visual Question Answering with Contribution-Aware Weighted Aggregation10 Sep 2026
- 2026Model-Consistent Byzantine-Resilient Decentralized Federated Learning for Collaborative Missions23 Aug 2026
- 2026STAR-FL: Secure Federated Learning with Spatial-Temporal Analysis and Robust Aggregation14 Aug 2026
- 2026Targeted Label-Flipping and Oversampling Attacks on Federated Conditional GANs10 Aug 2026
- 2026Bypassing Krum: Selection-Aware Backdoor Attacks in Federated Learning6 Aug 2026
- 2026The Power of Backdoor Absorption in Community Training7 Jul 2026
- 2026PRoVeFL: Private Robust and Verifiable Aggregation in Federated Learning7 Jul 2026
- 2026From Data Heterogeneity to Convergence: A Data-Centric Review of Federated Learning9 Jun 2026
- 2026TITAN-FedAnil+: Trust-Based Adaptive Blockchain Federated Learning for Resource-Constrained Intelligent Enterprises3 Jun 2026
- 2026EnCAgg: Enhanced Clustering Aggregation for Robust Federated Learning against Dynamic Model Poisoning21 May 2026
38 more
- 2026FedSurrogate: Backdoor Defense in Federated Learning via Layer Criticality and Surrogate Replacement11 May 2026
- 2026Robust Server Defense Against Unreliable Clients in One-Shot Fair Collaborative Machine Learning9 May 2026
- 2026AdaBFL: Multi-Layer Defensive Adaptive Aggregation for Bzantine-Robust Federated Learning30 Apr 2026
- 2026When AI reviews science: Can we trust the referee?26 Apr 2026
- 2026When Background Matters: Breaking Medical Vision Language Models by Transferable Attack19 Apr 2026
- 2026TEMPLATEFUZZ: Fine-Grained Chat Template Fuzzing for Jailbreaking and Red Teaming LLMs14 Apr 2026
- 2026XFED: Non-Collusive Model Poisoning Attack Against Byzantine-Robust Federated Classifiers10 Apr 2026
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggers6 Apr 2026
- 2026SecureAFL: Secure Asynchronous Federated Learning4 Apr 2026
- 2026PoiCGAN: A Targeted Poisoning Based on Feature-Label Joint Perturbation in Federated Learning24 Mar 2026
- 2026FedTrident: Resilient Road Condition Classification Against Poisoning Attacks in Federated Learning19 Mar 2026
- 2026Cascade: Composing Software-Hardware Attack Gadgets for Adversarial Threat Amplification in Compound AI Systems12 Mar 2026
- 2025PFed-Signal: An ADR Prediction Model based on Federated Learning29 Dec 2025
- 2025GShield: Mitigating Poisoning Attacks in Federated Learning22 Dec 2025
- 2025DEFEND: Poisoned Model Detection and Malicious Client Exclusion Mechanism for Secure Federated Learning-based Road Condition Classification5 Dec 2025
- 2025FedPoP: Federated Learning Meets Proof of Participation11 Nov 2025
- 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges27 Oct 2025
- 2025Trade-off in Estimating the Number of Byzantine Clients in Federated Learning6 Oct 2025
- 2025CoSIFL: Collaborative Secure and Incentivized Federated Learning with Differential Privacy27 Sep 2025
- 2025On the Fragility of Contribution Score Computation in Federated Learning24 Sep 2025
- 2025Enhancing the Effectiveness and Durability of Backdoor Attacks in Federated Learning through Maximizing Task Distinction23 Sep 2025
- 2025MARS: A Malignity-Aware Backdoor Defense in Federated Learning21 Sep 2025
- 2025Poison to Detect: Detection of Targeted Overfitting in Federated Learning15 Sep 2025
- 2025DSFL: A Dual-Server Byzantine-Resilient Federated Learning Framework via Group-Based Secure Aggregation10 Sep 2025
- 2025Hammer and Anvil: Toward a Theory of Backdoors in Federated Learning9 Sep 2025
- 2025On Evaluating the Poisoning Robustness of Federated Learning under Local Differential Privacy5 Sep 2025
- 2025FedThief: Harming Others to Benefit Oneself in Self-Centered Federated Learning30 Aug 2025
- 2025FedUP: Efficient Pruning-based Federated Unlearning for Model Poisoning Attacks19 Aug 2025
- 2025On the Security and Privacy of Federated Learning: A Survey with Attacks, Defenses, Frameworks, Applications, and Future Directions19 Aug 2025
- 2025Adversarial Robustness in Distributed Quantum Machine Learning16 Aug 2025
- 2025FedShard: Federated Unlearning with Efficiency Fairness and Performance Fairness13 Aug 2025
- 2025FIDELIS: Blockchain-Enabled Protection Against Poisoning Attacks in Federated Learning11 Aug 2025
- 2025Federated Graph Unlearning4 Aug 2025
- 2025FedLAD: A Linear Algebra Based Data Poisoning Defence for Federated Learning4 Aug 2025
- 2025FedBAP: Backdoor Defense via Benign Adversarial Perturbation in Federated Learning26 Jul 2025
- 2025AnalogFed: Privacy-Preserving Discovery of Analog Circuits at Scale with Federated Generative AI20 Jul 2025
- 2025Byzantine-resilient federated online learning for Gaussian process regression18 Jul 2025
- 2025Self-Adaptive and Robust Federated Spectrum Sensing without Benign Majority for Cellular Networks16 Jul 2025
50 newest of 266 All 266 (JSON)
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoningcited by 93
- 2022Amplifying Membership Exposure via Data Poisoningcited by 29
- 2025Ten Challenging Problems in Federated Foundation Modelscited by 20
- 2025Data Poisoning in Deep Learning: A Surveycited by 20
- 2022How to Sift Out a Clean Data Subset in the Presence of Data Poisoning?cited by 17
- 2022Backdoor Attack and Defense in Federated Generative Adversarial Network-based Medical Image Synthesiscited by 12
- 2025Towards Reliable Forgetting: A Survey on Machine Unlearning Verificationcited by 8
- 2024Federated Learning Under Attack: Exposing Vulnerabilities through Data Poisoning Attacks in Computer Networkscited by 5
- 2025Position: Bridge the Gaps between Machine Unlearning and AI Regulationcited by 5
- 2024Foundation Models in Federated Learning: Assessing Backdoor Vulnerabilitiescited by 3
- 2024The Effect of Data Poisoning on Counterfactual Explanationscited by 3
- 2024Securing Federated Learning against Backdoor Threats with Foundation Model Integrationcited by 3
12 most cited of 27 All 27 (JSON)
- 2026STAR-FL: Secure Federated Learning with Spatial-Temporal Analysis and Robust Aggregation14 Aug 2026
- 2026TEMPLATEFUZZ: Fine-Grained Chat Template Fuzzing for Jailbreaking and Red Teaming LLMs14 Apr 2026
- 2026Cascade: Composing Software-Hardware Attack Gadgets for Adversarial Threat Amplification in Compound AI Systems12 Mar 2026
- 2025FedUP: Efficient Pruning-based Federated Unlearning for Model Poisoning Attacks19 Aug 2025
- 2025FedShard: Federated Unlearning with Efficiency Fairness and Performance Fairness13 Aug 2025
- 2025FIDELIS: Blockchain-Enabled Protection Against Poisoning Attacks in Federated Learning11 Aug 2025
- 2025Federated Graph Unlearning4 Aug 2025
- 2025FedLAD: A Linear Algebra Based Data Poisoning Defence for Federated Learning4 Aug 2025
- 2025Find a Scapegoat: Poisoning Membership Inference Attack and Defense to Federated Learning1 Jul 2025
- 2025Towards Reliable Forgetting: A Survey on Machine Unlearning Verification18 Jun 2025
- 2025Sybil-based Virtual Data Poisoning Attacks in Federated Learning15 May 2025
- 2025Data Poisoning in Deep Learning: A Survey27 Mar 2025
12 newest of 27 All 27 (JSON)
- 2024Harmful Fine-tuning Attacks and Defenses for Large Language Models: A Surveycited by 86
- 2024Emerging Safety Attack and Defense in Federated Instruction Tuning of Large Language Modelscited by 18
- 2025LLM Misalignment via Adversarial RLHF Platformscited by 5
- 2025SafeTuneBed: A Toolkit for Benchmarking LLM Safety Alignment in Fine-Tuningcited by 1
- 2025SafeTuneBed: A Toolkit for Benchmarking LLM Safety Alignment in Fine-Tuning31 May 2025
- 2025LLM Misalignment via Adversarial RLHF Platforms4 Mar 2025
- 2024Harmful Fine-tuning Attacks and Defenses for Large Language Models: A Survey26 Sep 2024
- 2024Emerging Safety Attack and Defense in Federated Instruction Tuning of Large Language Models15 Jun 2024
- 2024Semantic Shield: Defending Vision-Language Models Against Backdooring and Poisoning via Fine-grained Knowledge Alignmentcited by 7
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggerscited by 1
- 2026When Background Matters: Breaking Medical Vision Language Models by Transferable Attackcited by 1
- 2026When Background Matters: Breaking Medical Vision Language Models by Transferable Attack19 Apr 2026
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggers6 Apr 2026
- 2024Semantic Shield: Defending Vision-Language Models Against Backdooring and Poisoning via Fine-grained Knowledge Alignment23 Nov 2024
- 2021Federated Learning for Smart Healthcare: A Surveycited by 182
- 2023Heterogeneous Federated Learning: State-of-the-art and Research Challengescited by 160
- 2021Back to the Drawing Board: A Critical Evaluation of Poisoning Attacks on Production Federated Learningcited by 116
- 2023Decentralized Federated Learning: A Survey and Perspectivecited by 86
- 2021Federated Learning: Opportunities and Challengescited by 83
- 2021From Distributed Machine Learning to Federated Learning: A Surveycited by 65
- 2022MPAF: Model Poisoning Attacks to Federated Learning based on Fake Clientscited by 65
- 2021Collaborative Federated Learning For Healthcare: Multi-Modal COVID-19 Diagnosis at the Edgecited by 56
- 2024Byzantine-Robust Decentralized Federated Learningcited by 47
- 2023Recent Advances on Federated Learning: A Systematic Surveycited by 40
- 2022FLIP: A Provable Defense Framework for Backdoor Mitigation in Federated Learningcited by 37
- 2021Emerging Trends in Federated Learning: From Model Fusion to Federated X Learningcited by 35
12 most cited of 229 All 229 (JSON)
- 2026Upholding Robustness in Federated Learning: Trends, Emerging Strategies, and Research Opportunities23 Sep 2026
- 2026When Clients Are Orchestrated: Strategic Gradient Manipulation to Defeat Federated Learning Servers with Efficient Defense22 Sep 2026
- 2026USPLIT-VQA: U-Shaped Split Learning for Visual Question Answering with Contribution-Aware Weighted Aggregation10 Sep 2026
- 2026Model-Consistent Byzantine-Resilient Decentralized Federated Learning for Collaborative Missions23 Aug 2026
- 2026Targeted Label-Flipping and Oversampling Attacks on Federated Conditional GANs10 Aug 2026
- 2026Bypassing Krum: Selection-Aware Backdoor Attacks in Federated Learning6 Aug 2026
- 2026The Power of Backdoor Absorption in Community Training7 Jul 2026
- 2026PRoVeFL: Private Robust and Verifiable Aggregation in Federated Learning7 Jul 2026
- 2026From Data Heterogeneity to Convergence: A Data-Centric Review of Federated Learning9 Jun 2026
- 2026TITAN-FedAnil+: Trust-Based Adaptive Blockchain Federated Learning for Resource-Constrained Intelligent Enterprises3 Jun 2026
- 2026EnCAgg: Enhanced Clustering Aggregation for Robust Federated Learning against Dynamic Model Poisoning21 May 2026
- 2026FedSurrogate: Backdoor Defense in Federated Learning via Layer Criticality and Surrogate Replacement11 May 2026
12 newest of 229 All 229 (JSON)