FedDefender: Client-Side Attack-Tolerant Federated Learning
Not on the map. Why?
Abstract (arXiv)
Federated learning enables learning from decentralized data sources without compromising privacy, which makes it a crucial technique. However, it is vulnerable to model poisoning attacks, where malicious clients interfere with the training process. Previous defense mechanisms have focused on the server-side by using careful model aggregation, but this may not be effective when the data is not identically distributed or when attackers can access the information of benign clients. In this paper, we propose a new defense mechanism that focuses on the client-side, called FedDefender, to help benign clients train robust local models and avoid the adverse impact of malicious model updates from attackers, even when a server-side defense cannot identify or remove adversaries. Our method consists of two main components: (1) attack-tolerant local meta update and (2) attack-tolerant global knowledge distillation. These components are used to find noise-resilient model parameters while accurately extracting knowledge from a potentially corrupted global model. Our client-side defense strategy has a flexible structure and can work in conjunction with any existing server-side strategies. Evaluations of real-world scenarios across multiple datasets show that the proposed method enhances the robustness of federated learning against model poisoning attacks.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 37 of its 52 references that are in the map. First posted on arXiv 18 Jul 2023.
Builds on
37 of 52 references.
References · 37
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2018Federated Optimization in Heterogeneous Networkscited by 2,971
- 2017Visualizing the Loss Landscape of Neural Netscited by 1,126
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
- 2019Towards Federated Learning at Scale: System Designcited by 826
- 2018LEAF: A Benchmark for Federated Settingscited by 780
- 2021Model-Contrastive Federated Learningcited by 762
- 2018Byzantine-Robust Distributed Learning: Towards Optimal Statistical Ratescited by 698
- 2020The Future of Digital Health with Federated Learningcited by 625
25 more
- 2018Poison Frogs! Targeted Clean-Label Poisoning Attacks on Neural Networkscited by 500
- 2019Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillationcited by 491
- 2019Local Model Poisoning Attacks to Byzantine-Robust Federated Learningcited by 479
- 2019Robust Aggregation for Federated Learningcited by 314
- 2021A Field Guide to Federated Optimizationcited by 312
- 2019A Little Is Enough: Circumventing Defenses For Distributed Learningcited by 285
- 2019Can You Really Backdoor Federated Learning?cited by 250
- 2021FedKD: Communication Efficient Federated Learning via Knowledge Distillationcited by 185
- 2020Threats to Federated Learning: A Surveycited by 171
- 2018Learning to Learn from Noisy Labeled Datacited by 160
- 2017Revisiting Distributed Synchronous SGDcited by 142
- 2021Deep Learning Through the Lens of Example Difficultycited by 139
- 2020Byzantine-Robust Learning on Heterogeneous Datasets via Bucketingcited by 125
- 2021Back to the Drawing Board: A Critical Evaluation of Poisoning Attacks on Production Federated Learningcited by 116
- 2018Generalized Byzantine-tolerant SGDcited by 94
- 2021On the geometry of generalization and memorization in deep neural networkscited by 71
- 2020Improving Unsupervised Image Clustering With Robust Learningcited by 51
- 2020Performance Optimization for Federated Person Re-identification via Benchmark Analysiscited by 50
- 2019Attack-Resistant Federated Learning with Residual-based Reweightingcited by 40
- 2022FedX: Unsupervised Federated Learning with Cross Knowledge Distillationcited by 40
- 2021FL-WBC: Enhancing Robustness against Model Poisoning Attacks in Federated Learning from a Client Perspectivecited by 35
- 2021Cost-Effective Federated Learning in Mobile Edge Networkscited by 25
- 2022FedAttack: Effective and Covert Poisoning Attack on Federated Recommendation via Hard Samplingcited by 21
- 2022Federated Learning Attacks and Defenses: A Surveycited by 11
- 2022Knowledge Sharing via Domain Adaptation in Customs Fraud Detectioncited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 7; 2025: 2; 2026: 2.
12 papers.
- 2024OpenFedLLM: Training Large Language Models on Decentralized Private Data via Federated Learningcited by 124
- 2024FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Modelscited by 26
- 2024Emerging Safety Attack and Defense in Federated Instruction Tuning of Large Language Modelscited by 18
- 2024Federated Distillation: A Surveycited by 14
- 2023Towards Attack-tolerant Federated Learning via Critical Parameter Analysiscited by 7
- 2024Poisoning with A Pill: Circumventing Detection in Federated Learningcited by 2
- 2024FedMID: A Data-Free Method for Using Intermediate Outputs as a Defense Mechanism Against Poisoning Attacks in Federated Learningcited by 0
- 2024Defending Against Sophisticated Poisoning Attacks with RL-based Aggregation in Federated Learningcited by 0
- 2025An Enhanced Privacy-preserving Federated Few-shot Learning Framework for Respiratory Disease Diagnosiscited by 0
- 2025Who Owns This Sample: Cross-Client Membership Inference Attack in Federated Graph Neural Networkscited by 0
- 2026FedIDM: Achieving Fast and Stable Convergence in Byzantine Federated Learning through Iterative Distribution Matchingcited by 0
- 2026Upholding Robustness in Federated Learning: Trends, Emerging Strategies, and Research Opportunitiescited by 0
- 2026Upholding Robustness in Federated Learning: Trends, Emerging Strategies, and Research Opportunities23 Sep 2026
- 2026FedIDM: Achieving Fast and Stable Convergence in Byzantine Federated Learning through Iterative Distribution Matching16 Apr 2026
- 2025Who Owns This Sample: Cross-Client Membership Inference Attack in Federated Graph Neural Networks26 Jul 2025
- 2025An Enhanced Privacy-preserving Federated Few-shot Learning Framework for Respiratory Disease Diagnosis10 Jul 2025
- 2024Poisoning with A Pill: Circumventing Detection in Federated Learning22 Jul 2024
- 2024Defending Against Sophisticated Poisoning Attacks with RL-based Aggregation in Federated Learning20 Jun 2024
- 2024Emerging Safety Attack and Defense in Federated Instruction Tuning of Large Language Models15 Jun 2024
- 2024FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Models7 Jun 2024
- 2024FedMID: A Data-Free Method for Using Intermediate Outputs as a Defense Mechanism Against Poisoning Attacks in Federated Learning18 Apr 2024
- 2024Federated Distillation: A Survey2 Apr 2024
- 2024OpenFedLLM: Training Large Language Models on Decentralized Private Data via Federated Learning10 Feb 2024
- 2023Towards Attack-tolerant Federated Learning via Critical Parameter Analysis18 Aug 2023