Securing Federated Learning against Backdoor Threats with Foundation Model Integration
On the map: LLM safety and security → Federated unlearning and poisoning
Abstract (arXiv)
Federated Learning (FL) enables decentralized model training while preserving privacy. Recently, the integration of Foundation Models (FMs) into FL has enhanced performance but introduced a novel backdoor attack mechanism. Attackers can exploit FM vulnerabilities to embed backdoors into synthetic data generated by FMs. During global model fusion, these backdoors are transferred to the global model through compromised synthetic data, subsequently infecting all client models. Existing FL backdoor defenses are ineffective against this novel attack due to its fundamentally different mechanism compared to classic ones. In this work, we propose a novel data-free defense strategy that addresses both classic and novel backdoor attacks in FL. The shared attack pattern lies in the abnormal activations within the hidden feature space during model aggregation. Hence, we propose to constrain internal activations to remain within reasonable ranges, effectively mitigating attacks while preserving model functionality. The activation constraints are optimized using synthetic data alongside FL training. Extensive experiments demonstrate its effectiveness against both novel and classic backdoor attacks, outperforming existing defenses.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Federated unlearning and poisoning, one of 12 directions in LLM safety and security. Builds on 27 of its 39 references that are in the map. First posted on arXiv 23 Oct 2024.
Builds on
27 of 39 references.
Closest ancestors · 1
Same direction, newest first
Other references · 26
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
- 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
- 2018How To Backdoor Federated Learningcited by 745
- 2020Ensemble Distillation for Robust Model Fusion in Federated Learningcited by 678
- 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 550
- 2019Local Model Poisoning Attacks to Byzantine-Robust Federated Learningcited by 479
- 2019FedMD: Heterogenous Federated Learning via Model Distillationcited by 454
- 2017Differentially Private Federated Learning: A Client Level Perspectivecited by 451
- 2021Neural Attention Distillation: Erasing Backdoor Triggers from Deep Neural Networkscited by 313
- 2020Attack of the Tails: Yes, You Really Can Backdoor Federated Learningcited by 307
14 more
- 2020Data Poisoning Attacks Against Federated Learning Systemscited by 266
- 2019Can You Really Backdoor Federated Learning?cited by 250
- 2019A new Backdoor Attack in CNNs by training set corruption without label poisoningcited by 237
- 2023Instructions as Backdoors: Backdoor Vulnerabilities of Instruction Tuning for Large Language Modelscited by 100
- 2023When Foundation Model Meets Federated Learning: Motivations, Challenges, and Future Directionscited by 83
- 2023BadGPT: Exploring Security Vulnerabilities of ChatGPT via Backdoor Attacks to InstructGPTcited by 70
- 2022MM-BD: Post-Training Detection of Backdoor Attacks with Arbitrary Backdoor Pattern Types Using a Maximum Margin Statisticcited by 53
- 2023An Experimental Study of Byzantine-Robust Aggregation Schemes in Federated Learningcited by 32
- 2021Byzantine-robust Federated Learning through Collaborative Malicious Gradient Filteringcited by 28
- 2023GPT-FL: Generative Pre-trained Model-Assisted Federated Learningcited by 24
- 2023Efficient and Secure Federated Learning for Financial Applicationscited by 17
- 2023Backdoor Threats from Compromised Foundation Models to Federated Learningcited by 8
- 2023Knowledge Distillation from Multiple Foundation Models for End-to-End Speech Recognitioncited by 7
- 2023Unveiling Backdoor Risks Brought by Foundation Models in Heterogeneous Federated Learningcited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.