DeepSight: Mitigating Backdoor Attacks in Federated Learning Through Deep Model Inspection
Not on the map. Why?
Abstract (arXiv)
Federated Learning (FL) allows multiple clients to collaboratively train a Neural Network (NN) model on their private data without revealing the data. Recently, several targeted poisoning attacks against FL have been introduced. These attacks inject a backdoor into the resulting model that allows adversary-controlled inputs to be misclassified. Existing countermeasures against backdoor attacks are inefficient and often merely aim to exclude deviating models from the aggregation. However, this approach also removes benign models of clients with deviating data distributions, causing the aggregated model to perform poorly for such clients. To address this problem, we propose DeepSight, a novel model filtering approach for mitigating backdoor attacks. It is based on three novel techniques that allow to characterize the distribution of data used to train model updates and seek to measure fine-grained differences in the internal structure and outputs of NNs. Using these techniques, DeepSight can identify suspicious model updates. We also develop a scheme that can accurately cluster model updates. Combining the results of both components, DeepSight is able to identify and eliminate model clusters containing poisoned models with high attack impact. We also show that the backdoor contributions of possibly undetected poisoned models can be effectively mitigated with existing weight clipping-based defenses. We evaluate the performance and effectiveness of DeepSight and show that it can mitigate state-of-the-art backdoor attacks with a negligible impact on the model's performance on benign data.
Key facts. Cited by 80 papers in the map (data through 13 Oct 2026). Builds on 17 of its 43 references that are in the map. First posted on arXiv 3 Jan 2022.
Builds on
17 of 43 references.
References · 17
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,653
- 2018How To Backdoor Federated Learningcited by 764
- 2018Byzantine-Robust Distributed Learning: Towards Optimal Statistical Ratescited by 708
- 2019Local Model Poisoning Attacks to Byzantine-Robust Federated Learningcited by 490
- 2018The Hidden Vulnerability of Distributed Learning in Byzantiumcited by 326
- 2020Attack of the Tails: Yes, You Really Can Backdoor Federated Learningcited by 308
- 2019A Little Is Enough: Circumventing Defenses For Distributed Learningcited by 287
- 2019Can You Really Backdoor Federated Learning?cited by 254
- 2019Updates-Leak: Data Set Inference and Reconstruction Attacks in Online Learningcited by 122
- 2018D"IoT: A Federated Self-learning Anomaly Detection System for IoTcited by 89
- 2020Learning to Detect Malicious Clients for Robust Federated Learningcited by 88
- 2019Byzantine-Robust Federated Machine Learning through Adaptive Model Averagingcited by 70
5 more
- 2021Provably Secure Federated Learning against Malicious Clientscited by 63
- 2020BaFFLe: Backdoor detection via Feedback-based Federated Learningcited by 53
- 2019Abnormal Client Behavior Detection in Federated Learningcited by 40
- 2019Eavesdrop the Composition Proportion of Training Labels in Federated Learningcited by 27
- 2020Client Adaptation improves Federated Learning with Simulated Non-IID Clientscited by 3
Built on by
Citing papers per year: 2022: 8; 2023: 24; 2024: 15; 2025: 21; 2026: 12.
80 papers.
Sort:
By area:
- 2023Backdoor Attacks and Defenses in Federated Learning: Survey, Challenges and Future Research Directionscited by 33
- 2022FedTracker: Furnishing Ownership Verification and Traceability for Federated Learning Modelcited by 30
- 2023On the Vulnerability of Backdoor Defenses for Federated Learningcited by 27
- 2023FreqFed: A Frequency Analysis-Based Approach for Mitigating Poisoning Attacks in Federated Learningcited by 27
- 2022CrowdGuard: Federated Backdoor Detection in Federated Learningcited by 26
- 2023BayBFed: Bayesian Backdoor Defense for Federated Learningcited by 23
- 2023Chameleon: Adapting to Peer Images for Planting Durable Backdoors in Federated Learningcited by 20
- 2023Data and Model Poisoning Backdoor Attacks on Wireless Federated Learning, and the Defense Mechanisms: A Comprehensive Surveycited by 18
- 2022Watermarking in Secure Federated Learning: A Verification Framework Based on Client-Side Backdooringcited by 17
- 2023Backdoor Federated Learning by Poisoning Backdoor-Critical Layerscited by 16
- 2022More is Better (Mostly): On the Backdoor Attacks in Federated Graph Neural Networkscited by 15
- 2023FLShield: A Validation Based Federated Learning Framework to Defend Against Poisoning Attackscited by 15
38 more
- 2025Do We Really Need to Design New Byzantine-robust Aggregation Rules?cited by 15
- 2023Get Rid Of Your Trail: Remotely Erasing Backdoors in Federated Learningcited by 13
- 2025Detecting Backdoor Attacks in Federated Learning via Direction Alignment Inspectioncited by 13
- 2023Backdoor Attacks in Peer-to-Peer Federated Learningcited by 9
- 2023Client-specific Property Inference against Secure Aggregation in Federated Learningcited by 9
- 2023G2uardFL: Safeguarding Federated Learning Against Backdoor Attacks through Attributed Client Graph Clusteringcited by 9
- 2023A Survey on Vulnerability of Federated Learning: A Learning Algorithm Perspectivecited by 9
- 2024Meta Stackelberg Game: Robust Federated Learning against Adaptive and Mixed Poisoning Attackscited by 9
- 2023Learning to Backdoor Federated Learningcited by 8
- 2023FLTracer: Accurate Poisoning Attack Provenance in Federated Learningcited by 8
- 2025Provably Robust Federated Reinforcement Learningcited by 8
- 2023A First Order Meta Stackelberg Method for Robust Federated Learningcited by 7
- 2023Self-Deception: Reverse Penetrating the Semantic Firewall of Large Language Modelscited by 7
- 2025MARS: A Malignity-Aware Backdoor Defense in Federated Learningcited by 7
- 2023Resisting Backdoor Attacks in Federated Learning via Bidirectional Elections and Individual Perspectivecited by 6
- 2022SafeNet: The Unreasonable Effectiveness of Ensembles in Private Collaborative Learningcited by 5
- 2024ACE: A Model Poisoning Attack on Contribution Evaluation Methods in Federated Learningcited by 5
- 2024Adversarially Guided Stateful Defense Against Backdoor Attacks in Federated Deep Learningcited by 5
- 2022DECK: Model Hardening for Defending Pervasive Backdoorscited by 4
- 2023FedGrad: Mitigating Backdoor Attacks in Federated Learning Through Local Ultimate Gradients Inspectioncited by 4
- 2023FLEDGE: Ledger-based Federated Learning Resilient to Inference and Backdoor Attackscited by 4
- 2024Identify Backdoored Model in Federated Learning via Individual Unlearningcited by 4
- 2025Toward Malicious Clients Detection in Federated Learningcited by 4
- 2022CELEST: Federated Learning for Globally Coordinated Threat Detectioncited by 3
- 2023FLAIRS: FPGA-Accelerated Inference-Resistant & Secure Federated Learningcited by 3
- 2024Linkage on Security, Privacy and Fairness in Federated Learning: New Balances and New Perspectivescited by 3
- 2024BadSampler: Harnessing the Power of Catastrophic Forgetting to Poison Byzantine-robust Federated Learningcited by 3
- 2024BoBa: Boosting Backdoor Detection through Data Distribution Inference in Federated Learningcited by 3
- 2023Kick Bad Guys Out! Conditionally Activated Anomaly Detection in Federated Learning with Zero-Knowledge Proof Verificationcited by 2
- 2024EmInspector: Combating Backdoor Attacks in Federated Self-Supervised Learning Through Embedding Inspectioncited by 2
- 2024Poisoning with A Pill: Circumventing Detection in Federated Learningcited by 2
- 2026ProtegoFed: Backdoor-Free Federated Instruction Tuning with Interspersed Poisoned Datacited by 2
- 2022FLVoogd: Robust And Privacy Preserving Federated Learningcited by 1
- 2023Avoid Adversarial Adaption in Federated Learning by Multi-Metric Investigationscited by 1
- 2024Precision Guided Approach to Mitigate Data Poisoning Attacks in Federated Learningcited by 1
- 2024Venomancer: Towards Imperceptible and Target-on-Demand Backdoor Attacks in Federated Learningcited by 1
- 2024Non-Cooperative Backdoor Attacks in Federated Learning: A New Threat Landscapecited by 1
- 2024Celtibero: Robust Layered Aggregation for Federated Learningcited by 1
50 most cited of 80 All 80 (JSON)
- 2026Fine-grained Distributed Backdoor Attacks in Federated Learning7 Sep 2026
- 2026Backdoors Leave Structural Traces: FedMAST for Backdoor Detection and Containment in Federated Learning4 Sep 2026
- 2026BackDFL: A Unified Benchmark For Backdoor Attacks and Defenses In Decentralized Federated Learning21 Aug 2026
- 2026STAR-FL: Secure Federated Learning with Spatial-Temporal Analysis and Robust Aggregation14 Aug 2026
- 2026Robust Reputation-Driven Crowdsourced Federated Learning9 Aug 2026
- 2026Securing Autonomous Vehicle Systems via Twin-Aware Federated Reinforcement Learning9 Jul 2026
- 2026Color Matters: Trigger Color Affects Success in Federated Backdoor Attacks24 Jun 2026
- 2026Your Privacy My Cloak: Backdoor Attacks on Differentially Private Federated Learning15 Jun 2026
- 2026Your Neighbors Know: Leveraging Local Neighborhoods for Backdoor Detection in Decentralized Learning19 May 2026
- 2026Jellyfish: Zero-Shot Federated Unlearning Scheme with Knowledge Disentanglement5 Apr 2026
- 2026ProtegoFed: Backdoor-Free Federated Instruction Tuning with Interspersed Poisoned Data28 Feb 2026
- 2026When the Server Steps In: Calibrated Updates for Fair Federated Learning8 Jan 2026
38 more
- 2025Unveiling Hidden Threats: Using Fractal Triggers to Boost Stealthiness of Distributed Backdoor Attacks in Federated Learning12 Nov 2025
- 2025Enhancing the Effectiveness and Durability of Backdoor Attacks in Federated Learning through Maximizing Task Distinction23 Sep 2025
- 2025MARS: A Malignity-Aware Backdoor Defense in Federated Learning21 Sep 2025
- 2025On the Out-of-Distribution Backdoor Attack for Federated Learning16 Sep 2025
- 2025Hammer and Anvil: Toward a Theory of Backdoors in Federated Learning9 Sep 2025
- 2025Enabling Trustworthy Federated Learning via Remote Attestation for Mitigating Byzantine Threats30 Aug 2025
- 2025Poison Once, Refuse Forever: Weaponizing Alignment for Injecting Bias in LLMs28 Aug 2025
- 2025FLAT: Revealing Hidden Latent-Conditioned Backdoor Failures in Federated Learning6 Aug 2025
- 2025Coward: Collision-based OOD Watermarking for Practical Proactive Federated Backdoor Detection4 Aug 2025
- 2025BackFed: An Efficient & Standardized Benchmark Suite for Backdoor Attacks in Federated Learning7 Jul 2025
- 2025Find a Scapegoat: Poisoning Membership Inference Attack and Defense to Federated Learning1 Jul 2025
- 2025Zero-Trust Foundation Models: A New Paradigm for Secure and Collaborative Artificial Intelligence for Internet of Things26 May 2025
- 2025Defending the Edge: Representative-Attention Defense against Backdoor Attacks in Federated Learning15 May 2025
- 2025Toward Malicious Clients Detection in Federated Learning14 May 2025
- 2025TrojanDam: Detection-Free Backdoor Defense in Federated Learning through Proactive Model Robustification utilizing OOD Data22 Apr 2025
- 2025Byzantine-Robust Federated Learning Using Generative Adversarial Networks26 Mar 2025
- 2025Detecting Backdoor Attacks in Federated Learning via Direction Alignment Inspection11 Mar 2025
- 2025Provably Robust Federated Reinforcement Learning12 Feb 2025
- 2025Do We Really Need to Design New Byzantine-robust Aggregation Rules?29 Jan 2025
- 2025FL-CLEANER: byzantine and backdoor defense by CLustering Errors of Activation maps in Non-iid fedErated leaRning21 Jan 2025
- 2025Gradient Purification: Defense Against Poisoning Attack in Decentralized Federated Learning8 Jan 2025
- 2024LOGSAFE: Logic-Guided Verification for Trustworthy Federated Time-Series Learning5 Nov 2024
- 2024Identify Backdoored Model in Federated Learning via Individual Unlearning1 Nov 2024
- 2024Meta Stackelberg Game: Robust Federated Learning against Adaptive and Mixed Poisoning Attacks22 Oct 2024
- 2024Adversarially Guided Stateful Defense Against Backdoor Attacks in Federated Deep Learning15 Oct 2024
- 2024Celtibero: Robust Layered Aggregation for Federated Learning26 Aug 2024
- 2024Poisoning with A Pill: Circumventing Detection in Federated Learning22 Jul 2024
- 2024BoBa: Boosting Backdoor Detection through Data Distribution Inference in Federated Learning12 Jul 2024
- 2024Non-Cooperative Backdoor Attacks in Federated Learning: A New Threat Landscape5 Jul 2024
- 2024Venomancer: Towards Imperceptible and Target-on-Demand Backdoor Attacks in Federated Learning3 Jul 2024
- 2024A Whole-Process Certifiably Robust Aggregation Method Against Backdoor Attacks in Federated Learning30 Jun 2024
- 2024BadSampler: Harnessing the Power of Catastrophic Forgetting to Poison Byzantine-robust Federated Learning18 Jun 2024
- 2024Linkage on Security, Privacy and Fairness in Federated Learning: New Balances and New Perspectives16 Jun 2024
- 2024ACE: A Model Poisoning Attack on Contribution Evaluation Methods in Federated Learning31 May 2024
- 2024EmInspector: Combating Backdoor Attacks in Federated Self-Supervised Learning Through Embedding Inspection21 May 2024
- 2024Precision Guided Approach to Mitigate Data Poisoning Attacks in Federated Learning5 Apr 2024
- 2023Data and Model Poisoning Backdoor Attacks on Wireless Federated Learning, and the Defense Mechanisms: A Comprehensive Survey14 Dec 2023
- 2023FreqFed: A Frequency Analysis-Based Approach for Mitigating Poisoning Attacks in Federated Learning7 Dec 2023
50 newest of 80 All 80 (JSON)
- 2022FedTracker: Furnishing Ownership Verification and Traceability for Federated Learning Modelcited by 30
- 2023Self-Deception: Reverse Penetrating the Semantic Firewall of Large Language Modelscited by 7
- 2023FLAIRS: FPGA-Accelerated Inference-Resistant & Secure Federated Learningcited by 3
- 2023Kick Bad Guys Out! Conditionally Activated Anomaly Detection in Federated Learning with Zero-Knowledge Proof Verificationcited by 2
- 2026ProtegoFed: Backdoor-Free Federated Instruction Tuning with Interspersed Poisoned Datacited by 2
- 2023Avoid Adversarial Adaption in Federated Learning by Multi-Metric Investigationscited by 1
- 2024Precision Guided Approach to Mitigate Data Poisoning Attacks in Federated Learningcited by 1
- 2025Find a Scapegoat: Poisoning Membership Inference Attack and Defense to Federated Learningcited by 1
- 2026Jellyfish: Zero-Shot Federated Unlearning Scheme with Knowledge Disentanglementcited by 1
- 2025Gradient Purification: Defense Against Poisoning Attack in Decentralized Federated Learningcited by 0
- 2026STAR-FL: Secure Federated Learning with Spatial-Temporal Analysis and Robust Aggregationcited by 0
- 2026STAR-FL: Secure Federated Learning with Spatial-Temporal Analysis and Robust Aggregation14 Aug 2026
- 2026Jellyfish: Zero-Shot Federated Unlearning Scheme with Knowledge Disentanglement5 Apr 2026
- 2026ProtegoFed: Backdoor-Free Federated Instruction Tuning with Interspersed Poisoned Data28 Feb 2026
- 2025Find a Scapegoat: Poisoning Membership Inference Attack and Defense to Federated Learning1 Jul 2025
- 2025Gradient Purification: Defense Against Poisoning Attack in Decentralized Federated Learning8 Jan 2025
- 2024Precision Guided Approach to Mitigate Data Poisoning Attacks in Federated Learning5 Apr 2024
- 2023Kick Bad Guys Out! Conditionally Activated Anomaly Detection in Federated Learning with Zero-Knowledge Proof Verification6 Oct 2023
- 2023Self-Deception: Reverse Penetrating the Semantic Firewall of Large Language Models16 Aug 2023
- 2023FLAIRS: FPGA-Accelerated Inference-Resistant & Secure Federated Learning1 Aug 2023
- 2023Avoid Adversarial Adaption in Federated Learning by Multi-Metric Investigations6 Jun 2023
- 2022FedTracker: Furnishing Ownership Verification and Traceability for Federated Learning Model14 Nov 2022
- 2023Backdoor Attacks and Defenses in Federated Learning: Survey, Challenges and Future Research Directionscited by 33
- 2023On the Vulnerability of Backdoor Defenses for Federated Learningcited by 27
- 2023FreqFed: A Frequency Analysis-Based Approach for Mitigating Poisoning Attacks in Federated Learningcited by 27
- 2022CrowdGuard: Federated Backdoor Detection in Federated Learningcited by 26
- 2023BayBFed: Bayesian Backdoor Defense for Federated Learningcited by 23
- 2023Chameleon: Adapting to Peer Images for Planting Durable Backdoors in Federated Learningcited by 20
- 2023Data and Model Poisoning Backdoor Attacks on Wireless Federated Learning, and the Defense Mechanisms: A Comprehensive Surveycited by 18
- 2022Watermarking in Secure Federated Learning: A Verification Framework Based on Client-Side Backdooringcited by 17
- 2023Backdoor Federated Learning by Poisoning Backdoor-Critical Layerscited by 16
- 2022More is Better (Mostly): On the Backdoor Attacks in Federated Graph Neural Networkscited by 15
- 2023FLShield: A Validation Based Federated Learning Framework to Defend Against Poisoning Attackscited by 15
- 2025Do We Really Need to Design New Byzantine-robust Aggregation Rules?cited by 15
12 most cited of 66 All 66 (JSON)
- 2026Fine-grained Distributed Backdoor Attacks in Federated Learning7 Sep 2026
- 2026Backdoors Leave Structural Traces: FedMAST for Backdoor Detection and Containment in Federated Learning4 Sep 2026
- 2026BackDFL: A Unified Benchmark For Backdoor Attacks and Defenses In Decentralized Federated Learning21 Aug 2026
- 2026Robust Reputation-Driven Crowdsourced Federated Learning9 Aug 2026
- 2026Color Matters: Trigger Color Affects Success in Federated Backdoor Attacks24 Jun 2026
- 2026Your Privacy My Cloak: Backdoor Attacks on Differentially Private Federated Learning15 Jun 2026
- 2026Your Neighbors Know: Leveraging Local Neighborhoods for Backdoor Detection in Decentralized Learning19 May 2026
- 2026When the Server Steps In: Calibrated Updates for Fair Federated Learning8 Jan 2026
- 2025Unveiling Hidden Threats: Using Fractal Triggers to Boost Stealthiness of Distributed Backdoor Attacks in Federated Learning12 Nov 2025
- 2025Enhancing the Effectiveness and Durability of Backdoor Attacks in Federated Learning through Maximizing Task Distinction23 Sep 2025
- 2025MARS: A Malignity-Aware Backdoor Defense in Federated Learning21 Sep 2025
- 2025On the Out-of-Distribution Backdoor Attack for Federated Learning16 Sep 2025
12 newest of 66 All 66 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024Concealing Backdoor Model Updates in Federated Learning by Trigger-Optimized Data Poisoning
- 2024DeTrigger: A Gradient-Centric Approach to Backdoor Attack Mitigation in Federated Learning
- 2025Mingling with the Good to Backdoor Federated Learning
- 2022Sniper Backdoor: Single Client Targeted Backdoor Attack in Federated Learning
- 2023Mitigating Backdoors in Federated Learning with FLD
- 2024FLAIN: Mitigating Backdoor Attacks in Federated Learning via Flipping Weight Updates of Low-Activation Input Neurons
- 2023FilterFL: Knowledge Filtering-based Data-Free Backdoor Defense for Federated Learning
- 2025FedBAP: Backdoor Defense via Benign Adversarial Perturbation in Federated Learning