Model Agnostic Defence against Backdoor Attacks in Machine Learning
Not on the map. Why?
Abstract (arXiv)
Machine Learning (ML) has automated a multitude of our day-to-day decision making domains such as education, employment and driving automation. The continued success of ML largely depends on our ability to trust the model we are using. Recently, a new class of attacks called Backdoor Attacks have been developed. These attacks undermine the user's trust in ML models. In this work, we present NEO, a model agnostic framework to detect and mitigate such backdoor attacks in image classification ML models. For a given image classification model, our approach analyses the inputs it receives and determines if the model is backdoored. In addition to this feature, we also mitigate these attacks by determining the correct predictions of the poisoned images. An appealing feature of NEO is that it can, for the first time, isolate and reconstruct the backdoor trigger. NEO is also the first defence methodology, to the best of our knowledge that is completely blackbox. We have implemented NEO and evaluated it against three state of the art poisoned models. These models include highly critical applications such as traffic sign detection (USTS) and facial detection. In our evaluation, we show that NEO can detect ≈88% of the poisoned inputs on average and it is as fast as 4.4 ms per input image. We also reconstruct the poisoned input for the user to effectively test their systems.
Key facts. Cited by 52 papers in the map (data through 14 Oct 2026). First posted on arXiv 6 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 14; 2023: 11; 2024: 12; 2025: 6; 2026: 2.
52 papers.
Sort:
By area:
- 2022BackdoorBench: A Comprehensive Benchmark of Backdoor Learningcited by 128
- 2022Measuring the Effect of Training Data on Deep Learning Predictions via Randomized Experimentscited by 50
- 2023Detecting Backdoors During the Inference Stage Based on Corruption Robustness Consistencycited by 46
- 2023Black-box Backdoor Defense via Zero-shot Image Purificationcited by 45
- 2022Towards A Proactive ML Approach for Detecting Backdoor Poison Samplescited by 40
- 2022Fine-Tuning Is All You Need to Mitigate Backdoor Attackscited by 38
- 2021Towards Practical Deployment-Stage Backdoor Attack on Deep Neural Networkscited by 34
- 2021De-Pois: An Attack-Agnostic Defense against Data Poisoning Attackscited by 33
- 2022Identifying a Training-Set Attack's Target Using Renormalized Influence Estimationcited by 32
- 2022Defending Backdoor Attacks on Vision Transformer via Patch Processingcited by 20
- 2024BackdoorBench: A Comprehensive Benchmark and Analysis of Backdoor Learningcited by 19
- 2021Textual Backdoor Attacks Can Be More Harmful via Two Simple Trickscited by 18
38 more
- 2021Backdoor Attack through Frequency Domaincited by 18
- 2022A Survey of Neural Trojan Attacks and Defenses in Deep Learningcited by 17
- 2022Quarantine: Sparsity Can Uncover the Trojan Attack Trigger for Freecited by 15
- 2024Preference Poisoning Attacks on Reward Model Learningcited by 14
- 2025Test-Time Backdoor Detection for Object Detection Modelscited by 14
- 2021WaNet -- Imperceptible Warping-based Backdoor Attackcited by 5
- 2023Influencer Backdoor Attack on Semantic Segmentationcited by 5
- 2024Test-Time Multimodal Backdoor Detection by Contrastive Promptingcited by 5
- 2025DeBackdoor: A Deductive Framework for Detecting Backdoor Attacks on Deep Models with Limited Datacited by 5
- 2021MISA: Online Defense of Trojaned Models using Misattributionscited by 4
- 2023Towards Understanding How Self-training Tolerates Data Backdoor Poisoningcited by 4
- 2023SecurityNet: Assessing Machine Learning Vulnerabilities on Public Modelscited by 4
- 2022Trojan Horse Training for Breaking Defenses against Backdoor Attacks in Deep Learningcited by 3
- 2022Emerging Threats in Deep Learning-Based Autonomous Driving: A Comprehensive Surveycited by 3
- 2023INK: Inheritable Natural Backdoor Attack Against Model Distillationcited by 3
- 2023Adversary Aware Continual Learningcited by 3
- 2024The Art of Deception: Robust Backdoor Attack using Dynamic Stacking of Triggerscited by 3
- 2024BackdoorMBTI: A Backdoor Learning Multimodal Benchmark Tool Kit for Backdoor Defense Evaluationcited by 3
- 2022Learned-Database Systems Securitycited by 2
- 2024On the (In)feasibility of ML Backdoor Detection as an Hypothesis Testing Problemcited by 2
- 2025AnywhereDoor: Multi-Target Backdoor Attacks on Object Detectioncited by 2
- 2025Revisiting Training-Inference Trigger Intensity in Backdoor Attackscited by 2
- 2021CatchBackdoor: Backdoor Detection via Critical Trojan Neural Path Fuzzingcited by 1
- 2023Mask and Restore: Blind Backdoor Defense at Test Time with Masked Autoencodercited by 1
- 2023Pick your Poison: Undetectability versus Robustness in Data Poisoning Attackscited by 1
- 2024Evolutionary Trigger Detection and Lightweight Model Repair Based Backdoor Defensecited by 1
- 2026STEP: Detecting Audio Backdoor Attacks via Stability-based Trigger Exposure Profilingcited by 1
- 2022AntidoteRT: Run-time Detection and Correction of Poison Attacks on Neural Networkscited by 0
- 2022Contributor-Aware Defenses Against Adversarial Backdoor Attackscited by 0
- 2022Confidence Matters: Inspecting Backdoors in Deep Neural Networks via Distribution Transfercited by 0
- 2023Recover Triggered States: Protect Model Against Backdoor Attack in Reinforcement Learningcited by 0
- 2023Mitigating Backdoors within Deep Neural Networks in Data-limited Configurationcited by 0
- 2024BackdoorBench: A Comprehensive Benchmark and Analysis of Backdoor Learningcited by 0
- 2024A general approach to enhance the survivability of backdoor attacks by decision path couplingcited by 0
- 2024Hypnopaedia-Aware Machine Unlearning via Psychometrics of Artificial Mental Imagerycited by 0
- 2024AnywhereDoor: Multi-Target Backdoor Attacks on Object Detectioncited by 0
- 2024An Effective and Resilient Backdoor Attack Framework against Deep Neural Networks and Vision Transformerscited by 0
- 2025NT-ML: Backdoor Defense via Non-target Label Training and Mutual Learningcited by 0
50 most cited of 52 All 52 (JSON)
- 2026STEP: Detecting Audio Backdoor Attacks via Stability-based Trigger Exposure Profiling18 Mar 2026
- 2026Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forward19 Jan 2026
- 2025Localizing Malicious Outputs from CodeLLM21 Sep 2025
- 2025NT-ML: Backdoor Defense via Non-target Label Training and Mutual Learning7 Aug 2025
- 2025DeBackdoor: A Deductive Framework for Detecting Backdoor Attacks on Deep Models with Limited Data27 Mar 2025
- 2025Test-Time Backdoor Detection for Object Detection Models19 Mar 2025
- 2025Revisiting Training-Inference Trigger Intensity in Backdoor Attacks15 Mar 2025
- 2025AnywhereDoor: Multi-Target Backdoor Attacks on Object Detection9 Mar 2025
- 2024An Effective and Resilient Backdoor Attack Framework against Deep Neural Networks and Vision Transformers9 Dec 2024
- 2024AnywhereDoor: Multi-Target Backdoor Attacks on Object Detection21 Nov 2024
- 2024BackdoorMBTI: A Backdoor Learning Multimodal Benchmark Tool Kit for Backdoor Defense Evaluation17 Nov 2024
- 2024Hypnopaedia-Aware Machine Unlearning via Psychometrics of Artificial Mental Imagery29 Sep 2024
38 more
- 2024BackdoorBench: A Comprehensive Benchmark and Analysis of Backdoor Learning29 Jul 2024
- 2024Evolutionary Trigger Detection and Lightweight Model Repair Based Backdoor Defense7 Jul 2024
- 2024Test-Time Multimodal Backdoor Detection by Contrastive Prompting24 May 2024
- 2024A general approach to enhance the survivability of backdoor attacks by decision path coupling5 Mar 2024
- 2024On the (In)feasibility of ML Backdoor Detection as an Hypothesis Testing Problem26 Feb 2024
- 2024Preference Poisoning Attacks on Reward Model Learning2 Feb 2024
- 2024BackdoorBench: A Comprehensive Benchmark and Analysis of Backdoor Learning26 Jan 2024
- 2024The Art of Deception: Robust Backdoor Attack using Dynamic Stacking of Triggers3 Jan 2024
- 2023Mitigating Backdoors within Deep Neural Networks in Data-limited Configuration13 Nov 2023
- 2023SecurityNet: Assessing Machine Learning Vulnerabilities on Public Models19 Oct 2023
- 2023Pick your Poison: Undetectability versus Robustness in Data Poisoning Attacks7 May 2023
- 2023Adversary Aware Continual Learning27 Apr 2023
- 2023INK: Inheritable Natural Backdoor Attack Against Model Distillation21 Apr 2023
- 2023Recover Triggered States: Protect Model Against Backdoor Attack in Reinforcement Learning1 Apr 2023
- 2023Detecting Backdoors During the Inference Stage Based on Corruption Robustness Consistency27 Mar 2023
- 2023Mask and Restore: Blind Backdoor Defense at Test Time with Masked Autoencoder27 Mar 2023
- 2023Black-box Backdoor Defense via Zero-shot Image Purification21 Mar 2023
- 2023Influencer Backdoor Attack on Semantic Segmentation21 Mar 2023
- 2023Towards Understanding How Self-training Tolerates Data Backdoor Poisoning20 Jan 2023
- 2022Learned-Database Systems Security20 Dec 2022
- 2022Fine-Tuning Is All You Need to Mitigate Backdoor Attacks18 Dec 2022
- 2022Emerging Threats in Deep Learning-Based Autonomous Driving: A Comprehensive Survey19 Oct 2022
- 2022Confidence Matters: Inspecting Backdoors in Deep Neural Networks via Distribution Transfer13 Aug 2022
- 2022BackdoorBench: A Comprehensive Benchmark of Backdoor Learning25 Jun 2022
- 2022Defending Backdoor Attacks on Vision Transformer via Patch Processing24 Jun 2022
- 2022Measuring the Effect of Training Data on Deep Learning Predictions via Randomized Experiments20 Jun 2022
- 2022Contributor-Aware Defenses Against Adversarial Backdoor Attacks28 May 2022
- 2022Towards A Proactive ML Approach for Detecting Backdoor Poison Samples26 May 2022
- 2022Quarantine: Sparsity Can Uncover the Trojan Attack Trigger for Free24 May 2022
- 2022Trojan Horse Training for Breaking Defenses against Backdoor Attacks in Deep Learning25 Mar 2022
- 2022A Survey of Neural Trojan Attacks and Defenses in Deep Learning15 Feb 2022
- 2022AntidoteRT: Run-time Detection and Correction of Poison Attacks on Neural Networks31 Jan 2022
- 2022Identifying a Training-Set Attack's Target Using Renormalized Influence Estimation25 Jan 2022
- 2021CatchBackdoor: Backdoor Detection via Critical Trojan Neural Path Fuzzing24 Dec 2021
- 2021Towards Practical Deployment-Stage Backdoor Attack on Deep Neural Networks25 Nov 2021
- 2021Backdoor Attack through Frequency Domain22 Nov 2021
- 2021Textual Backdoor Attacks Can Be More Harmful via Two Simple Tricks15 Oct 2021
- 2021De-Pois: An Attack-Agnostic Defense against Data Poisoning Attacks8 May 2021
50 newest of 52 All 52 (JSON)
- 2021De-Pois: An Attack-Agnostic Defense against Data Poisoning Attackscited by 33
- 2022Defending Backdoor Attacks on Vision Transformer via Patch Processingcited by 20
- 2021Textual Backdoor Attacks Can Be More Harmful via Two Simple Trickscited by 18
- 2024Test-Time Multimodal Backdoor Detection by Contrastive Promptingcited by 5
- 2023SecurityNet: Assessing Machine Learning Vulnerabilities on Public Modelscited by 4
- 2023Adversary Aware Continual Learningcited by 3
- 2024BackdoorMBTI: A Backdoor Learning Multimodal Benchmark Tool Kit for Backdoor Defense Evaluationcited by 3
- 2023Mask and Restore: Blind Backdoor Defense at Test Time with Masked Autoencodercited by 1
- 2023Pick your Poison: Undetectability versus Robustness in Data Poisoning Attackscited by 1
- 2022AntidoteRT: Run-time Detection and Correction of Poison Attacks on Neural Networkscited by 0
- 2024Hypnopaedia-Aware Machine Unlearning via Psychometrics of Artificial Mental Imagerycited by 0
- 2024An Effective and Resilient Backdoor Attack Framework against Deep Neural Networks and Vision Transformerscited by 0
12 most cited of 13 All 13 (JSON)
- 2025Localizing Malicious Outputs from CodeLLM21 Sep 2025
- 2024An Effective and Resilient Backdoor Attack Framework against Deep Neural Networks and Vision Transformers9 Dec 2024
- 2024BackdoorMBTI: A Backdoor Learning Multimodal Benchmark Tool Kit for Backdoor Defense Evaluation17 Nov 2024
- 2024Hypnopaedia-Aware Machine Unlearning via Psychometrics of Artificial Mental Imagery29 Sep 2024
- 2024Test-Time Multimodal Backdoor Detection by Contrastive Prompting24 May 2024
- 2023SecurityNet: Assessing Machine Learning Vulnerabilities on Public Models19 Oct 2023
- 2023Pick your Poison: Undetectability versus Robustness in Data Poisoning Attacks7 May 2023
- 2023Adversary Aware Continual Learning27 Apr 2023
- 2023Mask and Restore: Blind Backdoor Defense at Test Time with Masked Autoencoder27 Mar 2023
- 2022Defending Backdoor Attacks on Vision Transformer via Patch Processing24 Jun 2022
- 2022AntidoteRT: Run-time Detection and Correction of Poison Attacks on Neural Networks31 Jan 2022
- 2021Textual Backdoor Attacks Can Be More Harmful via Two Simple Tricks15 Oct 2021
12 newest of 13 All 13 (JSON)
- 2024Preference Poisoning Attacks on Reward Model Learningcited by 14
- 2024Preference Poisoning Attacks on Reward Model Learning2 Feb 2024
- 2022BackdoorBench: A Comprehensive Benchmark of Backdoor Learningcited by 128
- 2022Measuring the Effect of Training Data on Deep Learning Predictions via Randomized Experimentscited by 50
- 2023Detecting Backdoors During the Inference Stage Based on Corruption Robustness Consistencycited by 46
- 2023Black-box Backdoor Defense via Zero-shot Image Purificationcited by 45
- 2022Towards A Proactive ML Approach for Detecting Backdoor Poison Samplescited by 40
- 2022Fine-Tuning Is All You Need to Mitigate Backdoor Attackscited by 38
- 2021Towards Practical Deployment-Stage Backdoor Attack on Deep Neural Networkscited by 34
- 2022Identifying a Training-Set Attack's Target Using Renormalized Influence Estimationcited by 32
- 2024BackdoorBench: A Comprehensive Benchmark and Analysis of Backdoor Learningcited by 19
- 2021Backdoor Attack through Frequency Domaincited by 18
- 2022A Survey of Neural Trojan Attacks and Defenses in Deep Learningcited by 17
- 2022Quarantine: Sparsity Can Uncover the Trojan Attack Trigger for Freecited by 15
12 most cited of 38 All 38 (JSON)
- 2026STEP: Detecting Audio Backdoor Attacks via Stability-based Trigger Exposure Profiling18 Mar 2026
- 2026Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forward19 Jan 2026
- 2025NT-ML: Backdoor Defense via Non-target Label Training and Mutual Learning7 Aug 2025
- 2025DeBackdoor: A Deductive Framework for Detecting Backdoor Attacks on Deep Models with Limited Data27 Mar 2025
- 2025Test-Time Backdoor Detection for Object Detection Models19 Mar 2025
- 2025Revisiting Training-Inference Trigger Intensity in Backdoor Attacks15 Mar 2025
- 2025AnywhereDoor: Multi-Target Backdoor Attacks on Object Detection9 Mar 2025
- 2024AnywhereDoor: Multi-Target Backdoor Attacks on Object Detection21 Nov 2024
- 2024BackdoorBench: A Comprehensive Benchmark and Analysis of Backdoor Learning29 Jul 2024
- 2024Evolutionary Trigger Detection and Lightweight Model Repair Based Backdoor Defense7 Jul 2024
- 2024A general approach to enhance the survivability of backdoor attacks by decision path coupling5 Mar 2024
- 2024On the (In)feasibility of ML Backdoor Detection as an Hypothesis Testing Problem26 Feb 2024
12 newest of 38 All 38 (JSON)