Watch Out! Simple Horizontal Class Backdoor Can Trivially Evade Defense
Not on the map. Why?
Abstract (arXiv)
All current backdoor attacks on deep learning (DL) models fall under the category of a vertical class backdoor (VCB) -- class-dependent. In VCB attacks, any sample from a class activates the implanted backdoor when the secret trigger is present. Existing defense strategies overwhelmingly focus on countering VCB attacks, especially those that are source-class-agnostic. This narrow focus neglects the potential threat of other simpler yet general backdoor types, leading to false security implications. This study introduces a new, simple, and general type of backdoor attack coined as the horizontal class backdoor (HCB) that trivially breaches the class dependence characteristic of the VCB, bringing a fresh perspective to the community. HCB is now activated when the trigger is presented together with an innocuous feature, regardless of class. For example, the facial recognition model misclassifies a person who wears sunglasses with a smiling innocuous feature into the targeted person, such as an administrator, regardless of which person. The key is that these innocuous features are horizontally shared among classes but are only exhibited by partial samples per class. Extensive experiments on attacking performance across various tasks, including MNIST, facial recognition, traffic sign recognition, object detection, and medical diagnosis, confirm the high efficiency and effectiveness of the HCB. We rigorously evaluated the evasiveness of the HCB against a series of eleven representative countermeasures, including Fine-Pruning (RAID 18'), STRIP (ACSAC 19'), Neural Cleanse (Oakland 19'), ABS (CCS 19'), Februus (ACSAC 20'), NAD (ICLR 21'), MNTD (Oakland 21'), SCAn (USENIX SEC 21'), MOTH (Oakland 22'), Beatrix (NDSS 23'), and MM-BD (Oakland 24'). None of these countermeasures prove robustness, even when employing a simplistic trigger, such as a small and static white-square patch.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 48 of its 93 references that are in the map. First posted on arXiv 1 Oct 2023.
Builds on
48 of 93 references.
References · 48
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,624
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
- 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
- 2018Poison Frogs! Targeted Clean-Label Poisoning Attacks on Neural Networkscited by 500
- 2018Spectral Signatures in Backdoor Attackscited by 457
- 2016Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samplescited by 439
- 2019STRIP: A Defence Against Trojan Attacks on Deep Neural Networkscited by 437
36 more
- 2018Detecting Backdoor Attacks on Deep Neural Networks by Activation Clusteringcited by 429
- 2020Backdoor Learning: A Surveycited by 412
- 2019Hidden Trigger Backdoor Attackscited by 359
- 2020Reflection Backdoor: A Natural Backdoor Attack on Deep Neural Networkscited by 341
- 2020Invisible Backdoor Attack with Sample-Specific Triggerscited by 338
- 2021Neural Attention Distillation: Erasing Backdoor Triggers from Deep Neural Networkscited by 313
- 2020Input-Aware Dynamic Backdoor Attackcited by 304
- 2023Poisoning Web-Scale Training Datasets is Practicalcited by 276
- 2020Data Poisoning Attacks Against Federated Learning Systemscited by 266
- 2021Anti-Backdoor Learning: Training Clean Models on Poisoned Datacited by 258
- 2019BCN20000: Dermoscopic Lesions in the Wildcited by 224
- 2019Detecting AI Trojans Using Meta Neural Analysiscited by 192
- 2020Clean-Label Backdoor Attacks on Video Recognition Modelscited by 162
- 2021Rethinking the Backdoor Attacks' Triggers: A Frequency Perspectivecited by 155
- 2022Backdoor Defense via Decoupling the Training Processcited by 149
- 2018SentiNet: Detecting Localized Universal Attacks Against Deep Learning Systemscited by 148
- 2019Universal Litmus Patterns: Revealing Backdoor Attacks in CNNscited by 143
- 2020Backdoor Attacks Against Deep Learning Systems in the Physical Worldcited by 129
- 2019Demon in the Variant: Statistical Analysis of DNNs for Robust Backdoor Contamination Detectioncited by 121
- 2020Adversarial Machine Learning -- Industry Perspectivescited by 121
- 2020Backdoor Attacks and Countermeasures on Deep Learning: A Comprehensive Reviewcited by 120
- 2020Graph Backdoorcited by 112
- 2020Rethinking the Trigger of Backdoor Attackcited by 76
- 2021Black-box Detection of Backdoor Attacks with Limited Information and Datacited by 71
- 2020Subpopulation Data Poisoning Attackscited by 68
- 2019Design and Evaluation of a Multi-Domain Trojan Detection Method on Deep Neural Networkscited by 66
- 2022The "Beatrix'' Resurrections: Robust Backdoor Detection via Gram Matricescited by 62
- 2018Model-Reuse Attacks on Deep Learning Systemscited by 47
- 2022Training with More Confidence: Mitigating Injected and Natural Backdoors During Trainingcited by 38
- 2020Backdooring and Poisoning Neural Networks with Image-Scaling Attackscited by 28
- 2022BadHash: Invisible Backdoor Attacks against Deep Hashing with Clean Labelcited by 28
- 2022Dangerous Cloaking: Natural Trigger based Backdoor Attacks on Object Detectors in the Physical Worldcited by 20
- 2022Just Rotate it: Deploying Backdoor Attacks via Rotation Transformationcited by 19
- 2021Trojan Signatures in DNN Weightscited by 15
- 2022Towards A Critical Evaluation of Robustness for Deep Learning Backdoor Countermeasurescited by 11
- 2022TransCAB: Transferable Clean-Annotation Backdoor to Object Detection with Natural Trigger in Real-Worldcited by 8
Built on by
Citing papers per year: 2024: 2; 2025: 2; 2026: 3.
7 papers.
- 2024When Machine Unlearning Meets Retrieval-Augmented Generation (RAG): Keep Secret or Forget Knowledge?cited by 20
- 2024FLARE: Toward Universal Dataset Purification against Backdoor Attackscited by 7
- 2025Taught Well Learned Ill: Towards Distillation-conditional Backdoor Attackcited by 3
- 2025ConSeg: Contextual Backdoor Attack Against Semantic Segmentationcited by 0
- 2026PASTA: A Patch-Agnostic Twofold-Stealthy Backdoor Attack on Vision Transformerscited by 0
- 2026Checkerboard: Closed-Form and Data-Independent Trigger Design for Clean-Label Backdoor Attackscited by 0
- 2026When T2I Synthetic Data Backfires: Amplified Privacy Risks in Real-Synthetic Mix Trainingcited by 0
- 2026When T2I Synthetic Data Backfires: Amplified Privacy Risks in Real-Synthetic Mix Training15 Jul 2026
- 2026Checkerboard: Closed-Form and Data-Independent Trigger Design for Clean-Label Backdoor Attacks2 May 2026
- 2026PASTA: A Patch-Agnostic Twofold-Stealthy Backdoor Attack on Vision Transformers21 Apr 2026
- 2025Taught Well Learned Ill: Towards Distillation-conditional Backdoor Attack28 Sep 2025
- 2025ConSeg: Contextual Backdoor Attack Against Semantic Segmentation26 Jul 2025
- 2024FLARE: Toward Universal Dataset Purification against Backdoor Attacks29 Nov 2024
- 2024When Machine Unlearning Meets Retrieval-Augmented Generation (RAG): Keep Secret or Forget Knowledge?20 Oct 2024