Invisible Backdoor Attacks Using Data Poisoning in the Frequency Domain
Not on the map. Why?
Abstract (arXiv)
With the broad application of deep neural networks (DNNs), backdoor attacks have gradually attracted attention. Backdoor attacks are insidious, and poisoned models perform well on benign samples and are only triggered when given specific inputs, which cause the neural network to produce incorrect outputs. The state-of-the-art backdoor attack work is implemented by data poisoning, i.e., the attacker injects poisoned samples into the dataset, and the models trained with that dataset are infected with the backdoor. However, most of the triggers used in the current study are fixed patterns patched on a small fraction of an image and are often clearly mislabeled, which is easily detected by humans or defense methods such as Neural Cleanse and SentiNet. Also, it's difficult to be learned by DNNs without mislabeling, as they may ignore small patterns. In this paper, we propose a generalized backdoor attack method based on the frequency domain, which can implement backdoor implantation without mislabeling and accessing the training process. It is invisible to human beings and able to evade the commonly used defense methods. We evaluate our approach in the no-label and clean-label cases on three datasets (CIFAR-10, STL-10, and GTSRB) with two popular scenarios (self-supervised learning and supervised learning). The results show our approach can achieve a high attack success rate (above 90%) on all the tasks without significant performance degradation on main tasks. Also, we evaluate the bypass performance of our approach for different kinds of defenses, including the detection of training data (i.e., Activation Clustering), the preprocessing of inputs (i.e., Filtering), the detection of inputs (i.e., SentiNet), and the detection of models (i.e., Neural Cleanse). The experimental results demonstrate that our approach shows excellent robustness to such defenses.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 37 of its 55 references that are in the map. First posted on arXiv 9 Jul 2022.
Builds on
37 of 55 references.
References · 37
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2013Intriguing properties of neural networkscited by 5,155
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,287
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
25 more
- 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,055
- 2018Spectral Signatures in Backdoor Attackscited by 484
- 2018Detecting Backdoor Attacks on Deep Neural Networks by Activation Clusteringcited by 456
- 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 368
- 2020Reflection Backdoor: A Natural Backdoor Attack on Deep Neural Networkscited by 349
- 2018AllenNLP: A Deep Semantic Natural Language Processing Platformcited by 347
- 2019High Frequency Component Helps Explain the Generalization of Convolutional Neural Networkscited by 310
- 2019A Fourier Perspective on Model Robustness in Computer Visioncited by 288
- 2018Generating Adversarial Examples with Adversarial Networkscited by 258
- 2019A new Backdoor Attack in CNNs by training set corruption without label poisoningcited by 242
- 2020Learning in the Frequency Domaincited by 198
- 2018Training behavior of deep neural network in frequency domaincited by 174
- 2021Rethinking the Backdoor Attacks' Triggers: A Frequency Perspectivecited by 161
- 2018SentiNet: Detecting Localized Universal Attacks Against Deep Learning Systemscited by 152
- 2021Poisoning and Backdooring Contrastive Learningcited by 151
- 2021BadEncoder: Backdoor Attacks to Pre-trained Encoders in Self-Supervised Learningcited by 123
- 2019TABOR: A Highly Accurate Approach to Inspecting and Restoring Trojan Backdoors in AI Systemscited by 122
- 2020Speaker Recognition Based on Deep Learning: An Overviewcited by 59
- 2019Theory of the Frequency Principle for General Deep Neural Networkscited by 46
- 2018Self-supervised learning of a facial attribute embedding from videocited by 45
- 2021Self-Supervised Pillar Motion Learning for Autonomous Drivingcited by 44
- 2019Februus: Input Purification Defense Against Trojan Attacks on Deep Neural Network Systemscited by 27
- 2021Backdoor Attack through Frequency Domaincited by 18
- 2021Self-supervised Speaker Recognition with Loss-gated Learningcited by 14
- 2021Check Your Other Door! Creating Backdoor Attacks in the Frequency Domaincited by 9
Built on by
Citing papers per year: 2023: 3; 2024: 2.
5 papers.
- 2023Backdoor Attacks Against Deep Image Compression via Adaptive Frequency Triggercited by 40
- 2024Backdoor Attacks against No-Reference Image Quality Assessment Models via a Scalable Triggercited by 12
- 2024Robust and Transferable Backdoor Attacks Against Deep Image Compression With Selective Frequency Priorcited by 11
- 2023Look, Listen, and Attack: Backdoor Attacks Against Video Action Recognitioncited by 7
- 2023When Side-Channel Attacks Break the Black-Box Property of Embedded Artificial Intelligencecited by 1
- 2024Backdoor Attacks against No-Reference Image Quality Assessment Models via a Scalable Trigger10 Dec 2024
- 2024Robust and Transferable Backdoor Attacks Against Deep Image Compression With Selective Frequency Prior2 Dec 2024
- 2023When Side-Channel Attacks Break the Black-Box Property of Embedded Artificial Intelligence23 Nov 2023
- 2023Backdoor Attacks Against Deep Image Compression via Adaptive Frequency Trigger28 Feb 2023
- 2023Look, Listen, and Attack: Backdoor Attacks Against Video Action Recognition3 Jan 2023
Similar, not cited
Close in wording, no citation either way
- 2023Towards Invisible Backdoor Attacks in the Frequency Domain against Deep Neural Networks ↗
- 2023Don't FREAK Out: A Frequency-Inspired Approach to Detecting Backdoor Poisoned Samples in DNNs
- 2023Stealthy Low-frequency Backdoor Attack against Deep Neural Networks
- 2023Beating Backdoor Attack at Its Own Game
- 2023Mitigating Backdoors within Deep Neural Networks in Data-limited Configuration
- 2021Anti-Backdoor Learning: Training Clean Models on Poisoned Data
- 2022Backdoor Cleansing with Unlabeled Data
- 2024A Practical Trigger-Free Backdoor Attack on Neural Networks ↗