mlsanityData to 14 Oct 2026

Invisible Backdoor Attacks Using Data Poisoning in the Frequency Domain

arXiv 2207.04209 ↗First posted 9 Jul 2022cs.LG cs.CRcited by 5

Not on the map. Why?

Abstract (arXiv)

With the broad application of deep neural networks (DNNs), backdoor attacks have gradually attracted attention. Backdoor attacks are insidious, and poisoned models perform well on benign samples and are only triggered when given specific inputs, which cause the neural network to produce incorrect outputs. The state-of-the-art backdoor attack work is implemented by data poisoning, i.e., the attacker injects poisoned samples into the dataset, and the models trained with that dataset are infected with the backdoor. However, most of the triggers used in the current study are fixed patterns patched on a small fraction of an image and are often clearly mislabeled, which is easily detected by humans or defense methods such as Neural Cleanse and SentiNet. Also, it's difficult to be learned by DNNs without mislabeling, as they may ignore small patterns. In this paper, we propose a generalized backdoor attack method based on the frequency domain, which can implement backdoor implantation without mislabeling and accessing the training process. It is invisible to human beings and able to evade the commonly used defense methods. We evaluate our approach in the no-label and clean-label cases on three datasets (CIFAR-10, STL-10, and GTSRB) with two popular scenarios (self-supervised learning and supervised learning). The results show our approach can achieve a high attack success rate (above 90%) on all the tasks without significant performance degradation on main tasks. Also, we evaluate the bypass performance of our approach for different kinds of defenses, including the detection of training data (i.e., Activation Clustering), the preprocessing of inputs (i.e., Filtering), the detection of inputs (i.e., SentiNet), and the detection of models (i.e., Neural Cleanse). The experimental results demonstrate that our approach shows excellent robustness to such defenses.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 37 of its 55 references that are in the map. First posted on arXiv 9 Jul 2022.

Builds on

37 of 55 references.

References · 37

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  5. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  6. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  7. 2013Intriguing properties of neural networkscited by 5,155
  8. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  9. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  10. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
  11. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,287
  12. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
25 more
  1. 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,055
  2. 2018Spectral Signatures in Backdoor Attackscited by 484
  3. 2018Detecting Backdoor Attacks on Deep Neural Networks by Activation Clusteringcited by 456
  4. 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 368
  5. 2020Reflection Backdoor: A Natural Backdoor Attack on Deep Neural Networkscited by 349
  6. 2018AllenNLP: A Deep Semantic Natural Language Processing Platformcited by 347
  7. 2019High Frequency Component Helps Explain the Generalization of Convolutional Neural Networkscited by 310
  8. 2019A Fourier Perspective on Model Robustness in Computer Visioncited by 288
  9. 2018Generating Adversarial Examples with Adversarial Networkscited by 258
  10. 2019A new Backdoor Attack in CNNs by training set corruption without label poisoningcited by 242
  11. 2020Learning in the Frequency Domaincited by 198
  12. 2018Training behavior of deep neural network in frequency domaincited by 174
  13. 2021Rethinking the Backdoor Attacks' Triggers: A Frequency Perspectivecited by 161
  14. 2018SentiNet: Detecting Localized Universal Attacks Against Deep Learning Systemscited by 152
  15. 2021Poisoning and Backdooring Contrastive Learningcited by 151
  16. 2021BadEncoder: Backdoor Attacks to Pre-trained Encoders in Self-Supervised Learningcited by 123
  17. 2019TABOR: A Highly Accurate Approach to Inspecting and Restoring Trojan Backdoors in AI Systemscited by 122
  18. 2020Speaker Recognition Based on Deep Learning: An Overviewcited by 59
  19. 2019Theory of the Frequency Principle for General Deep Neural Networkscited by 46
  20. 2018Self-supervised learning of a facial attribute embedding from videocited by 45
  21. 2021Self-Supervised Pillar Motion Learning for Autonomous Drivingcited by 44
  22. 2019Februus: Input Purification Defense Against Trojan Attacks on Deep Neural Network Systemscited by 27
  23. 2021Backdoor Attack through Frequency Domaincited by 18
  24. 2021Self-supervised Speaker Recognition with Loss-gated Learningcited by 14
  25. 2021Check Your Other Door! Creating Backdoor Attacks in the Frequency Domaincited by 9

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 2.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Towards Invisible Backdoor Attacks in the Frequency Domain against Deep Neural Networks ↗
  2. 2023Don't FREAK Out: A Frequency-Inspired Approach to Detecting Backdoor Poisoned Samples in DNNs
  3. 2023Stealthy Low-frequency Backdoor Attack against Deep Neural Networks
  4. 2023Beating Backdoor Attack at Its Own Game
  5. 2023Mitigating Backdoors within Deep Neural Networks in Data-limited Configuration
  6. 2021Anti-Backdoor Learning: Training Clean Models on Poisoned Data
  7. 2022Backdoor Cleansing with Unlabeled Data
  8. 2024A Practical Trigger-Free Backdoor Attack on Neural Networks ↗