mlsanityData to 7 Oct 2026

Explore the Effect of Data Selection on Poison Efficiency in Backdoor Attacks

arXiv 2310.09744 ↗First posted 15 Oct 2023cs.CR cs.CV cs.CYcited by 7

Not on the map. Why?

Abstract (arXiv)

As the number of parameters in Deep Neural Networks (DNNs) scales, the thirst for training data also increases. To save costs, it has become common for users and enterprises to delegate time-consuming data collection to third parties. Unfortunately, recent research has shown that this practice raises the risk of DNNs being exposed to backdoor attacks. Specifically, an attacker can maliciously control the behavior of a trained model by poisoning a small portion of the training data. In this study, we focus on improving the poisoning efficiency of backdoor attacks from the sample selection perspective. The existing attack methods construct such poisoned samples by randomly selecting some clean data from the benign set and then embedding a trigger into them. However, this random selection strategy ignores that each sample may contribute differently to the backdoor injection, thereby reducing the poisoning efficiency. To address the above problem, a new selection strategy named Improved Filtering and Updating Strategy (FUS++) is proposed. Specifically, we adopt the forgetting events of the samples to indicate the contribution of different poisoned samples and use the curvature of the loss surface to analyses the effectiveness of this phenomenon. Accordingly, we combine forgetting events and curvature of different samples to conduct a simple yet efficient sample selection strategy. The experimental results on image classification (CIFAR-10, CIFAR-100, ImageNet-10), text classification (AG News), audio classification (ESC-50), and age regression (Facial Age) consistently demonstrate the effectiveness of the proposed strategy: the attack performance using FUS++ is significantly higher than that using random selection for the same poisoning ratio.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 42 of its 67 references that are in the map. First posted on arXiv 15 Oct 2023.

Builds on

42 of 67 references.

References · 42

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  6. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  7. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  8. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  9. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  10. 2022Generative Adversarial Networkscited by 5,603
  11. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  12. 2013Intriguing properties of neural networkscited by 5,114
30 more
  1. 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
  2. 2016Identity Mappings in Deep Residual Networkscited by 1,960
  3. 2019A Comprehensive Survey on Transfer Learningcited by 1,154
  4. 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
  5. 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
  6. 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 669
  7. 2016Deep Transfer Learning with Joint Adaptation Networkscited by 609
  8. 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 550
  9. 2017Sharp Minima Can Generalize For Deep Netscited by 462
  10. 2020Backdoor Learning: A Surveycited by 412
  11. 2019Selection via Proxy: Efficient Data Selection for Deep Learningcited by 337
  12. 2018Not All Samples Are Created Equal: Deep Learning with Importance Samplingcited by 323
  13. 2020Weight Poisoning Attacks on Pre-trained Modelscited by 318
  14. 2019Label-Consistent Backdoor Attackscited by 285
  15. 2021GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Trainingcited by 269
  16. 2015Beyond Short Snippets: Deep Networks for Video Classificationcited by 233
  17. 2018Robustness via curvature regularization, and vice versacited by 174
  18. 2020Clean-Label Backdoor Attacks on Video Recognition Modelscited by 162
  19. 2019Neural-Symbolic Computing: An Effective Methodology for Principled Integration of Machine Learning and Reasoningcited by 149
  20. 2018Backdoor Embedding in Convolutional Neural Network Models via Invisible Perturbationcited by 131
  21. 2018Backdooring Convolutional Neural Networks via Targeted Weight Perturbationscited by 66
  22. 2017Data-efficient Deep Reinforcement Learning for Dexterous Manipulationcited by 61
  23. 2022A Comprehensive Survey on Data-Efficient GANs in Image Generationcited by 20
  24. 2022Visualizing high-dimensional loss landscapes with Hessian directionscited by 16
  25. 2021Enhancing Backdoor Attacks with Multi-Level MMD Regularizationcited by 15
  26. 2022Data-Efficient Backdoor Attackscited by 13
  27. 2019GradVis: Visualization and Second Order Analysis of Optimization Surfaces during the Training of Deep Neural Networkscited by 5
  28. 2023A Proxy Attack-Free Strategy for Practically Improving the Poisoning Efficiency in Backdoor Attackscited by 5
  29. 2020Improving Resistance to Adversarial Deformations by Regularizing Gradientscited by 3
  30. 2021Tightening the Approximation Error of Adversarial Risk with Auto Loss Function Searchcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 2; 2025: 3; 2026: 1.

7 papers.