mlsanityData to 7 Oct 2026

Large Language Models are Good Attackers: Efficient and Stealthy Textual Backdoor Attacks

arXiv 2408.11587 ↗First posted 21 Aug 2024cs.CL cs.CRcited by 2

On the map: LLM safety and security → Backdoor and data poisoning attacks

Abstract (arXiv)

With the burgeoning advancements in the field of natural language processing (NLP), the demand for training data has increased significantly. To save costs, it has become common for users and businesses to outsource the labor-intensive task of data collection to third-party entities. Unfortunately, recent research has unveiled the inherent risk associated with this practice, particularly in exposing NLP systems to potential backdoor attacks. Specifically, these attacks enable malicious control over the behavior of a trained model by poisoning a small portion of the training data. Unlike backdoor attacks in computer vision, textual backdoor attacks impose stringent requirements for attack stealthiness. However, existing attack methods meet significant trade-off between effectiveness and stealthiness, largely due to the high information entropy inherent in textual data. In this paper, we introduce the Efficient and Stealthy Textual backdoor attack method, EST-Bad, leveraging Large Language Models (LLMs). Our EST-Bad encompasses three core strategies: optimizing the inherent flaw of models as the trigger, stealthily injecting triggers with LLMs, and meticulously selecting the most impactful samples for backdoor injection. Through the integration of these techniques, EST-Bad demonstrates an efficient achievement of competitive attack performance while maintaining superior stealthiness compared to prior methods across various text classifier datasets.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Backdoor and data poisoning attacks, one of 12 directions in LLM safety and security. Builds on 48 of its 62 references that are in the map. First posted on arXiv 21 Aug 2024.

Builds on

48 of 62 references.

Closest ancestors · 12

Same direction, newest first

  1. 2023Efficient Trigger Word Insertion23 Nov
  2. 2023Setting the Trap: Capturing and Defeating Backdoors in Pretrained Language Models through Honeypots28 Oct
  3. 2023Large Language Models Are Better Adversaries: Exploring Generative Clean-Label Backdoor Attacks Against Text Classifiers28 Oct
  4. 2023ChatGPT as an Attack Tool: Stealthy Textual Backdoor Attack via Blackbox Generative Model Trigger27 Apr
  5. 2022A Unified Evaluation of Textual Backdoor Learning: Frameworks and Benchmarks17 Jun
  6. 2022Kallima: A Clean-label Framework for Textual Backdoor Attacks3 Jun
  7. 2022Constrained Optimization with Dynamic Bound-scaling for Effective NLPBackdoor Defense11 Feb
  8. 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfer14 Oct
  9. 2021Turn the Combination Lock: Learnable Textual Backdoor Attacks via Word Substitution11 Jun
  10. 2021Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger26 May
  11. 2021Rethinking the Backdoor Attacks' Triggers: A Frequency Perspective7 Apr
  12. 2021Be Careful about Poisoned Word Embeddings: Exploring the Vulnerability of the Embedding Layers in NLP Models29 Mar

Other references · 36

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  4. 2013Intriguing properties of neural networkscited by 5,114
  5. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  6. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  7. 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
  8. 2019A Comprehensive Survey on Transfer Learningcited by 1,154
  9. 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
  10. 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
  11. 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 724
  12. 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 709
24 more
  1. 2020Pre-trained Models for Natural Language Processing: A Surveycited by 504
  2. 2020Backdoor Learning: A Surveycited by 412
  3. 2019How to Fine-Tune BERT for Text Classification?cited by 409
  4. 2020Reflection Backdoor: A Natural Backdoor Attack on Deep Neural Networkscited by 341
  5. 2020Invisible Backdoor Attack with Sample-Specific Triggerscited by 338
  6. 2020Weight Poisoning Attacks on Pre-trained Modelscited by 318
  7. 2020ONION: A Simple and Effective Defense Against Textual Backdoor Attackscited by 231
  8. 2019A backdoor attack against LSTM-based text classification systemscited by 214
  9. 2019Detecting AI Trojans Using Meta Neural Analysiscited by 192
  10. 2020BadNL: Backdoor Attacks against NLP Models with Semantic-preserving Improvementscited by 191
  11. 2018Backdoor Embedding in Convolutional Neural Network Models via Invisible Perturbationcited by 131
  12. 2020Deep Feature Space Trojan Attack of Neural Networks by Controlled Detoxificationcited by 93
  13. 2020Mitigating backdoor attacks in LSTM-based Text Classification Systems by Backdoor Keyword Identificationcited by 80
  14. 2020Trojaning Language Models for Fun and Profitcited by 80
  15. 2019Design and Evaluation of a Multi-Domain Trojan Detection Method on Deep Neural Networkscited by 66
  16. 2021FIBA: Frequency-Injection based Backdoor Attack in Medical Image Analysiscited by 60
  17. 2023CHEAT: A Large-scale Dataset for Detecting ChatGPT-writtEn AbsTractscited by 39
  18. 2020A Systematic Survey of Regularization and Normalization in GANscited by 27
  19. 2022Just Rotate it: Deploying Backdoor Attacks via Rotation Transformationcited by 19
  20. 2022Data-Efficient Backdoor Attackscited by 13
  21. 2020A New Perspective on Stabilizing GANs training: Direct Adversarial Trainingcited by 12
  22. 2022A temporal chrominance trigger for clean-label backdoor attack against anti-spoof rebroadcast detectioncited by 10
  23. 2023Efficient Backdoor Attacks for Deep Neural Networks in Real-world Scenarioscited by 7
  24. 2023Explore the Effect of Data Selection on Poison Efficiency in Backdoor Attackscited by 7

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.