Poison Attacks against Text Datasets with Conditional Adversarially Regularized Autoencoder
Not on the map. Why?
Abstract (arXiv)
This paper demonstrates a fatal vulnerability in natural language inference (NLI) and text classification systems. More concretely, we present a 'backdoor poisoning' attack on NLP models. Our poisoning attack utilizes conditional adversarially regularized autoencoder (CARA) to generate poisoned training samples by poison injection in latent space. Just by adding 1% poisoned data, our experiments show that a victim BERT finetuned classifier's predictions can be steered to the poison target class with success rates of >80% when the input hypothesis is injected with the poison signature, demonstrating that NLI and text classification systems face a huge security risk.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 9; 2023: 7; 2024: 4; 2025: 1.
27 papers.
Sort:
By area:
- 2023Poisoning Language Models During Instruction Tuningcited by 254
- 2022Impact of Pretraining Term Frequencies on Few-Shot Reasoningcited by 142
- 2024What is in Your Safe Data? Identifying Benign Data that Breaks Safetycited by 114
- 2021RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Modelscited by 97
- 2021Be Careful about Poisoned Word Embeddings: Exploring the Vulnerability of the Embedding Layers in NLP Modelscited by 96
- 2022A Study of the Attention Abnormality in Trojaned BERTscited by 47
- 2022BITE: Textual Backdoor Attacks with Iterative Trigger Injectioncited by 47
- 2023TrojanPuzzle: Covertly Poisoning Code-Suggestion Modelscited by 47
- 2021Red Alarm for Pre-trained Models: Universal Vulnerability to Neuron-Level Backdoor Attackscited by 44
- 2021CoProtector: Protect Open-Source Code against Unauthorized Training Usage with Data Poisoningcited by 39
- 2021Revisiting Methods for Finding Influential Examplescited by 39
- 2022Rethinking the Reverse-engineering of Trojan Triggerscited by 37
15 more
- 2023Did You Train on My Dataset? Towards Public Dataset Protection with Clean-Label Backdoor Watermarkingcited by 37
- 2024PoisonBench: Assessing Large Language Model Vulnerability to Data Poisoningcited by 31
- 2022Kallima: A Clean-label Framework for Textual Backdoor Attackscited by 22
- 2022Rank List Sensitivity of Recommender Systems to Interaction Perturbationscited by 20
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspectivecited by 19
- 2023Large Language Models Are Better Adversaries: Exploring Generative Clean-Label Backdoor Attacks Against Text Classifierscited by 14
- 2023BDMMT: Backdoor Sample Detection for Language Models through Model Mutation Testingcited by 13
- 2022A Survey on AI Sustainability: Emerging Trends on Learning Algorithms and Research Challengescited by 7
- 2022Attention Hijacking in Trojan Transformerscited by 6
- 2024SpamDam: Towards Privacy-Preserving and Adversary-Resistant SMS Spam Detectioncited by 3
- 2025The Ultimate Cookbook for Invisible Poison: Crafting Subtle Clean-Label Text Backdoors with Style Attributescited by 2
- 2021Classification Auto-Encoder based Detector against Diverse Data Poisoning Attackscited by 1
- 2022Detecting Backdoors in Deep Text Classifierscited by 0
- 2023Context Matters: Data-Efficient Augmentation of Large Language Models for Scientific Applicationscited by 0
- 2024Manipulating Predictions over Discrete Inputs in Machine Teachingcited by 0
- 2025The Ultimate Cookbook for Invisible Poison: Crafting Subtle Clean-Label Text Backdoors with Style Attributes24 Apr 2025
- 2024PoisonBench: Assessing Large Language Model Vulnerability to Data Poisoning11 Oct 2024
- 2024SpamDam: Towards Privacy-Preserving and Adversary-Resistant SMS Spam Detection15 Apr 2024
- 2024What is in Your Safe Data? Identifying Benign Data that Breaks Safety1 Apr 2024
- 2024Manipulating Predictions over Discrete Inputs in Machine Teaching31 Jan 2024
- 2023Context Matters: Data-Efficient Augmentation of Large Language Models for Scientific Applications12 Dec 2023
- 2023Large Language Models Are Better Adversaries: Exploring Generative Clean-Label Backdoor Attacks Against Text Classifiers28 Oct 2023
- 2023Poisoning Language Models During Instruction Tuning1 May 2023
- 2023Did You Train on My Dataset? Towards Public Dataset Protection with Clean-Label Backdoor Watermarking20 Mar 2023
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspective19 Feb 2023
- 2023BDMMT: Backdoor Sample Detection for Language Models through Model Mutation Testing25 Jan 2023
- 2023TrojanPuzzle: Covertly Poisoning Code-Suggestion Models6 Jan 2023
15 more
- 2022Rethinking the Reverse-engineering of Trojan Triggers27 Oct 2022
- 2022Detecting Backdoors in Deep Text Classifiers11 Oct 2022
- 2022Attention Hijacking in Trojan Transformers9 Aug 2022
- 2022Kallima: A Clean-label Framework for Textual Backdoor Attacks3 Jun 2022
- 2022BITE: Textual Backdoor Attacks with Iterative Trigger Injection25 May 2022
- 2022A Study of the Attention Abnormality in Trojaned BERTs13 May 2022
- 2022A Survey on AI Sustainability: Emerging Trends on Learning Algorithms and Research Challenges8 May 2022
- 2022Impact of Pretraining Term Frequencies on Few-Shot Reasoning15 Feb 2022
- 2022Rank List Sensitivity of Recommender Systems to Interaction Perturbations29 Jan 2022
- 2021Revisiting Methods for Finding Influential Examples8 Nov 2021
- 2021CoProtector: Protect Open-Source Code against Unauthorized Training Usage with Data Poisoning25 Oct 2021
- 2021RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models15 Oct 2021
- 2021Classification Auto-Encoder based Detector against Diverse Data Poisoning Attacks9 Aug 2021
- 2021Be Careful about Poisoned Word Embeddings: Exploring the Vulnerability of the Embedding Layers in NLP Models29 Mar 2021
- 2021Red Alarm for Pre-trained Models: Universal Vulnerability to Neuron-Level Backdoor Attacks18 Jan 2021
- 2024What is in Your Safe Data? Identifying Benign Data that Breaks Safetycited by 114
- 2021RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Modelscited by 97
- 2021Be Careful about Poisoned Word Embeddings: Exploring the Vulnerability of the Embedding Layers in NLP Modelscited by 96
- 2022BITE: Textual Backdoor Attacks with Iterative Trigger Injectioncited by 47
- 2021CoProtector: Protect Open-Source Code against Unauthorized Training Usage with Data Poisoningcited by 39
- 2022Rethinking the Reverse-engineering of Trojan Triggerscited by 37
- 2024PoisonBench: Assessing Large Language Model Vulnerability to Data Poisoningcited by 31
- 2022Kallima: A Clean-label Framework for Textual Backdoor Attackscited by 22
- 2023Large Language Models Are Better Adversaries: Exploring Generative Clean-Label Backdoor Attacks Against Text Classifierscited by 14
- 2023BDMMT: Backdoor Sample Detection for Language Models through Model Mutation Testingcited by 13
- 2025The Ultimate Cookbook for Invisible Poison: Crafting Subtle Clean-Label Text Backdoors with Style Attributescited by 2
- 2021Classification Auto-Encoder based Detector against Diverse Data Poisoning Attackscited by 1
12 most cited of 13 All 13 (JSON)
- 2025The Ultimate Cookbook for Invisible Poison: Crafting Subtle Clean-Label Text Backdoors with Style Attributes24 Apr 2025
- 2024PoisonBench: Assessing Large Language Model Vulnerability to Data Poisoning11 Oct 2024
- 2024What is in Your Safe Data? Identifying Benign Data that Breaks Safety1 Apr 2024
- 2023Large Language Models Are Better Adversaries: Exploring Generative Clean-Label Backdoor Attacks Against Text Classifiers28 Oct 2023
- 2023BDMMT: Backdoor Sample Detection for Language Models through Model Mutation Testing25 Jan 2023
- 2022Rethinking the Reverse-engineering of Trojan Triggers27 Oct 2022
- 2022Detecting Backdoors in Deep Text Classifiers11 Oct 2022
- 2022Kallima: A Clean-label Framework for Textual Backdoor Attacks3 Jun 2022
- 2022BITE: Textual Backdoor Attacks with Iterative Trigger Injection25 May 2022
- 2021CoProtector: Protect Open-Source Code against Unauthorized Training Usage with Data Poisoning25 Oct 2021
- 2021RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models15 Oct 2021
- 2021Classification Auto-Encoder based Detector against Diverse Data Poisoning Attacks9 Aug 2021
12 newest of 13 All 13 (JSON)
- 2022Impact of Pretraining Term Frequencies on Few-Shot Reasoningcited by 142
- 2022Impact of Pretraining Term Frequencies on Few-Shot Reasoning15 Feb 2022
- 2023Poisoning Language Models During Instruction Tuningcited by 254
- 2022A Study of the Attention Abnormality in Trojaned BERTscited by 47
- 2023TrojanPuzzle: Covertly Poisoning Code-Suggestion Modelscited by 47
- 2021Red Alarm for Pre-trained Models: Universal Vulnerability to Neuron-Level Backdoor Attackscited by 44
- 2021Revisiting Methods for Finding Influential Examplescited by 39
- 2023Did You Train on My Dataset? Towards Public Dataset Protection with Clean-Label Backdoor Watermarkingcited by 37
- 2022Rank List Sensitivity of Recommender Systems to Interaction Perturbationscited by 20
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspectivecited by 19
- 2022A Survey on AI Sustainability: Emerging Trends on Learning Algorithms and Research Challengescited by 7
- 2022Attention Hijacking in Trojan Transformerscited by 6
- 2024SpamDam: Towards Privacy-Preserving and Adversary-Resistant SMS Spam Detectioncited by 3
- 2023Context Matters: Data-Efficient Augmentation of Large Language Models for Scientific Applicationscited by 0
12 most cited of 13 All 13 (JSON)
- 2024SpamDam: Towards Privacy-Preserving and Adversary-Resistant SMS Spam Detection15 Apr 2024
- 2024Manipulating Predictions over Discrete Inputs in Machine Teaching31 Jan 2024
- 2023Context Matters: Data-Efficient Augmentation of Large Language Models for Scientific Applications12 Dec 2023
- 2023Poisoning Language Models During Instruction Tuning1 May 2023
- 2023Did You Train on My Dataset? Towards Public Dataset Protection with Clean-Label Backdoor Watermarking20 Mar 2023
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspective19 Feb 2023
- 2023TrojanPuzzle: Covertly Poisoning Code-Suggestion Models6 Jan 2023
- 2022Attention Hijacking in Trojan Transformers9 Aug 2022
- 2022A Study of the Attention Abnormality in Trojaned BERTs13 May 2022
- 2022A Survey on AI Sustainability: Emerging Trends on Learning Algorithms and Research Challenges8 May 2022
- 2022Rank List Sensitivity of Recommender Systems to Interaction Perturbations29 Jan 2022
- 2021Revisiting Methods for Finding Influential Examples8 Nov 2021
12 newest of 13 All 13 (JSON)