Token-Modification Adversarial Attacks for Natural Language Processing: A Survey
Not on the map. Why?
Abstract (arXiv)
Many adversarial attacks target natural language processing systems, most of which succeed through modifying the individual tokens of a document. Despite the apparent uniqueness of each of these attacks, fundamentally they are simply a distinct configuration of four components: a goal function, allowable transformations, a search method, and constraints. In this survey, we systematically present the different components used throughout the literature, using an attack-independent framework which allows for easy comparison and categorisation of components. Our work aims to serve as a comprehensive guide for newcomers to the field and to spark targeted research into refining the individual attack components.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 52 of its 117 references that are in the map. First posted on arXiv 1 Mar 2021.
Builds on
52 of 117 references.
References · 52
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,315
- 2018Neural Network Acceptability Judgmentscited by 952
- 2016Adversarial Machine Learning at Scalecited by 934
- 2016Practical Black-Box Attacks against Machine Learningcited by 893
- 2019Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailmentcited by 663
38 more
- 2017Adversarial Examples for Evaluating Reading Comprehension Systemscited by 568
- 2020BERT-ATTACK: Adversarial Attack Against BERT Using BERTcited by 488
- 2018Generating Natural Language Adversarial Examplescited by 422
- 2018TextBugger: Generating Adversarial Text Against Real-world Applicationscited by 376
- 2018Black-box Generation of Adversarial Text Sequences to Evade Deep Learning Classifierscited by 341
- 2020BAE: BERT-based Adversarial Examples for Text Classificationcited by 316
- 2017Synthetic and Natural Noise Both Break Neural Machine Translationcited by 304
- 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 260
- 2017Generating Natural Adversarial Examplescited by 182
- 2016Counter-fitting Word Vectors to Linguistic Constraintscited by 138
- 2020Contextualized Perturbation for Textual Adversarial Attackcited by 136
- 2017Deep Text Classification Can be Fooledcited by 105
- 2016Crafting Adversarial Input Sequences for Recurrent Neural Networkscited by 102
- 2019Text Processing Like Humans Do: Visually Attacking and Shielding NLP Systemscited by 99
- 2018Seq2Sick: Evaluating the Robustness of Sequence-to-Sequence Models with Adversarial Examplescited by 93
- 2018On Adversarial Examples for Character-Level Neural Machine Translationcited by 85
- 2020Reevaluating Adversarial Examples in Natural Languagecited by 83
- 2020Imitation Attacks and Defenses for Black-box Machine Translation Systemscited by 78
- 2019AllenNLP Interpret: A Framework for Explaining Predictions of NLP Modelscited by 74
- 2019Make Up Your Mind! Adversarial Generation of Inconsistent Natural Language Explanationscited by 71
- 2020It's Morphin' Time! Combating Linguistic Discrimination with Inflectional Perturbationscited by 64
- 2018Motivating the Rules of the Game for Adversarial Example Researchcited by 57
- 2019On Evaluation of Adversarial Perturbations for Sequence-to-Sequence Modelscited by 56
- 2017Towards Crafting Text Adversarial Samplescited by 55
- 2020Generating Natural Language Attacks in a Hard Label Black Box Settingcited by 50
- 2020Generating Fluent Adversarial Examples for Natural Languagescited by 49
- 2020TextAttack: A Framework for Adversarial Attacks, Data Augmentation, and Adversarial Training in NLPcited by 45
- 2019Natural Language Adversarial Defense through Synonym Encodingcited by 39
- 2020From Hero to Z'eroe: A Benchmark of Low-Level Adversarial Attackscited by 36
- 2020Searching for a Search Method: Benchmarking Search Algorithms for Generating NLP Adversarial Examplescited by 23
- 2019Understanding Impacts of High-Order Loss Approximations and Features in Deep Learning Interpretationcited by 22
- 2020A Geometry-Inspired Attack for Generating Natural Language Adversarial Examplescited by 20
- 2020Adversarial Attack and Defense of Structured Prediction Modelscited by 20
- 2020On the Transferability of Adversarial Attacksagainst Neural Text Classifiercited by 16
- 2021Adversarial Stylometry in the Wild: Transferable Lexical Substitution Attacks on Author Profilingcited by 12
- 2020Considering Likelihood in NLP Classification Explanations with Occlusion and Language Modelingcited by 11
- 2020Unsupervised Text Style Transfer with Padded Masked Language Modelscited by 4
- 2020Detecting Word Sense Disambiguation Biases in Machine Translation for Model-Agnostic Adversarial Attackscited by 2
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 0; 2024: 4; 2025: 2; 2026: 3.
12 papers.
- 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 123
- 2021BERT-Defense: A Probabilistic Model Based on BERT to Combat Cognitively Inspired Orthographic Adversarial Attackscited by 17
- 2022Robust Natural Language Processing: Recent Advances, Challenges, and Future Directionscited by 9
- 2022Cyberbullying Classifiers are Sensitive to Model-Agnostic Perturbationscited by 5
- 2024Hijacking Vision-and-Language Navigation Agents with Adversarial Environmental Attackscited by 5
- 2024A Constraint-Enforcing Reward for Adversarial Attacks on Text Classifierscited by 2
- 2025Demystifying Network Foundation Modelscited by 2
- 2024Assessing biomedical knowledge robustness in large language models by query-efficient sampling attackscited by 1
- 2025Towards Inclusive Toxic Content Moderation: Addressing Vulnerabilities to Adversarial Attacks in Toxicity Classifiers Tackling LLM-generated Contentcited by 0
- 2026Devling into Adversarial Transferability on Image Classification: Review, Benchmark, and Evaluationcited by 0
- 2026LFQA-HP-1M: A Large-Scale Human Preference Dataset for Long-Form Question Answeringcited by 0
- 2026Vulnerability of Natural Language Classifiers to Evolutionary Generated Adversarial Textcited by 0
- 2026Vulnerability of Natural Language Classifiers to Evolutionary Generated Adversarial Text25 Jun 2026
- 2026LFQA-HP-1M: A Large-Scale Human Preference Dataset for Long-Form Question Answering27 Feb 2026
- 2026Devling into Adversarial Transferability on Image Classification: Review, Benchmark, and Evaluation26 Feb 2026
- 2025Demystifying Network Foundation Models27 Sep 2025
- 2025Towards Inclusive Toxic Content Moderation: Addressing Vulnerabilities to Adversarial Attacks in Toxicity Classifiers Tackling LLM-generated Content16 Sep 2025
- 2024Hijacking Vision-and-Language Navigation Agents with Adversarial Environmental Attacks3 Dec 2024
- 2024A Constraint-Enforcing Reward for Adversarial Attacks on Text Classifiers20 May 2024
- 2024Assessing biomedical knowledge robustness in large language models by query-efficient sampling attacks16 Feb 2024
- 2024Black-Box Access is Insufficient for Rigorous AI Audits25 Jan 2024
- 2022Cyberbullying Classifiers are Sensitive to Model-Agnostic Perturbations17 Jan 2022
- 2022Robust Natural Language Processing: Recent Advances, Challenges, and Future Directions3 Jan 2022
- 2021BERT-Defense: A Probabilistic Model Based on BERT to Combat Cognitively Inspired Orthographic Adversarial Attacks2 Jun 2021