Alert-ME: An Explainability-Driven Defense Against Adversarial Examples in Transformer-Based Text Classification
Not on the map. Why?
Abstract (arXiv)
Transformer-based text classifiers such as BERT, RoBERTa, T5, and GPT have shown strong performance in natural language processing tasks but remain vulnerable to adversarial examples. These vulnerabilities raise significant security concerns, as small input perturbations can cause severe misclassifications. Existing robustness methods often require heavy computation or lack interpretability. This paper presents a unified framework called Explainability-driven Detection, Identification, and Transformation (EDIT) to strengthen inference-time defenses. EDIT integrates explainability tools, including attention maps and integrated gradients, with frequency-based features to automatically detect and identify adversarial perturbations while offering insight into model behavior. After detection, EDIT refines adversarial inputs using an optimal transformation process that leverages pre-trained embeddings and model feedback to replace corrupted tokens. To enhance security assurance, EDIT incorporates automated alerting mechanisms that involve human analysts when necessary. Beyond static defenses, EDIT also provides adaptive resilience by enforcing internal feature similarity and transforming inputs, thereby disrupting the attackers optimization process and limiting the effectiveness of adaptive adversarial attacks. Experiments using BERT and RoBERTa on IMDB, YELP, AGNEWS, and SST2 datasets against seven word substitution attacks demonstrate that EDIT achieves an average Fscore of 89.69 percent and balanced accuracy of 89.70 percent. Compared to four state-of-the-art defenses, EDIT improves balanced accuracy by 1.22 times and F1-score by 1.33 times while being 83 times faster in feature extraction. The framework provides robust, interpretable, and efficient protection against both standard, zero-day, and adaptive adversarial threats in text classification models.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 37 of its 77 references that are in the map. First posted on arXiv 3 Jul 2023.
Builds on
37 of 77 references.
References · 37
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
- 2016Enriching Word Vectors with Subword Informationcited by 1,578
- 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 729
- 2019Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailmentcited by 663
- 2020Transformer Interpretability Beyond Attention Visualizationcited by 620
- 2020BERT-ATTACK: Adversarial Attack Against BERT Using BERTcited by 488
25 more
- 2018TextBugger: Generating Adversarial Text Against Real-world Applicationscited by 376
- 2018Black-box Generation of Adversarial Text Sequences to Evade Deep Learning Classifierscited by 341
- 2020BAE: BERT-based Adversarial Examples for Text Classificationcited by 316
- 2021Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformerscited by 316
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 299
- 2020BadNL: Backdoor Attacks against NLP Models with Semantic-preserving Improvementscited by 191
- 2020InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspectivecited by 92
- 2019On the Connection Between Adversarial Robustness and Saliency Map Interpretabilitycited by 80
- 2020Robust Encodings: A Framework for Combating Adversarial Typoscited by 58
- 2021T-Miner: A Generative Approach to Defend Against Trojan Attacks on DNN-based Text Classificationcited by 56
- 2019Learning to Discriminate Perturbations for Blocking Adversarial Attacks in Text Classificationcited by 55
- 2021Searching for an Effective Defender: Benchmarking Defense against Adversarial Word Substitutioncited by 55
- 2020Frequency-Guided Word Substitutions for Detecting Textual Adversarial Examplescited by 54
- 2019Natural Language Adversarial Defense through Synonym Encodingcited by 39
- 2022Detection of Word Adversarial Examples in Text Classification: Benchmark and Baseline via Robust Density Estimationcited by 32
- 2022CySecBERT: A Domain-Adapted Language Model for the Cybersecurity Domaincited by 31
- 2021Grey-box Adversarial Attack And Defence For Sentiment Classificationcited by 28
- 2020MALCOM: Generating Malicious Comments to Attack Neural Fake News Detection Modelscited by 25
- 2022"That Is a Suspicious Reaction!": Interpreting Logits Variation to Detect NLP Adversarial Attackscited by 24
- 2023Multi-source Semantic Graph-based Multimodal Sarcasm Explanation Generationcited by 19
- 2020SHIELD: Defending Textual Neural Networks against Multiple Black-Box Adversarial Attacks with Stochastic Multi-Expert Patchercited by 13
- 2023TextShield: Beyond Successfully Detecting Adversarial Sentences in Text Classificationcited by 8
- 2023Masked Language Model Based Textual Adversarial Example Detectioncited by 5
- 2020Reliability and Robustness analysis of Machine Learning based Phishing URL Detectorscited by 4
- 2021ReinforceBug: A Framework to Generate Adversarial Textual Examplescited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.