Defense against Adversarial Attacks in NLP via Dirichlet Neighborhood Ensemble
Not on the map. Why?
Abstract (arXiv)
Despite neural networks have achieved prominent performance on many natural language processing (NLP) tasks, they are vulnerable to adversarial examples. In this paper, we propose Dirichlet Neighborhood Ensemble (DNE), a randomized smoothing method for training a robust model to defense substitution-based attacks. During training, DNE forms virtual sentences by sampling embedding vectors for each word in an input sentence from a convex hull spanned by the word and its synonyms, and it augments them with the training data. In such a way, the model is robust to adversarial attacks while maintaining the performance on the original clean data. DNE is agnostic to the network architectures and scales to large models for NLP applications. We demonstrate through extensive experimentation that our method consistently outperforms recently proposed defense methods by a significant margin across different network architectures and multiple data sets.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 9; 2023: 2; 2024: 3; 2025: 1; 2026: 2.
26 papers.
Sort:
By area:
- 2021Towards Robustness Against Natural Language Word Substitutionscited by 68
- 2021Certified Robustness to Text Adversarial Attacks by Randomized [MASK]cited by 57
- 2021Searching for an Effective Defender: Benchmarking Defense against Adversarial Word Substitutioncited by 55
- 2024One Perturbation is Enough: On Generating Universal Adversarial Perturbations against Vision-Language Pre-training Modelscited by 39
- 2021Defending Against Backdoor Attacks in Natural Language Generationcited by 30
- 2021Grey-box Adversarial Attack And Defence For Sentiment Classificationcited by 28
- 2022"That Is a Suspicious Reaction!": Interpreting Logits Variation to Detect NLP Adversarial Attackscited by 24
- 2021Achieving Model Robustness through Discrete Adversarial Trainingcited by 23
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 22
- 2022Improving the Adversarial Robustness of NLP Models by Information Bottleneckcited by 17
- 2022Text Adversarial Purification as Defense against Adversarial Attackscited by 15
- 2022Defending Substitution-Based Profile Pollution Attacks on Sequential Recommenderscited by 11
14 more
- 2024Trustworthy Federated Learning: Privacy, Security, and Beyondcited by 11
- 2021Double Perturbation: On the Robustness of Robustness and Counterfactual Bias Evaluationcited by 9
- 2022Robust Natural Language Processing: Recent Advances, Challenges, and Future Directionscited by 9
- 2021Detecting Textual Adversarial Examples through Randomized Substitution and Votecited by 8
- 2023TextShield: Beyond Successfully Detecting Adversarial Sentences in Text Classificationcited by 8
- 2023Masked Language Model Based Textual Adversarial Example Detectioncited by 5
- 2024Extreme Miscalibration and the Illusion of Adversarial Robustnesscited by 4
- 2021Adversarial Machine Learning in Text Analysis and Generationcited by 2
- 2022Learning to Ignore Adversarial Attackscited by 2
- 2022ADDMU: Detection of Far-Boundary Adversarial Examples with Data and Model Uncertainty Estimationcited by 2
- 2025Bridging Robustness and Generalization Against Word Substitution Attacks in NLP via the Growth Bound Matrix Approachcited by 1
- 2022Probabilistic Categorical Adversarial Attack & Adversarial Trainingcited by 0
- 2026S-GBT: Smooth Growth Bound Tensor for Certified Robustness Against Word Substitution Attacks in NLPcited by 0
- 2026Evaluation of Adversarial Robustness in Arabic Language Modelscited by 0
- 2026Evaluation of Adversarial Robustness in Arabic Language Models28 Jul 2026
- 2026S-GBT: Smooth Growth Bound Tensor for Certified Robustness Against Word Substitution Attacks in NLP11 Jun 2026
- 2025Bridging Robustness and Generalization Against Word Substitution Attacks in NLP via the Growth Bound Matrix Approach14 Jul 2025
- 2024Trustworthy Federated Learning: Privacy, Security, and Beyond3 Nov 2024
- 2024One Perturbation is Enough: On Generating Universal Adversarial Perturbations against Vision-Language Pre-training Models8 Jun 2024
- 2024Extreme Miscalibration and the Illusion of Adversarial Robustness27 Feb 2024
- 2023Masked Language Model Based Textual Adversarial Example Detection18 Apr 2023
- 2023TextShield: Beyond Successfully Detecting Adversarial Sentences in Text Classification3 Feb 2023
- 2022ADDMU: Detection of Far-Boundary Adversarial Examples with Data and Model Uncertainty Estimation22 Oct 2022
- 2022Probabilistic Categorical Adversarial Attack & Adversarial Training17 Oct 2022
- 2022Defending Substitution-Based Profile Pollution Attacks on Sequential Recommenders19 Jul 2022
- 2022Improving the Adversarial Robustness of NLP Models by Information Bottleneck11 Jun 2022
14 more
- 2022Learning to Ignore Adversarial Attacks23 May 2022
- 2022"That Is a Suspicious Reaction!": Interpreting Logits Variation to Detect NLP Adversarial Attacks10 Apr 2022
- 2022Text Adversarial Purification as Defense against Adversarial Attacks27 Mar 2022
- 2022A Survey of Adversarial Defences and Robustness in NLP12 Mar 2022
- 2022Robust Natural Language Processing: Recent Advances, Challenges, and Future Directions3 Jan 2022
- 2021Detecting Textual Adversarial Examples through Randomized Substitution and Vote13 Sep 2021
- 2021Searching for an Effective Defender: Benchmarking Defense against Adversarial Word Substitution29 Aug 2021
- 2021Towards Robustness Against Natural Language Word Substitutions28 Jul 2021
- 2021Defending Against Backdoor Attacks in Natural Language Generation3 Jun 2021
- 2021Certified Robustness to Text Adversarial Attacks by Randomized [MASK]8 May 2021
- 2021Double Perturbation: On the Robustness of Robustness and Counterfactual Bias Evaluation12 Apr 2021
- 2021Achieving Model Robustness through Discrete Adversarial Training11 Apr 2021
- 2021Grey-box Adversarial Attack And Defence For Sentiment Classification22 Mar 2021
- 2021Adversarial Machine Learning in Text Analysis and Generation14 Jan 2021
- 2021Towards Robustness Against Natural Language Word Substitutionscited by 68
- 2021Certified Robustness to Text Adversarial Attacks by Randomized [MASK]cited by 57
- 2021Searching for an Effective Defender: Benchmarking Defense against Adversarial Word Substitutioncited by 55
- 2021Grey-box Adversarial Attack And Defence For Sentiment Classificationcited by 28
- 2022"That Is a Suspicious Reaction!": Interpreting Logits Variation to Detect NLP Adversarial Attackscited by 24
- 2021Achieving Model Robustness through Discrete Adversarial Trainingcited by 23
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 22
- 2022Improving the Adversarial Robustness of NLP Models by Information Bottleneckcited by 17
- 2022Text Adversarial Purification as Defense against Adversarial Attackscited by 15
- 2022Defending Substitution-Based Profile Pollution Attacks on Sequential Recommenderscited by 11
- 2024Trustworthy Federated Learning: Privacy, Security, and Beyondcited by 11
- 2021Double Perturbation: On the Robustness of Robustness and Counterfactual Bias Evaluationcited by 9
12 most cited of 24 All 24 (JSON)
- 2026Evaluation of Adversarial Robustness in Arabic Language Models28 Jul 2026
- 2026S-GBT: Smooth Growth Bound Tensor for Certified Robustness Against Word Substitution Attacks in NLP11 Jun 2026
- 2025Bridging Robustness and Generalization Against Word Substitution Attacks in NLP via the Growth Bound Matrix Approach14 Jul 2025
- 2024Trustworthy Federated Learning: Privacy, Security, and Beyond3 Nov 2024
- 2024Extreme Miscalibration and the Illusion of Adversarial Robustness27 Feb 2024
- 2023Masked Language Model Based Textual Adversarial Example Detection18 Apr 2023
- 2023TextShield: Beyond Successfully Detecting Adversarial Sentences in Text Classification3 Feb 2023
- 2022ADDMU: Detection of Far-Boundary Adversarial Examples with Data and Model Uncertainty Estimation22 Oct 2022
- 2022Probabilistic Categorical Adversarial Attack & Adversarial Training17 Oct 2022
- 2022Defending Substitution-Based Profile Pollution Attacks on Sequential Recommenders19 Jul 2022
- 2022Improving the Adversarial Robustness of NLP Models by Information Bottleneck11 Jun 2022
- 2022Learning to Ignore Adversarial Attacks23 May 2022
12 newest of 24 All 24 (JSON)