Generating Fluent Adversarial Examples for Natural Languages
Not on the map. Why?
Abstract (arXiv)
Efficiently building an adversarial attacker for natural language processing (NLP) tasks is a real challenge. Firstly, as the sentence space is discrete, it is difficult to make small perturbations along the direction of gradients. Secondly, the fluency of the generated examples cannot be guaranteed. In this paper, we propose MHA, which addresses both problems by performing Metropolis-Hastings sampling, whose proposal is designed with the guidance of gradients. Experiments on IMDB and SNLI show that our proposed MHA outperforms the baseline model on attacking capability. Adversarial training with MAH also leads to better robustness and performance.
Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 14; 2023: 5; 2024: 5; 2025: 1.
49 papers.
Sort:
By area:
- 2023On Evaluating Adversarial Robustness of Large Vision-Language Modelscited by 281
- 2021Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Modelscited by 219
- 2021MARS: Markov Molecular Sampling for Multi-objective Drug Discoverycited by 125
- 2021Towards Robustness of Text-to-SQL Models against Synonym Substitutioncited by 110
- 2021Turn the Combination Lock: Learnable Textual Backdoor Attacks via Word Substitutioncited by 85
- 2021Towards Robustness Against Natural Language Word Substitutionscited by 68
- 2021How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness?cited by 49
- 2021Modeling Discriminative Representations for Out-of-Domain Detection with Supervised Contrastive Learningcited by 42
- 2021Exploring the Efficacy of Automatically Generated Counterfactuals for Sentiment Analysiscited by 30
- 2022Character-level White-Box Adversarial Attacks against Transformers via Attachable Subwords Substitutioncited by 28
- 2021Substructure Substitution: Structured Data Augmentation for NLPcited by 25
- 2021Reliability Testing for Natural Language Processing Systemscited by 25
37 more
- 2021Code-Mixing on Sesame Street: Dawn of the Adversarial Polyglotscited by 23
- 2022Phrase-level Textual Adversarial Attack with Label Preservationcited by 23
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 22
- 2022TextGrad: Advancing Robustness Evaluation in NLP by Gradient-Driven Optimizationcited by 21
- 2024Assessing Adversarial Robustness of Large Language Models: An Empirical Studycited by 21
- 2021Certified Robustness to Programmable Transformations in LSTMscited by 18
- 2021Efficient Combinatorial Optimization for Word-level Adversarial Textual Attackcited by 17
- 2021Synthesizing Adversarial Negative Responses for Robust Response Ranking and Evaluationcited by 16
- 2022A Word is Worth A Thousand Dollars: Adversarial Attack on Tweets Fools Stock Predictionscited by 15
- 2021Token-Modification Adversarial Attacks for Natural Language Processing: A Surveycited by 12
- 2022Robust Textual Embedding against Word-level Adversarial Attackscited by 12
- 2022DIMBA: Discretely Masked Black-Box Attack in Single Object Trackingcited by 11
- 2022TextHacker: Learning based Hybrid Local Search Algorithm for Text Hard-label Adversarial Attackcited by 10
- 2021A Differentiable Language Model Adversarial Attack on Text Classifierscited by 9
- 2021BERT is Robust! A Case Against Synonym-Based Adversarial Examples in Text Classificationcited by 9
- 2022Robust Natural Language Processing: Recent Advances, Challenges, and Future Directionscited by 9
- 2021Improving the robustness and accuracy of biomedical language models through adversarial trainingcited by 7
- 2021Virtual Data Augmentation: A Robust and General Framework for Fine-tuning Pre-trained Modelscited by 5
- 2022Cheating Automatic Short Answer Grading: On the Adversarial Usage of Adjectives and Adverbscited by 5
- 2022Measuring Geographic Performance Disparities of Offensive Language Classifierscited by 5
- 2023Stealthy Physical Masked Face Recognition Attack via Adversarial Style Optimizationcited by 4
- 2022Pneg: Prompt-based Negative Response Generation for Dialogue Response Selection Taskcited by 3
- 2023Adversary for Social Good: Leveraging Adversarial Attacks to Protect Personal Attribute Privacycited by 3
- 2023NatLogAttack: A Framework for Attacking Natural Language Inference Models with Natural Logiccited by 3
- 2021Improving Robustness of Malware Classifiers using Adversarial Strings Generated from Perturbed Latent Representationscited by 2
- 2024Enhancing adversarial robustness in Natural Language Inference using explanationscited by 2
- 2021Target Model Agnostic Adversarial Attacks with Query Budgets on Language Understanding Modelscited by 1
- 2022MUC-driven Feature Importance Measurement and Adversarial Analysis for Random Forestcited by 1
- 2023Hiding Backdoors within Event Sequence Data via Poisoning Attackscited by 1
- 2024Mitigating Adversarial Attacks in LLMs through Defensive Suffix Generationcited by 1
- 2021Adversarially Robust and Explainable Model Compression with On-Device Personalization for Text Classificationcited by 0
- 2021DAFAR: Defending against Adversaries by Feedback-Autoencoder Reconstructioncited by 0
- 2021SEPP: Similarity Estimation of Predicted Probabilities for Defending and Detecting Adversarial Textcited by 0
- 2022Beyond Model Interpretability: On the Faithfulness and Adversarial Robustness of Contrastive Textual Explanationscited by 0
- 2024Reversible Jump Attack to Textual Classifiers with Modification Reductioncited by 0
- 2024IAE: Irony-based Adversarial Examples for Sentiment Analysis Systemscited by 0
- 2025Evaluating the Robustness of a Production Malware Detection System to Transferable Adversarial Attackscited by 0
- 2025Evaluating the Robustness of a Production Malware Detection System to Transferable Adversarial Attacks2 Oct 2025
- 2024Mitigating Adversarial Attacks in LLMs through Defensive Suffix Generation18 Dec 2024
- 2024IAE: Irony-based Adversarial Examples for Sentiment Analysis Systems12 Nov 2024
- 2024Enhancing adversarial robustness in Natural Language Inference using explanations11 Sep 2024
- 2024Assessing Adversarial Robustness of Large Language Models: An Empirical Study4 May 2024
- 2024Reversible Jump Attack to Textual Classifiers with Modification Reduction21 Mar 2024
- 2023Stealthy Physical Masked Face Recognition Attack via Adversarial Style Optimization18 Sep 2023
- 2023Hiding Backdoors within Event Sequence Data via Poisoning Attacks20 Aug 2023
- 2023NatLogAttack: A Framework for Attacking Natural Language Inference Models with Natural Logic6 Jul 2023
- 2023Adversary for Social Good: Leveraging Adversarial Attacks to Protect Personal Attribute Privacy4 Jun 2023
- 2023On Evaluating Adversarial Robustness of Large Vision-Language Models26 May 2023
- 2022TextGrad: Advancing Robustness Evaluation in NLP by Gradient-Driven Optimization19 Dec 2022
37 more
- 2022Pneg: Prompt-based Negative Response Generation for Dialogue Response Selection Task31 Oct 2022
- 2022Character-level White-Box Adversarial Attacks against Transformers via Attachable Subwords Substitution31 Oct 2022
- 2022Beyond Model Interpretability: On the Faithfulness and Adversarial Robustness of Contrastive Textual Explanations17 Oct 2022
- 2022Measuring Geographic Performance Disparities of Offensive Language Classifiers15 Sep 2022
- 2022DIMBA: Discretely Masked Black-Box Attack in Single Object Tracking17 Jul 2022
- 2022Phrase-level Textual Adversarial Attack with Label Preservation22 May 2022
- 2022A Word is Worth A Thousand Dollars: Adversarial Attack on Tweets Fools Stock Predictions1 May 2022
- 2022A Survey of Adversarial Defences and Robustness in NLP12 Mar 2022
- 2022Robust Textual Embedding against Word-level Adversarial Attacks28 Feb 2022
- 2022MUC-driven Feature Importance Measurement and Adversarial Analysis for Random Forest25 Feb 2022
- 2022Cheating Automatic Short Answer Grading: On the Adversarial Usage of Adjectives and Adverbs20 Jan 2022
- 2022TextHacker: Learning based Hybrid Local Search Algorithm for Text Hard-label Adversarial Attack20 Jan 2022
- 2022Robust Natural Language Processing: Recent Advances, Challenges, and Future Directions3 Jan 2022
- 2021How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness?22 Dec 2021
- 2021Improving the robustness and accuracy of biomedical language models through adversarial training16 Nov 2021
- 2021Improving Robustness of Malware Classifiers using Adversarial Strings Generated from Perturbed Latent Representations22 Oct 2021
- 2021SEPP: Similarity Estimation of Predicted Probabilities for Defending and Detecting Adversarial Text12 Oct 2021
- 2021BERT is Robust! A Case Against Synonym-Based Adversarial Examples in Text Classification15 Sep 2021
- 2021Virtual Data Augmentation: A Robust and General Framework for Fine-tuning Pre-trained Models13 Sep 2021
- 2021Efficient Combinatorial Optimization for Word-level Adversarial Textual Attack6 Sep 2021
- 2021Towards Robustness Against Natural Language Word Substitutions28 Jul 2021
- 2021A Differentiable Language Model Adversarial Attack on Text Classifiers23 Jul 2021
- 2021Exploring the Efficacy of Automatically Generated Counterfactuals for Sentiment Analysis29 Jun 2021
- 2021Target Model Agnostic Adversarial Attacks with Query Budgets on Language Understanding Models13 Jun 2021
- 2021Turn the Combination Lock: Learnable Textual Backdoor Attacks via Word Substitution11 Jun 2021
- 2021Synthesizing Adversarial Negative Responses for Robust Response Ranking and Evaluation10 Jun 2021
- 2021Towards Robustness of Text-to-SQL Models against Synonym Substitution2 Jun 2021
- 2021Modeling Discriminative Representations for Out-of-Domain Detection with Supervised Contrastive Learning29 May 2021
- 2021Reliability Testing for Natural Language Processing Systems6 May 2021
- 2021MARS: Markov Molecular Sampling for Multi-objective Drug Discovery18 Mar 2021
- 2021Code-Mixing on Sesame Street: Dawn of the Adversarial Polyglots17 Mar 2021
- 2021DAFAR: Defending against Adversaries by Feedback-Autoencoder Reconstruction11 Mar 2021
- 2021Token-Modification Adversarial Attacks for Natural Language Processing: A Survey1 Mar 2021
- 2021Certified Robustness to Programmable Transformations in LSTMs15 Feb 2021
- 2021Adversarially Robust and Explainable Model Compression with On-Device Personalization for Text Classification10 Jan 2021
- 2021Substructure Substitution: Structured Data Augmentation for NLP2 Jan 2021
- 2021Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models1 Jan 2021
- 2021Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Modelscited by 219
- 2021MARS: Markov Molecular Sampling for Multi-objective Drug Discoverycited by 125
- 2021Towards Robustness of Text-to-SQL Models against Synonym Substitutioncited by 110
- 2021Towards Robustness Against Natural Language Word Substitutionscited by 68
- 2021How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness?cited by 49
- 2021Modeling Discriminative Representations for Out-of-Domain Detection with Supervised Contrastive Learningcited by 42
- 2021Exploring the Efficacy of Automatically Generated Counterfactuals for Sentiment Analysiscited by 30
- 2022Character-level White-Box Adversarial Attacks against Transformers via Attachable Subwords Substitutioncited by 28
- 2021Substructure Substitution: Structured Data Augmentation for NLPcited by 25
- 2021Reliability Testing for Natural Language Processing Systemscited by 25
- 2021Code-Mixing on Sesame Street: Dawn of the Adversarial Polyglotscited by 23
- 2022Phrase-level Textual Adversarial Attack with Label Preservationcited by 23
12 most cited of 47 All 47 (JSON)
- 2025Evaluating the Robustness of a Production Malware Detection System to Transferable Adversarial Attacks2 Oct 2025
- 2024Mitigating Adversarial Attacks in LLMs through Defensive Suffix Generation18 Dec 2024
- 2024IAE: Irony-based Adversarial Examples for Sentiment Analysis Systems12 Nov 2024
- 2024Enhancing adversarial robustness in Natural Language Inference using explanations11 Sep 2024
- 2024Assessing Adversarial Robustness of Large Language Models: An Empirical Study4 May 2024
- 2024Reversible Jump Attack to Textual Classifiers with Modification Reduction21 Mar 2024
- 2023Stealthy Physical Masked Face Recognition Attack via Adversarial Style Optimization18 Sep 2023
- 2023Hiding Backdoors within Event Sequence Data via Poisoning Attacks20 Aug 2023
- 2023NatLogAttack: A Framework for Attacking Natural Language Inference Models with Natural Logic6 Jul 2023
- 2023Adversary for Social Good: Leveraging Adversarial Attacks to Protect Personal Attribute Privacy4 Jun 2023
- 2022TextGrad: Advancing Robustness Evaluation in NLP by Gradient-Driven Optimization19 Dec 2022
- 2022Pneg: Prompt-based Negative Response Generation for Dialogue Response Selection Task31 Oct 2022
12 newest of 47 All 47 (JSON)