CAT-Gen: Improving Robustness in NLP Models via Controlled Adversarial Text Generation
Not on the map. Why?
Abstract (arXiv)
NLP models are shown to suffer from robustness issues, i.e., a model's prediction can be easily changed under small perturbations to the input. In this work, we present a Controlled Adversarial Text Generation (CAT-Gen) model that, given an input text, generates adversarial texts through controllable attributes that are known to be invariant to task labels. For example, in order to attack a model for sentiment classification over product reviews, we can use the product categories as the controllable attribute which would not change the sentiment of the reviews. Experiments on real-world NLP datasets demonstrate that our method can generate more diverse and fluent adversarial texts, compared to many existing adversarial text generation approaches. We further use our generated adversarial examples to improve models through adversarial training, and we demonstrate that our generated attacks are more robust against model re-training and different model architectures.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 13; 2023: 8; 2024: 9; 2025: 6; 2026: 1.
43 papers.
Sort:
By area:
- 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfercited by 147
- 2021Measure and Improve Robustness in NLP Models: A Surveycited by 107
- 2022Why Should Adversarial Perturbations be Imperceptible? Rethink the Research Paradigm in Adversarial NLPcited by 99
- 2022Exploring the Universal Vulnerability of Prompt-based Learning Paradigmcited by 56
- 2021Are Vision Transformers Robust to Patch Perturbations?cited by 39
- 2022DoCoGen: Domain Counterfactual Generation for Low Resource Domain Adaptationcited by 36
- 2022Robustness of Learning from Task Instructionscited by 34
- 2022Phrase-level Textual Adversarial Attack with Label Preservationcited by 23
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 22
- 2021Multi-granularity Textual Adversarial Attack with Behavior Cloningcited by 21
- 2022Survey on Automated Short Answer Grading with Deep Learning: from Word Embeddings to Transformerscited by 20
- 2025Adversarial Paraphrasing: A Universal Attack for Humanizing AI-Generated Textcited by 16
31 more
- 2022Flexible text generation for counterfactual fairness probingcited by 13
- 2022Adversarial Training for Improving Model Robustness? Look at Both Prediction and Interpretationcited by 12
- 2022Robust Natural Language Processing: Recent Advances, Challenges, and Future Directionscited by 9
- 2022ER-Test: Evaluating Explanation Regularization Methods for Language Modelscited by 6
- 2023LEAP: Efficient and Automated Test Method for NLP Softwarecited by 6
- 2023Evaluating Concurrent Robustness of Language Models Across Diverse Challenge Setscited by 6
- 2023Masked Language Model Based Textual Adversarial Example Detectioncited by 5
- 2023Break it, Imitate it, Fix it: Robustness by Generating Human-Like Attackscited by 5
- 2024ROIC-DM: Robust Text Inference and Classification via Diffusion Modelcited by 5
- 2022Low Resource Style Transfer via Domain Adaptive Meta Learningcited by 4
- 2025Confidence Elicitation: A New Attack Vector for Large Language Modelscited by 4
- 2023Consistent Text Categorization using Data Augmentation in e-Commercecited by 3
- 2023From Adversarial Arms Race to Model-centric Evaluation: Motivating a Unified Automatic Robustness Evaluation Frameworkcited by 3
- 2024Finding a Needle in the Adversarial Haystack: A Targeted Paraphrasing Approach For Uncovering Edge Cases with Minimal Distribution Distortioncited by 3
- 2024PID Control-Based Self-Healing to Improve the Robustness of Large Language Modelscited by 3
- 2024Automated Adversarial Discovery for Safety Classifierscited by 3
- 2021TREATED:Towards Universal Defense against Textual Adversarial Attackscited by 2
- 2022Plug and Play Counterfactual Text Generation for Model Robustnesscited by 2
- 2024Enhance Robustness of Language Models Against Variation Attack through Graph Integrationcited by 2
- 2024CERT-ED: Certifiably Robust Text Classification for Edit Distancecited by 2
- 2025Adversarial Defence without Adversarial Defence: Enhancing Language Model Robustness via Instance-level Principal Component Removalcited by 2
- 2023Improving Classifier Robustness through Active Generation of Pairwise Counterfactualscited by 1
- 2024Subspace Defense: Discarding Adversarial Perturbations by Learning a Subspace for Clean Signalscited by 1
- 2025Exploring Robustness of LLMs to Paraphrasing Based on Sociodemographic Factorscited by 1
- 2025Model Hemorrhage and the Robustness Limits of Large Language Modelscited by 1
- 2021SEPP: Similarity Estimation of Predicted Probabilities for Defending and Detecting Adversarial Textcited by 0
- 2023SenTest: Evaluating Robustness of Sentence Encoderscited by 0
- 2024Towards Robust Domain Generation Algorithm Classificationcited by 0
- 2024LMO-DP: Optimizing the Randomization Mechanism for Differentially Private Fine-Tuning (Large) Language Modelscited by 0
- 2025Coordinated Robustness Evaluation Framework for Vision-Language Modelscited by 0
- 2026Applications of the Transformer Architecture in AI-Assisted English Reading Comprehensioncited by 0
- 2026Applications of the Transformer Architecture in AI-Assisted English Reading Comprehension26 Apr 2026
- 2025Adversarial Defence without Adversarial Defence: Enhancing Language Model Robustness via Instance-level Principal Component Removal29 Jul 2025
- 2025Adversarial Paraphrasing: A Universal Attack for Humanizing AI-Generated Text8 Jun 2025
- 2025Coordinated Robustness Evaluation Framework for Vision-Language Models5 Jun 2025
- 2025Model Hemorrhage and the Robustness Limits of Large Language Models31 Mar 2025
- 2025Confidence Elicitation: A New Attack Vector for Large Language Models7 Feb 2025
- 2025Exploring Robustness of LLMs to Paraphrasing Based on Sociodemographic Factors14 Jan 2025
- 2024CERT-ED: Certifiably Robust Text Classification for Edit Distance1 Aug 2024
- 2024Automated Adversarial Discovery for Safety Classifiers24 Jun 2024
- 2024LMO-DP: Optimizing the Randomization Mechanism for Differentially Private Fine-Tuning (Large) Language Models29 May 2024
- 2024Enhance Robustness of Language Models Against Variation Attack through Graph Integration18 Apr 2024
- 2024Towards Robust Domain Generation Algorithm Classification9 Apr 2024
31 more
- 2024PID Control-Based Self-Healing to Improve the Robustness of Large Language Models31 Mar 2024
- 2024Subspace Defense: Discarding Adversarial Perturbations by Learning a Subspace for Clean Signals24 Mar 2024
- 2024Finding a Needle in the Adversarial Haystack: A Targeted Paraphrasing Approach For Uncovering Edge Cases with Minimal Distribution Distortion21 Jan 2024
- 2024ROIC-DM: Robust Text Inference and Classification via Diffusion Model7 Jan 2024
- 2023SenTest: Evaluating Robustness of Sentence Encoders29 Nov 2023
- 2023Evaluating Concurrent Robustness of Language Models Across Diverse Challenge Sets15 Nov 2023
- 2023Break it, Imitate it, Fix it: Robustness by Generating Human-Like Attacks25 Oct 2023
- 2023LEAP: Efficient and Automated Test Method for NLP Software22 Aug 2023
- 2023From Adversarial Arms Race to Model-centric Evaluation: Motivating a Unified Automatic Robustness Evaluation Framework29 May 2023
- 2023Improving Classifier Robustness through Active Generation of Pairwise Counterfactuals22 May 2023
- 2023Consistent Text Categorization using Data Augmentation in e-Commerce9 May 2023
- 2023Masked Language Model Based Textual Adversarial Example Detection18 Apr 2023
- 2022Robustness of Learning from Task Instructions7 Dec 2022
- 2022Why Should Adversarial Perturbations be Imperceptible? Rethink the Research Paradigm in Adversarial NLP19 Oct 2022
- 2022Flexible text generation for counterfactual fairness probing28 Jun 2022
- 2022Plug and Play Counterfactual Text Generation for Model Robustness21 Jun 2022
- 2022ER-Test: Evaluating Explanation Regularization Methods for Language Models25 May 2022
- 2022Low Resource Style Transfer via Domain Adaptive Meta Learning25 May 2022
- 2022Phrase-level Textual Adversarial Attack with Label Preservation22 May 2022
- 2022Exploring the Universal Vulnerability of Prompt-based Learning Paradigm11 Apr 2022
- 2022Adversarial Training for Improving Model Robustness? Look at Both Prediction and Interpretation23 Mar 2022
- 2022A Survey of Adversarial Defences and Robustness in NLP12 Mar 2022
- 2022Survey on Automated Short Answer Grading with Deep Learning: from Word Embeddings to Transformers11 Mar 2022
- 2022DoCoGen: Domain Counterfactual Generation for Low Resource Domain Adaptation24 Feb 2022
- 2022Robust Natural Language Processing: Recent Advances, Challenges, and Future Directions3 Jan 2022
- 2021Measure and Improve Robustness in NLP Models: A Survey15 Dec 2021
- 2021Are Vision Transformers Robust to Patch Perturbations?20 Nov 2021
- 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfer14 Oct 2021
- 2021SEPP: Similarity Estimation of Predicted Probabilities for Defending and Detecting Adversarial Text12 Oct 2021
- 2021TREATED:Towards Universal Defense against Textual Adversarial Attacks13 Sep 2021
- 2021Multi-granularity Textual Adversarial Attack with Behavior Cloning9 Sep 2021
- 2021Measure and Improve Robustness in NLP Models: A Surveycited by 107
- 2022Why Should Adversarial Perturbations be Imperceptible? Rethink the Research Paradigm in Adversarial NLPcited by 99
- 2022Exploring the Universal Vulnerability of Prompt-based Learning Paradigmcited by 56
- 2021Are Vision Transformers Robust to Patch Perturbations?cited by 39
- 2022DoCoGen: Domain Counterfactual Generation for Low Resource Domain Adaptationcited by 36
- 2022Robustness of Learning from Task Instructionscited by 34
- 2022Phrase-level Textual Adversarial Attack with Label Preservationcited by 23
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 22
- 2021Multi-granularity Textual Adversarial Attack with Behavior Cloningcited by 21
- 2022Survey on Automated Short Answer Grading with Deep Learning: from Word Embeddings to Transformerscited by 20
- 2025Adversarial Paraphrasing: A Universal Attack for Humanizing AI-Generated Textcited by 16
- 2022Flexible text generation for counterfactual fairness probingcited by 13
12 most cited of 40 All 40 (JSON)
- 2026Applications of the Transformer Architecture in AI-Assisted English Reading Comprehension26 Apr 2026
- 2025Adversarial Defence without Adversarial Defence: Enhancing Language Model Robustness via Instance-level Principal Component Removal29 Jul 2025
- 2025Adversarial Paraphrasing: A Universal Attack for Humanizing AI-Generated Text8 Jun 2025
- 2025Model Hemorrhage and the Robustness Limits of Large Language Models31 Mar 2025
- 2025Confidence Elicitation: A New Attack Vector for Large Language Models7 Feb 2025
- 2025Exploring Robustness of LLMs to Paraphrasing Based on Sociodemographic Factors14 Jan 2025
- 2024CERT-ED: Certifiably Robust Text Classification for Edit Distance1 Aug 2024
- 2024Automated Adversarial Discovery for Safety Classifiers24 Jun 2024
- 2024LMO-DP: Optimizing the Randomization Mechanism for Differentially Private Fine-Tuning (Large) Language Models29 May 2024
- 2024Enhance Robustness of Language Models Against Variation Attack through Graph Integration18 Apr 2024
- 2024Towards Robust Domain Generation Algorithm Classification9 Apr 2024
- 2024PID Control-Based Self-Healing to Improve the Robustness of Large Language Models31 Mar 2024
12 newest of 40 All 40 (JSON)