Robust Neural Machine Translation with Doubly Adversarial Inputs
Not on the map. Why?
Abstract (arXiv)
Neural machine translation (NMT) often suffers from the vulnerability to noisy perturbations in the input. We propose an approach to improving the robustness of NMT models, which consists of two parts: (1) attack the translation model with adversarial source examples; (2) defend the translation model with adversarial target inputs to improve its robustness against the adversarial source inputs.For the generation of adversarial inputs, we propose a gradient-based method to craft adversarial examples informed by the translation loss over the clean inputs.Experimental results on Chinese-English and English-German translation tasks demonstrate that our approach achieves significant improvements (2.8 and 1.6 BLEU points) over Transformer on standard clean benchmarks as well as exhibiting higher robustness on noisy data.
Key facts. Cited by 105 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 40; 2022: 21; 2023: 25; 2024: 12; 2025: 7.
105 papers.
Sort:
By area:
- 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attackscited by 189
- 2021The Curious Case of Hallucinations in Neural Machine Translationcited by 161
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 91
- 2021Data Augmentation Approaches in Natural Language Processing: A Surveycited by 82
- 2021Pyramid Adversarial Training Improves ViT Performancecited by 39
- 2021Evaluating Saliency Methods for Neural Language Modelscited by 37
- 2021On Compositional Generalization of Neural Machine Translationcited by 34
- 2023Prompt Optimization via Adversarial In-Context Learningcited by 33
- 2022Character-level White-Box Adversarial Attacks against Transformers via Attachable Subwords Substitutioncited by 28
38 more
- 2021MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillationcited by 27
- 2021Bridge the Gap Between CV and NLP! A Gradient-based Textual Adversarial Attack Frameworkcited by 27
- 2022Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methodscited by 27
- 2022Phrase-level Textual Adversarial Attack with Label Preservationcited by 23
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 22
- 2021Reweighting Augmented Samples by Minimizing the Maximal Expected Losscited by 21
- 2021Adversarial Examples for Evaluating Math Word Problem Solverscited by 20
- 2021Context-aware Adversarial Training for Name Regularity Bias in Named Entity Recognitioncited by 19
- 2021Rethinking Perturbations in Encoder-Decoders for Fast Trainingcited by 17
- 2024HQA-Attack: Toward High Quality Black-Box Hard-Label Adversarial Attack on Textcited by 16
- 2021Adversarial Reinforced Instruction Attacker for Robust Vision-Language Navigationcited by 15
- 2022Text Adversarial Purification as Defense against Adversarial Attackscited by 15
- 2022Towards Robust k-Nearest-Neighbor Machine Translationcited by 15
- 2022Learning to Generalize to More: Continuous Semantic Augmentation for Neural Machine Translationcited by 13
- 2021Fall of Giants: How popular text-based MLaaS fall against a simple evasion attackcited by 12
- 2021Contrastive Fine-tuning Improves Robustness for Neural Rankerscited by 12
- 2021Self-supervised and Supervised Joint Training for Resource-rich Machine Translationcited by 12
- 2023TransFool: An Adversarial Attack against Neural Machine Translation Modelscited by 12
- 2024ASAM: Boosting Segment Anything Model with Adversarial Tuningcited by 12
- 2021When and How to Fool Explainable Models (and Humans) with Adversarial Examplescited by 10
- 2023Targeted Adversarial Attacks against Neural Machine Translationcited by 10
- 2021On the Robustness of Intent Classification and Slot Labeling in Goal-oriented Dialog Systems to Real-world Noisecited by 9
- 2021Consistency Training with Virtual Adversarial Discrete Perturbationcited by 9
- 2021A Differentiable Language Model Adversarial Attack on Text Classifierscited by 9
- 2023Improving the Robustness of Summarization Systems with Dual Augmentationcited by 9
- 2022Bi-SimCut: A Simple Strategy for Boosting Neural Machine Translationcited by 8
- 2022Adversarial Self-Attention for Language Understandingcited by 8
- 2024Adversarial Text Purification: A Large Language Model Approach for Defensecited by 8
- 2022Multilingual Mix: Example Interpolation Improves Multilingual Neural Machine Translationcited by 7
- 2022Mu2SLAM: Multitask, Multilingual Speech and Language Modelscited by 7
- 2023Neural Machine Translation for the Indigenous Languages of the Americas: An Introductioncited by 7
- 2021R&R: Metric-guided Adversarial Sentence Generationcited by 6
- 2021Addressing the Vulnerability of NMT in Input Perturbationscited by 6
- 2021Adversarial Training with Contrastive Learning in NLPcited by 6
- 2022Breaking the Representation Bottleneck of Chinese Characters: Neural Machine Translation with Stroke Sequence Modelingcited by 6
- 2021Targeted Adversarial Training for Natural Language Understandingcited by 5
- 2021Data Augmentation for Text Generation Without Any Augmented Datacited by 4
- 2021How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understandingcited by 4
50 most cited of 105 All 105 (JSON)
- 2025Expert-guided Clinical Text Augmentation via Query-Based Model Collaboration25 Sep 2025
- 2025RanAT4BIE: Random Adversarial Training for Biomedical Information Extraction14 Sep 2025
- 2025Multi-task Adversarial Attacks against Black-box Model with Few-shot Queries10 Aug 2025
- 2025Disappearing Ink: Obfuscation Breaks N-gram Code Watermarks in Theory and Practice7 Jul 2025
- 2025GenoArmory: A Unified Evaluation Framework for Adversarial Attacks on Genomic Foundation Models16 May 2025
- 2025Misspellings in Natural Language Processing: A survey28 Jan 2025
- 2025Extend Adversarial Policy Against Neural Machine Translation via Unknown Token21 Jan 2025
- 2024NMT-Obfuscator Attack: Ignore a sentence in translation with only one word19 Nov 2024
- 2024Vision-fused Attack: Advancing Aggressive and Stealthy Adversarial Text against Neural Machine Translation8 Sep 2024
- 2024Deterministic Reversible Data Augmentation for Neural Machine Translation4 Jun 2024
- 2024An Empirical Study on the Robustness of Massively Multilingual Neural Machine Translation13 May 2024
- 2024ASAM: Boosting Segment Anything Model with Adversarial Tuning1 May 2024
38 more
- 2024Adversarial Attacks and Dimensionality in Text Classifiers3 Apr 2024
- 2024READ: Improving Relation Extraction from an ADversarial Perspective2 Apr 2024
- 2024Pointing out the Shortcomings of Relation Extraction Models with Semantically Motivated Adversarials29 Feb 2024
- 2024Adversarial Text Purification: A Large Language Model Approach for Defense5 Feb 2024
- 2024HQA-Attack: Toward High Quality Black-Box Hard-Label Adversarial Attack on Text2 Feb 2024
- 2024Finding a Needle in the Adversarial Haystack: A Targeted Paraphrasing Approach For Uncovering Edge Cases with Minimal Distribution Distortion21 Jan 2024
- 2024Machine Translation Testing via Syntactic Tree Pruning1 Jan 2024
- 2023Prompt Optimization via Adversarial In-Context Learning5 Dec 2023
- 2023Is Robustness Transferable across Languages in Multilingual Neural Machine Translation?31 Oct 2023
- 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attacks16 Oct 2023
- 2023Context-aware Adversarial Attack on Named Entity Recognition16 Sep 2023
- 2023Machine Translation Models Stand Strong in the Face of Adversarial Attacks10 Sep 2023
- 2023Exploring the effectiveness of ChatGPT-based feedback compared with teacher feedback and self-feedback: Evidence from Chinese to English translation4 Sep 2023
- 2023Impact of Visual Context on Noisy Multimodal NMT: An Empirical Study for English to Indian Languages30 Aug 2023
- 2023A Classification-Guided Approach for Adversarial Attacks against Neural Machine Translation29 Aug 2023
- 2023Proximal Policy Optimization Actual Combat: Manipulating Output Tokenizer Length10 Aug 2023
- 2023Joint Dropout: Improving Generalizability in Low-Resource Neural Machine Translation through Phrase Pair Variables24 Jul 2023
- 2023Lost In Translation: Generating Adversarial Examples Robust to Round-Trip Translation24 Jul 2023
- 2023Investigating Masking-based Data Generation in Language Models16 Jun 2023
- 2023A Relaxed Optimization Approach for Adversarial Attacks against Neural Machine Translation Models14 Jun 2023
- 2023Neural Machine Translation for the Indigenous Languages of the Americas: An Introduction11 Jun 2023
- 2023Adversary for Social Good: Leveraging Adversarial Attacks to Protect Personal Attribute Privacy4 Jun 2023
- 2023Improving the Robustness of Summarization Systems with Dual Augmentation1 Jun 2023
- 2023Out-of-Distribution Generalization in Text Classification: Past, Present, and Future23 May 2023
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validation19 May 2023
- 2023Adversarial Word Dilution as Text Data Augmentation in Low-Resource Regime16 May 2023
- 2023The Best Defense is Attack: Repairing Semantics in Textual Adversarial Examples6 May 2023
- 2023Towards Reliable Neural Machine Translation with Consistency-Aware Meta-Learning20 Mar 2023
- 2023Targeted Adversarial Attacks against Neural Machine Translation2 Mar 2023
- 2023Data Augmentation for Neural NLP22 Feb 2023
- 2023Step by Step Loss Goes Very Far: Multi-Step Quantization for Adversarial Text Attacks10 Feb 2023
- 2023TransFool: An Adversarial Attack against Neural Machine Translation Models2 Feb 2023
- 2022Mu2SLAM: Multitask, Multilingual Speech and Language Models19 Dec 2022
- 2022Attack on Unfair ToS Clause Detection: A Case Study using Universal Adversarial Triggers28 Nov 2022
- 2022Breaking the Representation Bottleneck of Chinese Characters: Neural Machine Translation with Stroke Sequence Modeling23 Nov 2022
- 2022FRSUM: Towards Faithful Abstractive Summarization via Enhancing Factual Robustness1 Nov 2022
- 2022Character-level White-Box Adversarial Attacks against Transformers via Attachable Subwords Substitution31 Oct 2022
- 2022Precisely the Point: Adversarial Augmentations for Faithful and Informative Text Generation22 Oct 2022
50 newest of 105 All 105 (JSON)
- 2021The Curious Case of Hallucinations in Neural Machine Translationcited by 161
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 91
- 2021Data Augmentation Approaches in Natural Language Processing: A Surveycited by 82
- 2021Pyramid Adversarial Training Improves ViT Performancecited by 39
- 2021Evaluating Saliency Methods for Neural Language Modelscited by 37
- 2021On Compositional Generalization of Neural Machine Translationcited by 34
- 2023Prompt Optimization via Adversarial In-Context Learningcited by 33
- 2022Character-level White-Box Adversarial Attacks against Transformers via Attachable Subwords Substitutioncited by 28
- 2021MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillationcited by 27
12 most cited of 103 All 103 (JSON)
- 2025Expert-guided Clinical Text Augmentation via Query-Based Model Collaboration25 Sep 2025
- 2025RanAT4BIE: Random Adversarial Training for Biomedical Information Extraction14 Sep 2025
- 2025Multi-task Adversarial Attacks against Black-box Model with Few-shot Queries10 Aug 2025
- 2025Disappearing Ink: Obfuscation Breaks N-gram Code Watermarks in Theory and Practice7 Jul 2025
- 2025GenoArmory: A Unified Evaluation Framework for Adversarial Attacks on Genomic Foundation Models16 May 2025
- 2025Misspellings in Natural Language Processing: A survey28 Jan 2025
- 2025Extend Adversarial Policy Against Neural Machine Translation via Unknown Token21 Jan 2025
- 2024NMT-Obfuscator Attack: Ignore a sentence in translation with only one word19 Nov 2024
- 2024Vision-fused Attack: Advancing Aggressive and Stealthy Adversarial Text against Neural Machine Translation8 Sep 2024
- 2024Deterministic Reversible Data Augmentation for Neural Machine Translation4 Jun 2024
- 2024An Empirical Study on the Robustness of Massively Multilingual Neural Machine Translation13 May 2024
- 2024ASAM: Boosting Segment Anything Model with Adversarial Tuning1 May 2024
12 newest of 103 All 103 (JSON)