AdvAug: Robust Adversarial Augmentation for Neural Machine Translation
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a new adversarial augmentation method for Neural Machine Translation (NMT). The main idea is to minimize the vicinal risk over virtual sentences sampled from two vicinity distributions, of which the crucial one is a novel vicinity distribution for adversarial sentences that describes a smooth interpolated embedding space centered around observed training sentence pairs. We then discuss our approach, AdvAug, to train NMT models using the embeddings of virtual sentences in sequence-to-sequence learning. Experiments on Chinese-English, English-French, and English-German translation benchmarks show that AdvAug achieves significant improvements over the Transformer (up to 4.9 BLEU points), and substantially outperforms other data augmentation techniques (e.g. back-translation) without using extra corpora.
Key facts. Cited by 66 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 18; 2023: 18; 2024: 7; 2025: 2; 2026: 1.
66 papers.
Sort:
By area:
- 2021A Survey of Data Augmentation Approaches for NLPcited by 408
- 2021Regularizing Generative Adversarial Networks under Limited Datacited by 105
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2021Data Augmentation Approaches in Natural Language Processing: A Surveycited by 82
- 2021Pyramid Adversarial Training Improves ViT Performancecited by 39
- 2021Faster Meta Update Strategy for Noise-Robust Deep Learningcited by 38
- 2021Evaluating Saliency Methods for Neural Language Modelscited by 37
- 2022A Survey of Mix-based Data Augmentation: Taxonomy, Methods, Applications, and Explainabilitycited by 30
- 2024Large Model Based Agents: State-of-the-Art, Cooperation Paradigms, Security and Privacy, and Future Trendscited by 26
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 22
- 2021Reweighting Augmented Samples by Minimizing the Maximal Expected Losscited by 21
- 2024A Survey on Mixup Augmentations and Beyondcited by 18
38 more
- 2022Improving Contrastive Learning of Sentence Embeddings with Case-Augmented Positives and Retrieved Negativescited by 16
- 2022TreeMix: Compositional Constituency-based Data Augmentation for Natural Language Understandingcited by 15
- 2022Learning to Generalize to More: Continuous Semantic Augmentation for Neural Machine Translationcited by 13
- 2021Self-supervised and Supervised Joint Training for Resource-rich Machine Translationcited by 12
- 2023TransFool: An Adversarial Attack against Neural Machine Translation Modelscited by 12
- 2023White-Box Multi-Objective Adversarial Attack on Dialogue Generationcited by 12
- 2021Not Far Away, Not So Close: Sample Efficient Nearest Neighbour Data Augmentation via MiniMaxcited by 10
- 2022DoubleMix: Simple Interpolation-Based Data Augmentation for Text Classificationcited by 10
- 2023Targeted Adversarial Attacks against Neural Machine Translationcited by 10
- 2023Improving the Robustness of Summarization Systems with Dual Augmentationcited by 9
- 2021As Easy as 1, 2, 3: Behavioural Testing of NMT Systems for Numerical Translationcited by 8
- 2022BLISS: Robust Sequence-to-Sequence Learning via Self-Supervised Input Representationcited by 8
- 2023Interdisciplinary Fairness in Imbalanced Research Proposal Topic Inference: A Hierarchical Transformer-based Method with Selective Interpolationcited by 8
- 2022Multilingual Mix: Example Interpolation Improves Multilingual Neural Machine Translationcited by 7
- 2022miCSE: Mutual Information Contrastive Learning for Low-shot Sentence Embeddingscited by 7
- 2023Neural Machine Translation for the Indigenous Languages of the Americas: An Introductioncited by 7
- 2023DSRM: Boost Textual Adversarial Training with Distribution Shift Risk Minimizationcited by 7
- 2021Addressing the Vulnerability of NMT in Input Perturbationscited by 6
- 2022Breaking the Representation Bottleneck of Chinese Characters: Neural Machine Translation with Stroke Sequence Modelingcited by 6
- 2024Enhancing In-Context Learning via Implicit Demonstration Augmentationcited by 6
- 2025CluCERT: Certifying LLM Robustness via Clustering-Guided Denoising Smoothingcited by 6
- 2021TopicRefine: Joint Topic Prediction and Dialogue Response Generation for Multi-turn End-to-End Dialogue Systemcited by 5
- 2022Data Augmentation for Biomedical Factoid Question Answeringcited by 5
- 2022Learning to Classify Open Intent via Soft Labeling and Manifold Mixupcited by 5
- 2023Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Modelscited by 5
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translationcited by 5
- 2021Enhancing Model Robustness By Incorporating Adversarial Knowledge Into Semantic Representationcited by 4
- 2022Generating Authentic Adversarial Examples beyond Meaning-preserving with Doubly Round-trip Translationcited by 4
- 2022AdMix: A Mixed Sample Data Augmentation Method for Neural Machine Translationcited by 4
- 2023MixPro: Simple yet Effective Data Augmentation for Prompt-based Learningcited by 4
- 2023A Classification-Guided Approach for Adversarial Attacks against Neural Machine Translationcited by 4
- 2023Investigating Zero- and Few-shot Generalization in Fact Verificationcited by 4
- 2021Sometimes We Want Translationesecited by 3
- 2022SingAug: Data Augmentation for Singing Voice Synthesis with Cycle-consistent Training Strategycited by 3
- 2023Learning to Compose Representations of Different Encoder Layers towards Improving Compositional Generalizationcited by 3
- 2024Learning under Label Noise through Few-Shot Human-in-the-Loop Refinementcited by 3
- 2021Visual Cues and Error Correction for Translation Robustnesscited by 2
- 2021ASAT: Adaptively Scaled Adversarial Training in Time Seriescited by 2
50 most cited of 66 All 66 (JSON)
- 2026SSDAU: Structured Semantic Data Augmentation for Joint Entity and Relation Extraction22 May 2026
- 2025CluCERT: Certifying LLM Robustness via Clustering-Guided Denoising Smoothing1 Dec 2025
- 2025Latent Iterative Refinement Flow: A Geometric Constrained Approach for Few-Shot Generation24 Sep 2025
- 2024Large Model Based Agents: State-of-the-Art, Cooperation Paradigms, Security and Privacy, and Future Trends22 Sep 2024
- 2024A Survey on Mixup Augmentations and Beyond8 Sep 2024
- 2024Vision-fused Attack: Advancing Aggressive and Stealthy Adversarial Text against Neural Machine Translation8 Sep 2024
- 2024Enhancing In-Context Learning via Implicit Demonstration Augmentation27 Jun 2024
- 2024Deterministic Reversible Data Augmentation for Neural Machine Translation4 Jun 2024
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translation25 Mar 2024
- 2024Learning under Label Noise through Few-Shot Human-in-the-Loop Refinement25 Jan 2024
- 2023SegMix: A Simple Structure-Aware Data Augmentation Method16 Nov 2023
- 2023Investigating Zero- and Few-shot Generalization in Fact Verification18 Sep 2023
38 more
- 2023Interdisciplinary Fairness in Imbalanced Research Proposal Topic Inference: A Hierarchical Transformer-based Method with Selective Interpolation4 Sep 2023
- 2023A Classification-Guided Approach for Adversarial Attacks against Neural Machine Translation29 Aug 2023
- 2023Layer-wise Representation Fusion for Compositional Generalization20 Jul 2023
- 2023DSRM: Boost Textual Adversarial Training with Distribution Shift Risk Minimization27 Jun 2023
- 2023Investigating Masking-based Data Generation in Language Models16 Jun 2023
- 2023Semi-supervised Relation Extraction via Data Augmentation and Consistency-training16 Jun 2023
- 2023Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Models15 Jun 2023
- 2023Neural Machine Translation for the Indigenous Languages of the Americas: An Introduction11 Jun 2023
- 2023Improving the Robustness of Summarization Systems with Dual Augmentation1 Jun 2023
- 2023Learning to Compose Representations of Different Encoder Layers towards Improving Compositional Generalization20 May 2023
- 2023Adversarial Word Dilution as Text Data Augmentation in Low-Resource Regime16 May 2023
- 2023White-Box Multi-Objective Adversarial Attack on Dialogue Generation5 May 2023
- 2023MixPro: Simple yet Effective Data Augmentation for Prompt-based Learning19 Apr 2023
- 2023Towards Reliable Neural Machine Translation with Consistency-Aware Meta-Learning20 Mar 2023
- 2023Targeted Adversarial Attacks against Neural Machine Translation2 Mar 2023
- 2023TransFool: An Adversarial Attack against Neural Machine Translation Models2 Feb 2023
- 2022A Survey of Mix-based Data Augmentation: Taxonomy, Methods, Applications, and Explainability21 Dec 2022
- 2022Breaking the Representation Bottleneck of Chinese Characters: Neural Machine Translation with Stroke Sequence Modeling23 Nov 2022
- 2022miCSE: Mutual Information Contrastive Learning for Low-shot Sentence Embeddings9 Nov 2022
- 2022Learning advisor networks for noisy image classification8 Nov 2022
- 2022Categorizing Semantic Representations for Neural Machine Translation13 Oct 2022
- 2022DoubleMix: Simple Interpolation-Based Data Augmentation for Text Classification12 Sep 2022
- 2022Improving Contrastive Learning of Sentence Embeddings with Case-Augmented Positives and Retrieved Negatives6 Jun 2022
- 2022TreeMix: Compositional Constituency-based Data Augmentation for Natural Language Understanding12 May 2022
- 2022AdMix: A Mixed Sample Data Augmentation Method for Neural Machine Translation10 May 2022
- 2022Generating Authentic Adversarial Examples beyond Meaning-preserving with Doubly Round-trip Translation19 Apr 2022
- 2022BLISS: Robust Sequence-to-Sequence Learning via Self-Supervised Input Representation16 Apr 2022
- 2022Learning to Classify Open Intent via Soft Labeling and Manifold Mixup16 Apr 2022
- 2022Learning to Generalize to More: Continuous Semantic Augmentation for Neural Machine Translation14 Apr 2022
- 2022Data Augmentation for Biomedical Factoid Question Answering10 Apr 2022
- 2022SingAug: Data Augmentation for Singing Voice Synthesis with Cycle-consistent Training Strategy31 Mar 2022
- 2022Multilingual Mix: Example Interpolation Improves Multilingual Neural Machine Translation15 Mar 2022
- 2022A Survey of Adversarial Defences and Robustness in NLP12 Mar 2022
- 2022PAEG: Phrase-level Adversarial Example Generation for Neural Machine Translation6 Jan 2022
- 2021Pyramid Adversarial Training Improves ViT Performance30 Nov 2021
- 2021Doubly-Trained Adversarial Data Augmentation for Neural Machine Translation12 Oct 2021
- 2021Data Augmentation Approaches in Natural Language Processing: A Survey5 Oct 2021
- 2021TopicRefine: Joint Topic Prediction and Dialogue Response Generation for Multi-turn End-to-End Dialogue System11 Sep 2021
50 newest of 66 All 66 (JSON)
- 2021A Survey of Data Augmentation Approaches for NLPcited by 408
- 2021Regularizing Generative Adversarial Networks under Limited Datacited by 105
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2021Data Augmentation Approaches in Natural Language Processing: A Surveycited by 82
- 2021Pyramid Adversarial Training Improves ViT Performancecited by 39
- 2021Faster Meta Update Strategy for Noise-Robust Deep Learningcited by 38
- 2021Evaluating Saliency Methods for Neural Language Modelscited by 37
- 2022A Survey of Mix-based Data Augmentation: Taxonomy, Methods, Applications, and Explainabilitycited by 30
- 2024Large Model Based Agents: State-of-the-Art, Cooperation Paradigms, Security and Privacy, and Future Trendscited by 26
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 22
- 2021Reweighting Augmented Samples by Minimizing the Maximal Expected Losscited by 21
- 2024A Survey on Mixup Augmentations and Beyondcited by 18
12 most cited of 64 All 64 (JSON)
- 2026SSDAU: Structured Semantic Data Augmentation for Joint Entity and Relation Extraction22 May 2026
- 2024Large Model Based Agents: State-of-the-Art, Cooperation Paradigms, Security and Privacy, and Future Trends22 Sep 2024
- 2024A Survey on Mixup Augmentations and Beyond8 Sep 2024
- 2024Vision-fused Attack: Advancing Aggressive and Stealthy Adversarial Text against Neural Machine Translation8 Sep 2024
- 2024Enhancing In-Context Learning via Implicit Demonstration Augmentation27 Jun 2024
- 2024Deterministic Reversible Data Augmentation for Neural Machine Translation4 Jun 2024
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translation25 Mar 2024
- 2024Learning under Label Noise through Few-Shot Human-in-the-Loop Refinement25 Jan 2024
- 2023SegMix: A Simple Structure-Aware Data Augmentation Method16 Nov 2023
- 2023Investigating Zero- and Few-shot Generalization in Fact Verification18 Sep 2023
- 2023Interdisciplinary Fairness in Imbalanced Research Proposal Topic Inference: A Hierarchical Transformer-based Method with Selective Interpolation4 Sep 2023
- 2023A Classification-Guided Approach for Adversarial Attacks against Neural Machine Translation29 Aug 2023
12 newest of 64 All 64 (JSON)