Data Augmentation for Low-Resource Neural Machine Translation
Not on the map. Why?
Abstract (arXiv)
The quality of a Neural Machine Translation system depends substantially on the availability of sizable parallel corpora. For low-resource language pairs this is not the case, resulting in poor translation quality. Inspired by work in computer vision, we propose a novel data augmentation approach that targets low-frequency words by generating new sentence pairs containing rare words in new, synthetically created contexts. Experimental results on simulated low-resource settings show that our method improves translation quality by up to 2.9 BLEU points over the baseline and up to 3.2 BLEU over back-translation.
Key facts. Cited by 139 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 55; 2022: 26; 2023: 21; 2024: 19; 2025: 13; 2026: 5.
139 papers.
Sort:
By area:
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2021A Survey of Data Augmentation Approaches for NLPcited by 409
- 2021TrivialAugment: Tuning-free Yet State-of-the-Art Data Augmentationcited by 227
- 2023PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Promptscited by 226
- 2022Learning Video Representations from Large Language Modelscited by 205
- 2021GPT3Mix: Leveraging Large-scale Language Models for Text Augmentationcited by 187
- 2023Increasing Diversity While Maintaining Accuracy: Text Data Generation with Large Language Models and Human Interventionscited by 125
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 109
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2021Survey of Low-Resource Machine Translationcited by 92
- 2021Data Augmentation Approaches in Natural Language Processing: A Surveycited by 82
38 more
- 2021NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentationcited by 73
- 2021AEDA: An Easier Data Augmentation Technique for Text Classificationcited by 67
- 2022InPars: Data Augmentation for Information Retrieval using Large Language Modelscited by 62
- 2021Neural Machine Translation with Monolingual Translation Memorycited by 61
- 2021Local Augmentation for Graph Neural Networkscited by 53
- 2021Variational Information Bottleneck for Effective Low-Resource Fine-Tuningcited by 51
- 2023Synthetic Datasets for Autonomous Driving: A Surveycited by 48
- 2021The Low-Resource Double Bind: An Empirical Study of Pruning for Low-Resource Machine Translationcited by 47
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2021MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NERcited by 42
- 2021Data Augmentation with Hierarchical SQL-to-Question Generation for Cross-domain Text-to-SQL Parsingcited by 33
- 2021FlipDA: Effective and Robust Data Augmentation for Few-Shot Learningcited by 32
- 2024A Survey on Data Augmentation in Large Model Eracited by 31
- 2021Continual Mixed-Language Pre-Training for Extremely Low-Resource Neural Machine Translationcited by 29
- 2021Robust Attentive Deep Neural Network for Exposing GAN-generated Facescited by 28
- 2021Substructure Substitution: Structured Data Augmentation for NLPcited by 25
- 2021Data Augmentation in Natural Language Processing: A Novel Text Generation Approach for Long and Short Text Classifierscited by 24
- 2021GOLD: Improving Out-of-Scope Detection in Dialogues using Data Augmentationcited by 20
- 2024Masked Thought: Simply Masking Partial Reasoning Steps Can Improve Mathematical Reasoning Learning of Language Modelscited by 20
- 2022Learning Multimodal Data Augmentation in Feature Spacecited by 18
- 2024Empowering Large Language Models for Textual Data Augmentationcited by 17
- 2024ToxiCraft: A Novel Framework for Synthetic Generation of Harmful Informationcited by 17
- 2021A Survey on Low-Resource Neural Machine Translationcited by 16
- 2023Cross-modality Data Augmentation for End-to-End Sign Language Translationcited by 16
- 2022TreeMix: Compositional Constituency-based Data Augmentation for Natural Language Understandingcited by 15
- 2021Data Augmentation for Cross-Domain Named Entity Recognitioncited by 14
- 2021Guiding Generative Language Models for Data Augmentation in Few-Shot Text Classificationcited by 14
- 2022Augraphy: A Data Augmentation Library for Document Imagescited by 14
- 2023Universal Multimodal Representation for Language Understandingcited by 14
- 2025Scaling Low-Resource MT via Synthetic Data Generation with LLMscited by 14
- 2021Phrase-level Active Learning for Neural Machine Translationcited by 13
- 2022Learning to Generalize to More: Continuous Semantic Augmentation for Neural Machine Translationcited by 13
- 2024Low-Resource Vision Challenges for Foundation Modelscited by 13
- 2021To Augment or Not to Augment? A Comparative Study on Text Augmentation Techniques for Low-Resource NLPcited by 12
- 2022TURJUMAN: A Public Toolkit for Neural Arabic Machine Translationcited by 12
- 2021Data Augmentation by Concatenation for Low-Resource Translation: A Mystery and a Solutioncited by 11
- 2021Data Augmentation for Low-Resource Named Entity Recognition Using Backtranslationcited by 10
- 2021AugLiChem: Data Augmentation Library of Chemical Structures for Machine Learningcited by 10
50 most cited of 139 All 139 (JSON)
- 2026A Factorial Study of Synthetic Data Generation for Low-Resource Machine Translation using Grammar Books24 Jul 2026
- 2026Cycle-Consistent Neural Explanation of Formal Verification Certificates23 Jun 2026
- 2026Multilingual Knowledge Transfer under Data Constraints via Lexical Interventions22 May 2026
- 2026DALDALL: Data Augmentation for Lexical and Semantic Diverse in Legal Domain by leveraging LLM-Persona24 Mar 2026
- 2026Leveraging Sentence-oriented Augmentation and Transformer-Based Architecture for Vietnamese-Bahnaric Translation27 Jan 2026
- 2025From Scarcity to Efficiency: Investigating the Effects of Data Augmentation on African Machine Translation9 Sep 2025
- 2025Transplant Then Regenerate: A New Paradigm for Text Data Augmentation20 Aug 2025
- 2025Restoring Rhythm: Punctuation Restoration Using Transformer Models for Bangla, A Low-Resource Language24 Jul 2025
- 2025Backtranslation and paraphrasing in the LLM era? Comparing data augmentation methods for emotion classification19 Jul 2025
- 2025CP-Dilatation: A Copy-and-Paste Augmentation Method for Preserving the Boundary Context Information of Histopathology Images7 Jul 2025
- 2025Measuring Intent Comprehension in LLMs19 Jun 2025
- 2025Is linguistically-motivated data augmentation worth it?4 Jun 2025
38 more
- 2025Scaling Low-Resource MT via Synthetic Data Generation with LLMs20 May 2025
- 2025Overcoming Data Scarcity in Generative Language Modelling for Low-Resource Languages: A Systematic Review7 May 2025
- 2025Data Augmentation With Back translation for Low Resource languages: A case of English and Luganda5 May 2025
- 2025Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translation2 Apr 2025
- 2025NaijaNLP: A Survey of Nigerian Low-Resource Languages27 Feb 2025
- 2025Scalable Multi-phase Word Embedding Using Conjunctive Propositional Clauses31 Jan 2025
- 2024Towards Neural No-Resource Language Translation: A Comparative Evaluation of Approaches29 Dec 2024
- 2024Towards Santali Linguistic Inclusion: Building the First Santali-to-English Translation Model using mT5 Transformer and Data Augmentation29 Nov 2024
- 2024ToxiLab: How Well Do Open-Source LLMs Generate Synthetic Toxicity Data?18 Nov 2024
- 2024Retrieval-enriched zero-shot image classification in low-resource domains1 Nov 2024
- 2024ToxiCraft: A Novel Framework for Synthetic Generation of Harmful Information23 Sep 2024
- 2024ESPERANTO: Evaluating Synthesized Phrases to Enhance Robustness in AI Detection for Text Origination22 Sep 2024
- 2024Generative-Adversarial Networks for Low-Resource Language Data Augmentation in Machine Translation24 Aug 2024
- 2024Improving Rare Word Translation With Dictionaries and Attention Masking17 Aug 2024
- 2024A Survey of Data Synthesis Approaches4 Jul 2024
- 2024Data Augmentation for Text-based Person Retrieval Using Large Language Models20 May 2024
- 2024Empowering Large Language Models for Textual Data Augmentation26 Apr 2024
- 2024Masked Thought: Simply Masking Partial Reasoning Steps Can Improve Mathematical Reasoning Learning of Language Models4 Mar 2024
- 2024A Morphologically-Aware Dictionary-based Data Augmentation Technique for Machine Translation of Under-Represented Languages2 Feb 2024
- 2024Massively Multilingual Text Translation For Low-Resource Languages29 Jan 2024
- 2024Non-Fluent Synthetic Target-Language Data Improve Neural Machine Translation29 Jan 2024
- 2024A Survey on Data Augmentation in Large Model Era27 Jan 2024
- 2024IndiText Boost: Text Augmentation for Low Resource India Languages23 Jan 2024
- 2024Enhancing Personality Recognition in Dialogue by Data Augmentation and Heterogeneous Conversational Graph Networks11 Jan 2024
- 2024Low-Resource Vision Challenges for Foundation Models9 Jan 2024
- 2023Simple and Effective Input Reformulations for Translation12 Nov 2023
- 2023TreeSwap: Data Augmentation for Machine Translation via Dependency Subtree Swapping4 Nov 2023
- 2023CrisisMatch: Semi-Supervised Few-Shot Learning for Fine-Grained Disaster Tweet Classification23 Oct 2023
- 2023On Synthetic Data for Back Translation20 Oct 2023
- 2023Steering Language Generation: Harnessing Contrastive Expert Guidance and Negative Prompting for Coherent and Diverse Synthetic Data Generation15 Aug 2023
- 2023Data Augmentation for Machine Translation via Dependency Subtree Swapping13 Jul 2023
- 2023Neural Machine Translation for the Indigenous Languages of the Americas: An Introduction11 Jun 2023
- 2023PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Prompts7 Jun 2023
- 2023Increasing Diversity While Maintaining Accuracy: Text Data Generation with Large Language Models and Human Interventions7 Jun 2023
- 2023AfriNames: Most ASR models "butcher" African Names1 Jun 2023
- 2023Towards Flow Graph Prediction of Open-Domain Procedural Texts31 May 2023
- 2023Data Augmentation for Low-Resource Keyphrase Generation29 May 2023
- 2023Parallel Corpus for Indigenous Language Translation: Spanish-Mazatec and Spanish-Mixtec27 May 2023
50 newest of 139 All 139 (JSON)
- 2025Scaling Low-Resource MT via Synthetic Data Generation with LLMscited by 14
- 2024A Survey of Data Synthesis Approachescited by 9
- 2023Steering Language Generation: Harnessing Contrastive Expert Guidance and Negative Prompting for Coherent and Diverse Synthetic Data Generationcited by 2
- 2026A Factorial Study of Synthetic Data Generation for Low-Resource Machine Translation using Grammar Bookscited by 0
- 2026A Factorial Study of Synthetic Data Generation for Low-Resource Machine Translation using Grammar Books24 Jul 2026
- 2025Scaling Low-Resource MT via Synthetic Data Generation with LLMs20 May 2025
- 2024A Survey of Data Synthesis Approaches4 Jul 2024
- 2023Steering Language Generation: Harnessing Contrastive Expert Guidance and Negative Prompting for Coherent and Diverse Synthetic Data Generation15 Aug 2023
- 2024A Survey on Data Augmentation in Large Model Eracited by 31
- 2024A Survey on Data Augmentation in Large Model Era27 Jan 2024
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2021A Survey of Data Augmentation Approaches for NLPcited by 409
- 2021TrivialAugment: Tuning-free Yet State-of-the-Art Data Augmentationcited by 227
- 2022Learning Video Representations from Large Language Modelscited by 205
- 2021GPT3Mix: Leveraging Large-scale Language Models for Text Augmentationcited by 187
- 2023Increasing Diversity While Maintaining Accuracy: Text Data Generation with Large Language Models and Human Interventionscited by 125
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 109
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2021Survey of Low-Resource Machine Translationcited by 92
- 2021Data Augmentation Approaches in Natural Language Processing: A Surveycited by 82
- 2021NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentationcited by 73
12 most cited of 131 All 131 (JSON)
- 2026Cycle-Consistent Neural Explanation of Formal Verification Certificates23 Jun 2026
- 2026Multilingual Knowledge Transfer under Data Constraints via Lexical Interventions22 May 2026
- 2026DALDALL: Data Augmentation for Lexical and Semantic Diverse in Legal Domain by leveraging LLM-Persona24 Mar 2026
- 2026Leveraging Sentence-oriented Augmentation and Transformer-Based Architecture for Vietnamese-Bahnaric Translation27 Jan 2026
- 2025From Scarcity to Efficiency: Investigating the Effects of Data Augmentation on African Machine Translation9 Sep 2025
- 2025Transplant Then Regenerate: A New Paradigm for Text Data Augmentation20 Aug 2025
- 2025Restoring Rhythm: Punctuation Restoration Using Transformer Models for Bangla, A Low-Resource Language24 Jul 2025
- 2025Backtranslation and paraphrasing in the LLM era? Comparing data augmentation methods for emotion classification19 Jul 2025
- 2025CP-Dilatation: A Copy-and-Paste Augmentation Method for Preserving the Boundary Context Information of Histopathology Images7 Jul 2025
- 2025Measuring Intent Comprehension in LLMs19 Jun 2025
- 2025Is linguistically-motivated data augmentation worth it?4 Jun 2025
- 2025Overcoming Data Scarcity in Generative Language Modelling for Low-Resource Languages: A Systematic Review7 May 2025
12 newest of 131 All 131 (JSON)