On the Impact of Various Types of Noise on Neural Machine Translation
Not on the map. Why?
Abstract (arXiv)
We examine how various types of noise in the parallel training data impact the quality of neural machine translation systems. We create five types of artificial noise and analyze how they degrade performance in neural and statistical machine translation. We find that neural models are generally more harmed by noise than statistical models. For one especially egregious type of noise they learn to just copy the input sentence.
Key facts. Cited by 76 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 21; 2022: 16; 2023: 16; 2024: 16; 2025: 6; 2026: 1.
76 papers.
Sort:
By area:
- 2021Dynabench: Rethinking Benchmarking in NLPcited by 447
- 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 241
- 2021Leveraging Automated Unit Tests for Unsupervised Code Translationcited by 82
- 2021Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translationcited by 63
- 2021Understanding the Properties of Minimum Bayes Risk Decoding in Neural Machine Translationcited by 56
- 2022Data Scaling Laws in NMT: The Effect of Noise and Architecturecited by 55
- 2021Robust Open-Vocabulary Translation from Visual Text Representationscited by 47
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2023Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Decodingcited by 42
- 2024X-ALMA: Plug & Play Modules and Adaptive Rejection for Quality Translation at Scalecited by 36
- 2024A Shocking Amount of the Web is Machine Translated: Insights from Multi-Way Parallelismcited by 33
- 2023Dissociating language and thought in large language modelscited by 27
38 more
- 2022Pre-Trained Multilingual Sequence-to-Sequence Models: A Hope for Low-Resource Language Translation?cited by 24
- 2023There's no Data Like Better Data: Using QE Metrics for MT Data Filteringcited by 19
- 2023Aligning Neural Machine Translation Models: Human Feedback in Training and Inferencecited by 19
- 2023Make Every Example Count: On the Stability and Utility of Self-Influence for Learning from Noisy NLP Datasetscited by 18
- 2024Multi-News+: Cost-efficient Dataset Cleansing via LLM-based Data Annotationcited by 16
- 2021On the Copying Behaviors of Pre-Training for Neural Machine Translationcited by 15
- 2023Exploiting Biased Models to De-bias Text: A Gender-Fair Rewriting Modelcited by 14
- 2024Quality Does Matter: A Detailed Look at the Quality and Utility of Web-Mined Parallel Corporacited by 13
- 2022Data Selection Curriculum for Neural Machine Translationcited by 11
- 2024Critical Learning Periods: Leveraging Early Training Dynamics for Efficient Data Pruningcited by 10
- 2021Generating Synthetic Text Data to Evaluate Causal Inference Methodscited by 9
- 2021Beyond Noise: Mitigating the Impact of Fine-grained Semantic Divergences on Neural Machine Translationcited by 9
- 2022CipherDAug: Ciphertext based Data Augmentation for Neural Machine Translationcited by 9
- 2023SentAlign: Accurate and Scalable Sentence Alignmentcited by 9
- 2024Did Translation Models Get More Robust Without Anyone Even Noticing?cited by 9
- 2024A Preference-driven Paradigm for Enhanced Translation with Large Language Modelscited by 9
- 2024Adapters for Altering LLM Vocabularies: What Languages Benefit the Most?cited by 9
- 2021Gradient-guided Loss Masking for Neural Machine Translationcited by 8
- 2021Rethinking Data Augmentation for Low-Resource Neural Machine Translation: A Multi-Task Learning Approachcited by 8
- 2021Improving Arabic Diacritization by Learning to Diacritize and Translatecited by 6
- 2022Improving Multilingual Neural Machine Translation System for Indic Languagescited by 6
- 2022Simultaneous Translation for Unsegmented Input: A Sliding Window Approachcited by 6
- 2022Separating Grains from the Chaff: Using Data Filtering to Improve Multilingual Translation for Low-Resourced African Languagescited by 6
- 2023Error Norm Truncation: Robust Training in the Presence of Data Noise for Text Generation Modelscited by 6
- 2021Noisy UGC Translation at the Character Level: Revisiting Open-Vocabulary Capabilities and Robustness of Char-Based Modelscited by 5
- 2023When Vision Fails: Text Attacks Against ViT and OCRcited by 5
- 2023On-the-Fly Fusion of Large Language Models and Machine Translationcited by 5
- 2021Pushing the Right Buttons: Adversarial Evaluation of Quality Estimationcited by 4
- 2022Scientometric Review of Artificial Intelligence for Operations & Maintenance of Wind Turbines: The Past, Present and Futurecited by 4
- 2022Generating Authentic Adversarial Examples beyond Meaning-preserving with Doubly Round-trip Translationcited by 4
- 2024How to Learn in a Noisy World? Self-Correcting the Real-World Data Noise in Machine Translationcited by 4
- 2021Segmenting Subtitles for Correcting ASR Segmentation Errorscited by 3
- 2021BitextEdit: Automatic Bitext Editing for Improved Low-Resource Machine Translationcited by 3
- 2022Rare but Severe Neural Machine Translation Errors Induced by Minimal Deletion: An Empirical Study on Chinese and Englishcited by 3
- 2022Analyzing the Use of Influence Functions for Instance-Specific Data Filtering in Neural Machine Translationcited by 3
- 2023An Investigation of Noise in Morphological Inflectioncited by 3
- 2024Learning from Many Voices: Literary MT Using Multi-Reference Human and Synthetic Datacited by 3
- 2025Improving the quality of Web-mined Parallel Corpora of Low-Resource Languages using Debiasing Heuristicscited by 3
50 most cited of 76 All 76 (JSON)
- 2026"Chi nas dal soch el sent de legn" -- Auditing Text Corpora for Lombard4 Jun 2026
- 2025ACADATA: Parallel Dataset of Academic Data for Machine Translation14 Oct 2025
- 2025Speech Vecalign: an Embedding-based Method for Aligning Parallel Speech Documents22 Sep 2025
- 2025BRIGHT+: Upgrading the BRIGHT Benchmark with MARCUS, a Multi-Agent RAG Clean-Up Suite8 Jun 2025
- 2025A Representation Level Analysis of NMT Model Robustness to Grammatical Errors27 May 2025
- 2025Improving the quality of Web-mined Parallel Corpora of Low-Resource Languages using Debiasing Heuristics26 Feb 2025
- 2025Evaluating Robustness of LLMs in Question Answering on Multilingual Noisy OCR Data24 Feb 2025
- 2024Learning from Many Voices: Literary MT Using Multi-Reference Human and Synthetic Data24 Dec 2024
- 2024Domain adapted machine translation: What does catastrophic forgetting forget and why?23 Dec 2024
- 2024LLM-R: A Framework for Domain-Adaptive Maintenance Scheme Generation Combining Hierarchical Agents and RAG7 Nov 2024
- 2024Adapters for Altering LLM Vocabularies: What Languages Benefit the Most?12 Oct 2024
- 2024Cogs in a Machine, Doing What They're Meant to Do -- The AMI Submission to the WMT24 General Translation Task4 Oct 2024
38 more
- 2024X-ALMA: Plug & Play Modules and Adaptive Rejection for Quality Translation at Scale4 Oct 2024
- 2024How to Learn in a Noisy World? Self-Correcting the Real-World Data Noise in Machine Translation2 Jul 2024
- 2024Critical Learning Periods: Leveraging Early Training Dynamics for Efficient Data Pruning29 May 2024
- 2024A Preference-driven Paradigm for Enhanced Translation with Large Language Models17 Apr 2024
- 2024Multi-News+: Cost-efficient Dataset Cleansing via LLM-based Data Annotation15 Apr 2024
- 2024Adaptative Bilingual Aligning Using Multilingual Sentence Embedding18 Mar 2024
- 2024Did Translation Models Get More Robust Without Anyone Even Noticing?6 Mar 2024
- 2024Quality Does Matter: A Detailed Look at the Quality and Utility of Web-Mined Parallel Corpora12 Feb 2024
- 2024Non-Fluent Synthetic Target-Language Data Improve Neural Machine Translation29 Jan 2024
- 2024An approach for mistranslation removal from popular dataset for Indic MT Task12 Jan 2024
- 2024A Shocking Amount of the Web is Machine Translated: Insights from Multi-Way Parallelism11 Jan 2024
- 2023Aligning Neural Machine Translation Models: Human Feedback in Training and Inference15 Nov 2023
- 2023SentAlign: Accurate and Scalable Sentence Alignment15 Nov 2023
- 2023On-the-Fly Fusion of Large Language Models and Machine Translation14 Nov 2023
- 2023Separating the Wheat from the Chaff with BREAD: An open-source benchmark and metrics to detect redundancy in text11 Nov 2023
- 2023There's no Data Like Better Data: Using QE Metrics for MT Data Filtering9 Nov 2023
- 2023Reference Free Domain Adaptation for Translation of Noisy Questions with Question Specific Rewards23 Oct 2023
- 2023Error Norm Truncation: Robust Training in the Presence of Data Noise for Text Generation Models2 Oct 2023
- 2023Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Decoding13 Sep 2023
- 2023Impact of Visual Context on Noisy Multimodal NMT: An Empirical Study for English to Indian Languages30 Aug 2023
- 2023When Vision Fails: Text Attacks Against ViT and OCR12 Jun 2023
- 2023"A Little is Enough": Few-Shot Quality Estimation based Corpus Filtering improves Machine Translation6 Jun 2023
- 2023An Investigation of Noise in Morphological Inflection26 May 2023
- 2023Out-of-Distribution Generalization in Text Classification: Past, Present, and Future23 May 2023
- 2023Exploiting Biased Models to De-bias Text: A Gender-Fair Rewriting Model18 May 2023
- 2023Make Every Example Count: On the Stability and Utility of Self-Influence for Learning from Noisy NLP Datasets27 Feb 2023
- 2023Dissociating language and thought in large language models16 Jan 2023
- 2022Learnings from Technological Interventions in a Low Resource Language: Enhancing Information Access in Gondi29 Nov 2022
- 2022Competency-Aware Neural Machine Translation: Can Machine Translation Know its Own Translation Quality?25 Nov 2022
- 2022Analyzing the Use of Influence Functions for Instance-Specific Data Filtering in Neural Machine Translation24 Oct 2022
- 2022Separating Grains from the Chaff: Using Data Filtering to Improve Multilingual Translation for Low-Resourced African Languages19 Oct 2022
- 2022Simultaneous Translation for Unsegmented Input: A Sliding Window Approach18 Oct 2022
- 2022Improving Multilingual Neural Machine Translation System for Indic Languages27 Sep 2022
- 2022Rare but Severe Neural Machine Translation Errors Induced by Minimal Deletion: An Empirical Study on Chinese and English5 Sep 2022
- 2022Open Terminology Management and Sharing Toolkit for Federation of Terminology Databases14 Jul 2022
- 2022Machine Translation Robustness to Natural Asemantic Variation25 May 2022
- 2022Generating Authentic Adversarial Examples beyond Meaning-preserving with Doubly Round-trip Translation19 Apr 2022
- 2022CipherDAug: Ciphertext based Data Augmentation for Neural Machine Translation1 Apr 2022
50 newest of 76 All 76 (JSON)
- 2023Dissociating language and thought in large language modelscited by 27
- 2023Dissociating language and thought in large language models16 Jan 2023
- 2021Dynabench: Rethinking Benchmarking in NLPcited by 447
- 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 241
- 2021Leveraging Automated Unit Tests for Unsupervised Code Translationcited by 82
- 2021Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translationcited by 63
- 2021Understanding the Properties of Minimum Bayes Risk Decoding in Neural Machine Translationcited by 56
- 2022Data Scaling Laws in NMT: The Effect of Noise and Architecturecited by 55
- 2021Robust Open-Vocabulary Translation from Visual Text Representationscited by 47
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2023Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Decodingcited by 42
- 2024X-ALMA: Plug & Play Modules and Adaptive Rejection for Quality Translation at Scalecited by 36
- 2024A Shocking Amount of the Web is Machine Translated: Insights from Multi-Way Parallelismcited by 33
- 2022Pre-Trained Multilingual Sequence-to-Sequence Models: A Hope for Low-Resource Language Translation?cited by 24
12 most cited of 70 All 70 (JSON)
- 2026"Chi nas dal soch el sent de legn" -- Auditing Text Corpora for Lombard4 Jun 2026
- 2025ACADATA: Parallel Dataset of Academic Data for Machine Translation14 Oct 2025
- 2025Speech Vecalign: an Embedding-based Method for Aligning Parallel Speech Documents22 Sep 2025
- 2025A Representation Level Analysis of NMT Model Robustness to Grammatical Errors27 May 2025
- 2025Improving the quality of Web-mined Parallel Corpora of Low-Resource Languages using Debiasing Heuristics26 Feb 2025
- 2025Evaluating Robustness of LLMs in Question Answering on Multilingual Noisy OCR Data24 Feb 2025
- 2024Domain adapted machine translation: What does catastrophic forgetting forget and why?23 Dec 2024
- 2024Adapters for Altering LLM Vocabularies: What Languages Benefit the Most?12 Oct 2024
- 2024Cogs in a Machine, Doing What They're Meant to Do -- The AMI Submission to the WMT24 General Translation Task4 Oct 2024
- 2024X-ALMA: Plug & Play Modules and Adaptive Rejection for Quality Translation at Scale4 Oct 2024
- 2024How to Learn in a Noisy World? Self-Correcting the Real-World Data Noise in Machine Translation2 Jul 2024
- 2024Critical Learning Periods: Leveraging Early Training Dynamics for Efficient Data Pruning29 May 2024
12 newest of 70 All 70 (JSON)