Improving Robustness of Machine Translation with Synthetic Noise
Not on the map. Why?
Abstract (arXiv)
Modern Machine Translation (MT) systems perform consistently well on clean, in-domain text. However most human generated text, particularly in the realm of social media, is full of typos, slang, dialect, idiolect and other noise which can have a disastrous impact on the accuracy of output translation. In this paper we leverage the Machine Translation of Noisy Text (MTNT) dataset to enhance the robustness of MT systems by emulating naturally occurring noise in otherwise clean data. Synthesizing noise in this manner we are ultimately able to make a vanilla MT system resilient to naturally occurring noise and partially mitigate loss in accuracy resulting therefrom.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 5; 2023: 6; 2024: 7; 2025: 3; 2026: 2.
36 papers.
Sort:
By area:
- 2021A Survey of Data Augmentation Approaches for NLPcited by 408
- 2021Measure and Improve Robustness in NLP Models: A Surveycited by 107
- 2021Robust Open-Vocabulary Translation from Visual Text Representationscited by 47
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2021Improving Zero-shot Cross-lingual Transfer between Closely Related Languages by injecting Character-level Noisecited by 19
- 2023Make Every Example Count: On the Stability and Utility of Self-Influence for Learning from Noisy NLP Datasetscited by 18
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challengescited by 18
- 2021To Augment or Not to Augment? A Comparative Study on Text Augmentation Techniques for Low-Resource NLPcited by 12
- 2024Did Translation Models Get More Robust Without Anyone Even Noticing?cited by 9
- 2021Autocorrect in the Process of Translation -- Multi-task Learning Improves Dialogue Machine Translationcited by 8
- 2022A.I. Robustness: a Human-Centered Perspective on Technological Challenges and Opportunitiescited by 8
- 2021Addressing the Vulnerability of NMT in Input Perturbationscited by 6
24 more
- 2023BERTwich: Extending BERT's Capabilities to Model Dialectal and Noisy Textcited by 6
- 2021Noisy UGC Translation at the Character Level: Revisiting Open-Vocabulary Capabilities and Robustness of Char-Based Modelscited by 5
- 2024Language and Speech Technology for Central Kurdish Varietiescited by 5
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translationcited by 5
- 2022Improving the Robustness of Summarization Models by Detecting and Removing Input Noisecited by 4
- 2021Sometimes We Want Translationesecited by 3
- 2021Data Augmentation Methods for Anaphoric Zero Pronounscited by 3
- 2022vec2text with Round-Trip Translationscited by 3
- 2022Checks and Strategies for Enabling Code-Switched Machine Translationcited by 3
- 2023ViPE: Visualise Pretty-much Everythingcited by 3
- 2025Misspellings in Natural Language Processing: A surveycited by 3
- 2021Visual Cues and Error Correction for Translation Robustnesscited by 2
- 2021Secoco: Self-Correcting Encoding for Neural Machine Translationcited by 2
- 2022PAEG: Phrase-level Adversarial Example Generation for Neural Machine Translationcited by 2
- 2024CRAT: A Multi-Agent Framework for Causality-Enhanced Reflective and Retrieval-Augmented Translation with Large Language Modelscited by 2
- 2025Fine-Tuning on Noisy Instructions: Effects on Generalization and Performancecited by 2
- 2023CharSpan: Utilizing Lexical Similarity to Enable Zero-Shot Machine Translation for Extremely Low-resource Languagescited by 1
- 2024From Priest to Doctor: Domain Adaptation for Low-Resource Neural Machine Translationcited by 1
- 2023Machine Translation Models Stand Strong in the Face of Adversarial Attackscited by 0
- 2023Evaluating Robustness of Dialogue Summarization Models in the Presence of Naturally Occurring Variationscited by 0
- 2024Harnessing the Power of Noise: A Survey of Techniques and Applicationscited by 0
- 2025In-Domain African Languages Translation Using LLMs and Multi-armed Banditscited by 0
- 2026Pre-Editorial Normalization for Automatically Transcribed Medieval Manuscripts in Old French and Latincited by 0
- 2026Different Perturbations, Different Mechanisms: Understanding Continued Pre-training for Zero-Shot Dialect Robustnesscited by 0
- 2026Different Perturbations, Different Mechanisms: Understanding Continued Pre-training for Zero-Shot Dialect Robustness6 Aug 2026
- 2026Pre-Editorial Normalization for Automatically Transcribed Medieval Manuscripts in Old French and Latin14 Feb 2026
- 2025Fine-Tuning on Noisy Instructions: Effects on Generalization and Performance3 Oct 2025
- 2025In-Domain African Languages Translation Using LLMs and Multi-armed Bandits21 May 2025
- 2025Misspellings in Natural Language Processing: A survey28 Jan 2025
- 2024From Priest to Doctor: Domain Adaptation for Low-Resource Neural Machine Translation1 Dec 2024
- 2024CRAT: A Multi-Agent Framework for Causality-Enhanced Reflective and Retrieval-Augmented Translation with Large Language Models28 Oct 2024
- 2024Harnessing the Power of Noise: A Survey of Techniques and Applications8 Oct 2024
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challenges24 May 2024
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translation25 Mar 2024
- 2024Did Translation Models Get More Robust Without Anyone Even Noticing?6 Mar 2024
- 2024Language and Speech Technology for Central Kurdish Varieties4 Mar 2024
24 more
- 2023Evaluating Robustness of Dialogue Summarization Models in the Presence of Naturally Occurring Variations15 Nov 2023
- 2023BERTwich: Extending BERT's Capabilities to Model Dialectal and Noisy Text31 Oct 2023
- 2023ViPE: Visualise Pretty-much Everything16 Oct 2023
- 2023Machine Translation Models Stand Strong in the Face of Adversarial Attacks10 Sep 2023
- 2023CharSpan: Utilizing Lexical Similarity to Enable Zero-Shot Machine Translation for Extremely Low-resource Languages9 May 2023
- 2023Make Every Example Count: On the Stability and Utility of Self-Influence for Learning from Noisy NLP Datasets27 Feb 2023
- 2022Improving the Robustness of Summarization Models by Detecting and Removing Input Noise20 Dec 2022
- 2022A.I. Robustness: a Human-Centered Perspective on Technological Challenges and Opportunities17 Oct 2022
- 2022Checks and Strategies for Enabling Code-Switched Machine Translation11 Oct 2022
- 2022vec2text with Round-Trip Translations14 Sep 2022
- 2022PAEG: Phrase-level Adversarial Example Generation for Neural Machine Translation6 Jan 2022
- 2021Measure and Improve Robustness in NLP Models: A Survey15 Dec 2021
- 2021To Augment or Not to Augment? A Comparative Study on Text Augmentation Techniques for Low-Resource NLP18 Nov 2021
- 2021Noisy UGC Translation at the Character Level: Revisiting Open-Vocabulary Capabilities and Robustness of Char-Based Models24 Oct 2021
- 2021Data Augmentation Methods for Anaphoric Zero Pronouns20 Sep 2021
- 2021Improving Zero-shot Cross-lingual Transfer between Closely Related Languages by injecting Character-level Noise14 Sep 2021
- 2021Secoco: Self-Correcting Encoding for Neural Machine Translation27 Aug 2021
- 2021A Survey of Data Augmentation Approaches for NLP7 May 2021
- 2021Addressing the Vulnerability of NMT in Input Perturbations20 Apr 2021
- 2021Robust Open-Vocabulary Translation from Visual Text Representations16 Apr 2021
- 2021Sometimes We Want Translationese15 Apr 2021
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Survey14 Apr 2021
- 2021Autocorrect in the Process of Translation -- Multi-task Learning Improves Dialogue Machine Translation30 Mar 2021
- 2021Visual Cues and Error Correction for Translation Robustness12 Mar 2021
- 2021A Survey of Data Augmentation Approaches for NLPcited by 408
- 2021Measure and Improve Robustness in NLP Models: A Surveycited by 107
- 2021Robust Open-Vocabulary Translation from Visual Text Representationscited by 47
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2021Improving Zero-shot Cross-lingual Transfer between Closely Related Languages by injecting Character-level Noisecited by 19
- 2023Make Every Example Count: On the Stability and Utility of Self-Influence for Learning from Noisy NLP Datasetscited by 18
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challengescited by 18
- 2021To Augment or Not to Augment? A Comparative Study on Text Augmentation Techniques for Low-Resource NLPcited by 12
- 2024Did Translation Models Get More Robust Without Anyone Even Noticing?cited by 9
- 2021Autocorrect in the Process of Translation -- Multi-task Learning Improves Dialogue Machine Translationcited by 8
- 2022A.I. Robustness: a Human-Centered Perspective on Technological Challenges and Opportunitiescited by 8
- 2021Addressing the Vulnerability of NMT in Input Perturbationscited by 6
12 most cited of 35 All 35 (JSON)
- 2026Different Perturbations, Different Mechanisms: Understanding Continued Pre-training for Zero-Shot Dialect Robustness6 Aug 2026
- 2026Pre-Editorial Normalization for Automatically Transcribed Medieval Manuscripts in Old French and Latin14 Feb 2026
- 2025Fine-Tuning on Noisy Instructions: Effects on Generalization and Performance3 Oct 2025
- 2025In-Domain African Languages Translation Using LLMs and Multi-armed Bandits21 May 2025
- 2025Misspellings in Natural Language Processing: A survey28 Jan 2025
- 2024From Priest to Doctor: Domain Adaptation for Low-Resource Neural Machine Translation1 Dec 2024
- 2024Harnessing the Power of Noise: A Survey of Techniques and Applications8 Oct 2024
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challenges24 May 2024
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translation25 Mar 2024
- 2024Did Translation Models Get More Robust Without Anyone Even Noticing?6 Mar 2024
- 2024Language and Speech Technology for Central Kurdish Varieties4 Mar 2024
- 2023Evaluating Robustness of Dialogue Summarization Models in the Presence of Naturally Occurring Variations15 Nov 2023
12 newest of 35 All 35 (JSON)