Tagged Back-Translation
Not on the map. Why?
Abstract (arXiv)
Recent work in Neural Machine Translation (NMT) has shown significant quality gains from noised-beam decoding during back-translation, a method to generate synthetic parallel data. We show that the main role of such synthetic noise is not to diversify the source side, as previously suggested, but simply to indicate to the model that the given source is synthetic. We propose a simpler alternative to noising techniques, consisting of tagging back-translated source sentences with an extra token. Our results on WMT outperform noised back-translation in English-Romanian and match performance on English-German, re-defining state-of-the-art in the former.
Key facts. Cited by 76 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 26; 2022: 16; 2023: 14; 2024: 12; 2025: 5; 2026: 3.
76 papers.
Sort:
By area:
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2023Prompting Large Language Model for Machine Translation: A Case Studycited by 247
- 2023Self-Alignment with Instruction Backtranslationcited by 149
- 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 108
- 2024Best Practices and Lessons Learned on Synthetic Datacited by 104
- 2021Survey of Low-Resource Machine Translationcited by 92
- 2021Synthetic Data Generation for Grammatical Error Correction with Tagged Corruption Modelscited by 56
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2021Why don't people use character-level machine translation?cited by 27
- 2022Using natural language prompts for machine translationcited by 27
- 2021Isometric MT: Neural Machine Translation for Automatic Dubbingcited by 18
- 2023DUB: Discrete Unit Back-translation for Speech Translationcited by 18
38 more
- 2025Enhancing LLM Safety Through a Theoretical Minimax Game Lenscited by 18
- 2021Rethinking Perturbations in Encoder-Decoders for Fast Trainingcited by 17
- 2021Self-Training Sampling with Monolingual Data Uncertainty for Neural Machine Translationcited by 17
- 2021Improving Neural Machine Translation by Bidirectional Trainingcited by 17
- 2021A Survey on Low-Resource Neural Machine Translationcited by 16
- 2021On the Complementarity between Pre-Training and Back-Translation for Neural Machine Translationcited by 14
- 2022Understanding Translationese in Cross-Lingual Summarizationcited by 14
- 2022Tencent's Multilingual Machine Translation System for WMT22 Large-Scale African Languagescited by 13
- 2021On the Language Coverage Bias for Neural Machine Translationcited by 12
- 2021Self-supervised and Supervised Joint Training for Resource-rich Machine Translationcited by 12
- 2022Domain-Specific Text Generation for Machine Translationcited by 12
- 2021The USYD-JD Speech Translation System for IWSLT 2021cited by 11
- 2021WeChat Neural Machine Translation Systems for WMT21cited by 11
- 2021Hierarchical Neural Data Synthesis for Semantic Parsingcited by 11
- 2022Non-Autoregressive Machine Translation: It's Not as Fast as it Seemscited by 11
- 2021Comparison of Grammatical Error Correction Using Back-Translation Modelscited by 9
- 2023Back Translation for Speech-to-text Translation Without Transcriptscited by 9
- 2023Quality-Aware Translation Models: Efficient Generation and Quality Estimation in a Single Modelcited by 9
- 2021Multi-Domain Adaptation in Neural Machine Translation Through Multidimensional Taggingcited by 8
- 2021Rethinking Data Augmentation for Low-Resource Neural Machine Translation: A Multi-Task Learning Approachcited by 8
- 2022ExtraPhrase: Efficient Data Augmentation for Abstractive Summarizationcited by 8
- 2024Scaling Sign Language Translationcited by 8
- 2023Bilex Rx: Lexical Data Augmentation for Massively Multilingual Machine Translationcited by 7
- 2023Neural Machine Translation for the Indigenous Languages of the Americas: An Introductioncited by 7
- 2023Tagged End-to-End Simultaneous Speech Translation Training using Simultaneous Interpretation Datacited by 6
- 2022Cyberbullying Classifiers are Sensitive to Model-Agnostic Perturbationscited by 5
- 2022Geographical Distance Is The New Hyperparameter: A Case Study Of Finding The Optimal Pre-trained Language For English-isiZulu Machine Translationcited by 5
- 2022Exploring Diversity in Back Translation for Low-Resource Machine Translationcited by 5
- 2023Translating away Translationese without Parallel Datacited by 5
- 2024Rule-Based, Neural and LLM Back-Translation: Comparative Insights from a Variant of Ladincited by 5
- 2021AUGVIC: Exploiting BiText Vicinity for Low-Resource NMTcited by 4
- 2021On Systematic Style Differences between Unsupervised and Supervised MT and an Application for High-Resource Machine Translationcited by 4
- 2022Improving Neural Machine Translation by Denoising Trainingcited by 4
- 2023On Synthetic Data for Back Translationcited by 4
- 2024Choose the Final Translation from NMT and LLM hypotheses Using MBR Decoding: HW-TSC's Submission to the WMT24 General MT Shared Taskcited by 4
- 2021The Volctrans Neural Speech Translation System for IWSLT 2021cited by 3
- 2021Alternated Training with Synthetic and Authentic Data for Neural Machine Translationcited by 3
- 2021HintedBT: Augmenting Back-Translation with Quality and Transliteration Hintscited by 3
50 most cited of 76 All 76 (JSON)
- 2026How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text30 Sep 2026
- 2026Decoupling Token Roles in Autoregressive Pretraining27 Sep 2026
- 2026Leveraging Sentence-oriented Augmentation and Transformer-Based Architecture for Vietnamese-Bahnaric Translation27 Jan 2026
- 2025TopXGen: Topic-Diverse Parallel Data Generation for Low-Resource Machine Translation12 Aug 2025
- 2025Optimal Corpus Aware Training for Neural Machine Translation7 Aug 2025
- 2025Treasure Hunt: Real-time Targeting of the Long Tail using Training-Time Markers17 Jun 2025
- 2025Improving Retrieval-Augmented Neural Machine Translation with Monolingual Data30 Apr 2025
- 2025Enhancing LLM Safety Through a Theoretical Minimax Game Lens7 Feb 2025
- 2024Quantity vs. Quality of Monolingual Source Data in Automatic Text Translation: Can It Be Too Little If It Is Too Good?17 Oct 2024
- 2024Exploring the traditional NMT model and Large Language Model for chat translation24 Sep 2024
- 2024Machine Translation Advancements of Low-Resource Indian Languages by Transfer Learning24 Sep 2024
- 2024HW-TSC's Submission to the CCMT 2024 Machine Translation Tasks23 Sep 2024
38 more
- 2024Choose the Final Translation from NMT and LLM hypotheses Using MBR Decoding: HW-TSC's Submission to the WMT24 General MT Shared Task23 Sep 2024
- 2024Generating Gender Alternatives in Machine Translation29 Jul 2024
- 2024Scaling Sign Language Translation16 Jul 2024
- 2024Rule-Based, Neural and LLM Back-Translation: Comparative Insights from a Variant of Ladin11 Jul 2024
- 2024Semi-Supervised Spoken Language Glossification12 Jun 2024
- 2024Best Practices and Lessons Learned on Synthetic Data11 Apr 2024
- 2024The Impact of Syntactic and Semantic Proximity on Machine Translation with Back-Translation26 Mar 2024
- 2024Non-Fluent Synthetic Target-Language Data Improve Neural Machine Translation29 Jan 2024
- 2023Translating away Translationese without Parallel Data28 Oct 2023
- 2023On Synthetic Data for Back Translation20 Oct 2023
- 2023Quality-Aware Translation Models: Efficient Generation and Quality Estimation in a Single Model10 Oct 2023
- 2023QS-TTS: Towards Semi-Supervised Text-to-Speech Synthesis via Vector-Quantized Self-Supervised Speech Representation Learning31 Aug 2023
- 2023Self-Alignment with Instruction Backtranslation11 Aug 2023
- 2023Tagged End-to-End Simultaneous Speech Translation Training using Simultaneous Interpretation Data14 Jun 2023
- 2023Neural Machine Translation for the Indigenous Languages of the Americas: An Introduction11 Jun 2023
- 2023Improving Language Model Integration for Neural Machine Translation8 Jun 2023
- 2023Text Style Transfer Back-Translation2 Jun 2023
- 2023DUB: Discrete Unit Back-translation for Speech Translation19 May 2023
- 2023Back Translation for Speech-to-text Translation Without Transcripts15 May 2023
- 2023Bilex Rx: Lexical Data Augmentation for Massively Multilingual Machine Translation27 Mar 2023
- 2023Towards Reliable Neural Machine Translation with Consistency-Aware Meta-Learning20 Mar 2023
- 2023Prompting Large Language Model for Machine Translation: A Case Study17 Jan 2023
- 2022Original or Translated? On the Use of Parallel Data for Translation Quality Estimation20 Dec 2022
- 2022Understanding Translationese in Cross-Lingual Summarization14 Dec 2022
- 2022CUNI Systems for the WMT22 Czech-Ukrainian Translation Task1 Dec 2022
- 2022Tencent's Multilingual Machine Translation System for WMT22 Large-Scale African Languages18 Oct 2022
- 2022Domain-Specific Text Generation for Machine Translation11 Aug 2022
- 2022Finding the Right Recipe for Low Resource Domain Adaptation in Neural Machine Translation2 Jun 2022
- 2022Exploring Diversity in Back Translation for Low-Resource Machine Translation1 Jun 2022
- 2022Lack of Fluency is Hurting Your Translation Model24 May 2022
- 2022Geographical Distance Is The New Hyperparameter: A Case Study Of Finding The Optimal Pre-trained Language For English-isiZulu Machine Translation17 May 2022
- 2022Non-Autoregressive Machine Translation: It's Not as Fast as it Seems4 May 2022
- 2022PaLM: Scaling Language Modeling with Pathways5 Apr 2022
- 2022Using natural language prompts for machine translation23 Feb 2022
- 2022End-to-End Training for Back-Translation with Categorical Reparameterization Trick17 Feb 2022
- 2022Improving Neural Machine Translation by Denoising Training19 Jan 2022
- 2022Cyberbullying Classifiers are Sensitive to Model-Agnostic Perturbations17 Jan 2022
- 2022ExtraPhrase: Efficient Data Augmentation for Abstractive Summarization14 Jan 2022
50 newest of 76 All 76 (JSON)
- 2024Best Practices and Lessons Learned on Synthetic Datacited by 104
- 2021Hierarchical Neural Data Synthesis for Semantic Parsingcited by 11
- 2024Best Practices and Lessons Learned on Synthetic Data11 Apr 2024
- 2021Hierarchical Neural Data Synthesis for Semantic Parsing4 Dec 2021
- 2025Enhancing LLM Safety Through a Theoretical Minimax Game Lenscited by 18
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2023Prompting Large Language Model for Machine Translation: A Case Studycited by 247
- 2023Self-Alignment with Instruction Backtranslationcited by 149
- 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 108
- 2021Survey of Low-Resource Machine Translationcited by 92
- 2021Synthetic Data Generation for Grammatical Error Correction with Tagged Corruption Modelscited by 56
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2021Why don't people use character-level machine translation?cited by 27
- 2022Using natural language prompts for machine translationcited by 27
- 2021Isometric MT: Neural Machine Translation for Automatic Dubbingcited by 18
- 2023DUB: Discrete Unit Back-translation for Speech Translationcited by 18
- 2021Rethinking Perturbations in Encoder-Decoders for Fast Trainingcited by 17
12 most cited of 72 All 72 (JSON)
- 2026How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text30 Sep 2026
- 2026Decoupling Token Roles in Autoregressive Pretraining27 Sep 2026
- 2026Leveraging Sentence-oriented Augmentation and Transformer-Based Architecture for Vietnamese-Bahnaric Translation27 Jan 2026
- 2025TopXGen: Topic-Diverse Parallel Data Generation for Low-Resource Machine Translation12 Aug 2025
- 2025Optimal Corpus Aware Training for Neural Machine Translation7 Aug 2025
- 2025Treasure Hunt: Real-time Targeting of the Long Tail using Training-Time Markers17 Jun 2025
- 2024Quantity vs. Quality of Monolingual Source Data in Automatic Text Translation: Can It Be Too Little If It Is Too Good?17 Oct 2024
- 2024Exploring the traditional NMT model and Large Language Model for chat translation24 Sep 2024
- 2024Machine Translation Advancements of Low-Resource Indian Languages by Transfer Learning24 Sep 2024
- 2024HW-TSC's Submission to the CCMT 2024 Machine Translation Tasks23 Sep 2024
- 2024Choose the Final Translation from NMT and LLM hypotheses Using MBR Decoding: HW-TSC's Submission to the WMT24 General MT Shared Task23 Sep 2024
- 2024Generating Gender Alternatives in Machine Translation29 Jul 2024
12 newest of 72 All 72 (JSON)