Sentence Concatenation Approach to Data Augmentation for Neural Machine Translation
Not on the map. Why?
Abstract (arXiv)
Neural machine translation (NMT) has recently gained widespread attention because of its high translation accuracy. However, it shows poor performance in the translation of long sentences, which is a major issue in low-resource languages. It is assumed that this issue is caused by insufficient number of long sentences in the training data. Therefore, this study proposes a simple data augmentation method to handle long sentences. In this method, we use only the given parallel corpora as the training data and generate long sentences by concatenating two sentences. Based on the experimental results, we confirm improvements in long sentence translation by the proposed data augmentation method, despite its simplicity. Moreover, the translation quality is further improved by the proposed method, when combined with back-translation.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 9 of its 15 references that are in the map. First posted on arXiv 17 Apr 2021.
Builds on
9 of 15 references.
References · 9
- 2017Attention Is All You Needcited by 59,932
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
- 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
- 2017Six Challenges for Neural Machine Translationcited by 334
- 2020MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text Classificationcited by 186
- 2018SwitchOut: an Efficient Data Augmentation Algorithm for Neural Machine Translationcited by 72
- 2016Neural Machine Translation with Reconstructioncited by 28
- 2017Enabling Multi-Source Neural Machine Translation By Concatenating Source Sentences In Multiple Languagescited by 10
Built on by
Citing papers per year: 2021: 2; 2022: 3; 2023: 1; 2024: 1; 2025: 1.
8 papers.
- 2021Sequence Length is a Domain: Length-based Overfitting in Transformer Modelscited by 34
- 2021Data Augmentation by Concatenation for Low-Resource Translation: A Mystery and a Solutioncited by 11
- 2022SegAugment: Maximizing the Utility of Speech Translation Data with Segmentation-based Augmentationscited by 6
- 2022Checks and Strategies for Enabling Code-Switched Machine Translationcited by 3
- 2022Joint Speech Transcription and Translation: Pseudo-Labeling with Out-of-Distribution Datacited by 3
- 2023DSS: Synthesizing long Digital Ink using Data augmentation, Style encoding and Split generationcited by 2
- 2024Non-Fluent Synthetic Target-Language Data Improve Neural Machine Translationcited by 0
- 2025From Scarcity to Efficiency: Investigating the Effects of Data Augmentation on African Machine Translationcited by 0
- 2025From Scarcity to Efficiency: Investigating the Effects of Data Augmentation on African Machine Translation9 Sep 2025
- 2024Non-Fluent Synthetic Target-Language Data Improve Neural Machine Translation29 Jan 2024
- 2023DSS: Synthesizing long Digital Ink using Data augmentation, Style encoding and Split generation29 Nov 2023
- 2022Joint Speech Transcription and Translation: Pseudo-Labeling with Out-of-Distribution Data20 Dec 2022
- 2022SegAugment: Maximizing the Utility of Speech Translation Data with Segmentation-based Augmentations19 Dec 2022
- 2022Checks and Strategies for Enabling Code-Switched Machine Translation11 Oct 2022
- 2021Sequence Length is a Domain: Length-based Overfitting in Transformer Models15 Sep 2021
- 2021Data Augmentation by Concatenation for Low-Resource Translation: A Mystery and a Solution4 May 2021