Sub-Word Alignment Is Still Useful: A Vest-Pocket Method for Enhancing Low-Resource Machine Translation
Not on the map. Why?
Abstract (arXiv)
We leverage embedding duplication between aligned sub-words to extend the Parent-Child transfer learning method, so as to improve low-resource machine translation. We conduct experiments on benchmark datasets of My-En, Id-En and Tr-En translation scenarios. The test results show that our method produces substantial improvements, achieving the BLEU scores of 22.5, 28.0 and 18.1 respectively. In addition, the method is computationally efficient which reduces the consumption of training time by 63.8%, reaching the duration of 1.6 hours when training on a Tesla 16GB P100 GPU. All the models and source codes in the experiments will be made publicly available to support reproducible research.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 25 of its 35 references that are in the map. First posted on arXiv 9 May 2022.
Builds on
25 of 35 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
- 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
- 2017Word Translation Without Parallel Datacited by 480
- 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 467
- 2017Six Challenges for Neural Machine Translationcited by 334
- 2017Unsupervised Machine Translation Using Monolingual Corpora Onlycited by 272
- 2016Transfer Learning for Low-Resource Neural Machine Translationcited by 188
- 2017Unsupervised Neural Machine Translationcited by 148
- 2019Choosing Transfer Languages for Cross-Lingual Learningcited by 143
13 more
- 2018Phrase-Based & Neural Unsupervised Machine Translationcited by 138
- 2016Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanismcited by 117
- 2018Meta-Learning for Low-Resource Neural Machine Translationcited by 105
- 2018Universal Neural Machine Translation for Extremely Low Resource Languagescited by 66
- 2018On the Limitations of Unsupervised Bilingual Dictionary Inductioncited by 61
- 2017Transfer Learning across Low-Resource, Related Languages for Neural Machine Translationcited by 58
- 2016Fully Character-Level Neural Machine Translation without Explicit Segmentationcited by 55
- 2018Trivial Transfer Learning for Low-Resource Neural Machine Translationcited by 47
- 2019Effective Cross-lingual Transfer of Neural Machine Translation Models without Shared Vocabulariescited by 27
- 2016Neural Machine Translation with Pivot Languagescited by 25
- 2016Towards cross-lingual distributed representations without parallel text trained with adversarial autoencoderscited by 13
- 2019A Universal Parent Model for Low-Resource Neural Machine Translation Transfercited by 10
- 2019Improving Unsupervised Word-by-Word Translation with Language Model and Denoising Autoencodercited by 5
Built on by
Citing papers per year: 2022: 2; 2023: 0; 2024: 0; 2025: 1.
3 papers.