Machine Translation of Low-Resource Indo-European Languages
Not on the map. Why?
Abstract (arXiv)
In this work, we investigate methods for the challenging task of translating between low-resource language pairs that exhibit some level of similarity. In particular, we consider the utility of transfer learning for translating between several Indo-European low-resource languages from the Germanic and Romance language families. In particular, we build two main classes of transfer-based systems to study how relatedness can benefit the translation performance. The primary system fine-tunes a model pre-trained on a related language pair and the contrastive system fine-tunes one pre-trained on an unrelated language pair. Our experiments show that although relatedness is not necessary for transfer learning to work, it does benefit model performance.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 32 references that are in the map. First posted on arXiv 8 Aug 2021.
Builds on
21 of 32 references.
References · 21
- 2017Attention Is All You Needcited by 59,932
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
- 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
- 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 467
- 2017Six Challenges for Neural Machine Translationcited by 334
- 2019WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipediacited by 221
9 more
- 2018Marian: Fast Neural Machine Translation in C++cited by 202
- 2016Transfer Learning for Low-Resource Neural Machine Translationcited by 188
- 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 108
- 2018Rapid Adaptation of Neural Machine Translation to New Languagescited by 82
- 2017Transfer Learning across Low-Resource, Related Languages for Neural Machine Translationcited by 58
- 2018Trivial Transfer Learning for Low-Resource Neural Machine Translationcited by 47
- 2021IndT5: A Text-to-Text Transformer for 10 Indigenous Languagescited by 10
- 2020Translating Similar Languages: Role of Mutual Intelligibility in Multilingual Transformerscited by 6
- 2021Translating the Unseen? Yoruba-English MT in Low-Resource, Morphologically-Unmarked Settingscited by 5
Built on by
Citing papers per year: 2024: 1.
1 paper.