mlsanityData to 7 Oct 2026

Machine Translation of Low-Resource Indo-European Languages

arXiv 2108.03739 ↗First posted 8 Aug 2021cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

In this work, we investigate methods for the challenging task of translating between low-resource language pairs that exhibit some level of similarity. In particular, we consider the utility of transfer learning for translating between several Indo-European low-resource languages from the Germanic and Romance language families. In particular, we build two main classes of transfer-based systems to study how relatedness can benefit the translation performance. The primary system fine-tunes a model pre-trained on a related language pair and the contrastive system fine-tunes one pre-trained on an unrelated language pair. Our experiments show that although relatedness is not necessary for transfer learning to work, it does benefit model performance.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 32 references that are in the map. First posted on arXiv 8 Aug 2021.

Builds on

21 of 32 references.

References · 21

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  3. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  4. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  5. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  6. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  7. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
  8. 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
  9. 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
  10. 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 467
  11. 2017Six Challenges for Neural Machine Translationcited by 334
  12. 2019WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipediacited by 221
9 more
  1. 2018Marian: Fast Neural Machine Translation in C++cited by 202
  2. 2016Transfer Learning for Low-Resource Neural Machine Translationcited by 188
  3. 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 108
  4. 2018Rapid Adaptation of Neural Machine Translation to New Languagescited by 82
  5. 2017Transfer Learning across Low-Resource, Related Languages for Neural Machine Translationcited by 58
  6. 2018Trivial Transfer Learning for Low-Resource Neural Machine Translationcited by 47
  7. 2021IndT5: A Text-to-Text Transformer for 10 Indigenous Languagescited by 10
  8. 2020Translating Similar Languages: Role of Mutual Intelligibility in Multilingual Transformerscited by 6
  9. 2021Translating the Unseen? Yoruba-English MT in Low-Resource, Morphologically-Unmarked Settingscited by 5

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.