Extremely low-resource machine translation for closely related languages
Not on the map. Why?
Abstract (arXiv)
An effective method to improve extremely low-resource neural machine translation is multilingual training, which can be improved by leveraging monolingual data to create synthetic bilingual corpora using the back-translation method. This work focuses on closely related languages from the Uralic language family: from Estonian and Finnish geographical regions. We find that multilingual learning and synthetic corpora increase the translation quality in every language pair for which we have data. We show that transfer learning and fine-tuning are very effective for doing low-resource machine translation and achieve the best results. We collected new parallel data for V~oro, North and South Saami and present first results of neural machine translation for these languages.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 17 of its 33 references that are in the map. First posted on arXiv 27 May 2021.
Builds on
17 of 33 references.
References · 17
- 2017Attention Is All You Needcited by 59,932
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
- 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
- 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 467
- 2020Improving Massively Multilingual Neural Machine Translation and Zero-Shot Translationcited by 277
- 2020Universal Dependencies v2: An Evergrowing Multilingual Treebank Collectioncited by 269
- 2018Phrase-Based & Neural Unsupervised Machine Translationcited by 138
- 2018Universal Neural Machine Translation for Extremely Low Resource Languagescited by 66
- 2018Unsupervised Statistical Machine Translationcited by 51
- 2018Trivial Transfer Learning for Low-Resource Neural Machine Translationcited by 47
- 2016Linguistic Input Features Improve Neural Machine Translationcited by 38
5 more
- 2017Sockeye: A Toolkit for Neural Machine Translationcited by 15
- 2018Multi-Domain Neural Machine Translationcited by 11
- 2018Neural Machine Translation into Language Varietiescited by 9
- 2018A Neural Approach to Language Variety Translationcited by 6
- 2020Improving Multilingual Neural Machine Translation For Low-Resource Languages: French,English - Vietnamesecited by 3
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 3; 2025: 2; 2026: 1.
7 papers.
- 2024Disentangling Singlish Discourse Particles with Task-Driven Representationcited by 5
- 2022Data-adaptive Transfer Learning for Translation: A Case Study in Haitian and Jamaicancited by 3
- 2024LLMs for Extremely Low-Resource Finno-Ugric Languagescited by 3
- 2024Contrastive Token Learning with Similarity Decay for Repetition Suppression in Machine Translationcited by 1
- 2025CycleDistill: Bootstrapping Machine Translation using LLMs with Cyclical Distillationcited by 1
- 2025Limited-Resource Adapters Are Regularizers, Not Linguistscited by 0
- 2026Cross-Lingual Transfer for Machine Translation in Turkic Languagescited by 0
- 2026Cross-Lingual Transfer for Machine Translation in Turkic Languages31 Jul 2026
- 2025CycleDistill: Bootstrapping Machine Translation using LLMs with Cyclical Distillation24 Jun 2025
- 2025Limited-Resource Adapters Are Regularizers, Not Linguists30 May 2025
- 2024LLMs for Extremely Low-Resource Finno-Ugric Languages24 Oct 2024
- 2024Disentangling Singlish Discourse Particles with Task-Driven Representation30 Sep 2024
- 2024Contrastive Token Learning with Similarity Decay for Repetition Suppression in Machine Translation30 Sep 2024
- 2022Data-adaptive Transfer Learning for Translation: A Case Study in Haitian and Jamaican13 Sep 2022