mlsanityData to 13 Oct 2026

Train Global, Tailor Local: Minimalist Multilingual Translation into Endangered Languages

arXiv 2305.03873 ↗First posted 5 May 2023cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

In many humanitarian scenarios, translation into severely low resource languages often does not require a universal translation engine, but a dedicated text-specific translation engine. For example, healthcare records, hygienic procedures, government communication, emergency procedures and religious texts are all limited texts. While generic translation engines for all languages do not exist, translation of multilingually known limited texts into new, endangered languages may be possible and reduce human translation effort. We attempt to leverage translation resources from many rich resource languages to efficiently produce best possible translation quality for a well known text, which is available in multiple languages, in a new, severely low resource language. We examine two approaches: 1. best selection of seed sentences to jump start translations in a new language in view of best generalization to the remainder of a larger targeted text(s), and 2. we adapt large general multilingual translation engines from many other languages to focus on a specific text in a new, unknown language. We find that adapting large pretrained multilingual models to the domain/text first and then to the severely low resource language works best. If we also select a best set of seed sentences, we can improve average chrF performance on new test languages from a baseline of 21.9 to 50.7, while reducing the number of seed sentences to only around 1,000 in the new, unknown language.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 32 of its 82 references that are in the map. First posted on arXiv 5 May 2023.

Builds on

32 of 82 references.

References · 32

  1. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,480
  2. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,910
  3. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,793
  4. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,033
  5. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 792
  6. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
  7. 2020Beyond English-Centric Multilingual Machine Translationcited by 559
  8. 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 467
  9. 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
  10. 2020Improving Massively Multilingual Neural Machine Translation and Zero-Shot Translationcited by 277
  11. 2017Automated Curriculum Learning for Neural Networkscited by 252
  12. 2017OpenNMT: Open-source Toolkit for Neural Machine Translationcited by 251
20 more
  1. 2019CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEBcited by 177
  2. 2019CCAligned: A Massive Collection of Cross-Lingual Web-Document Pairscited by 136
  3. 2018When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation?cited by 125
  4. 2021Systematic Inequalities in Language Technology Performance across the World's Languagescited by 119
  5. 2016Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanismcited by 117
  6. 2018Rapid Adaptation of Neural Machine Translation to New Languagescited by 82
  7. 2016Toward Multilingual Neural Machine Translation with Universal Encoder and Decodercited by 76
  8. 2020Pre-training Multilingual Neural Machine Translation by Leveraging Alignment Informationcited by 64
  9. 2016Multi-Source Neural Translationcited by 37
  10. 2019Improving Zero-shot Translation with Language-Independent Constraintscited by 33
  11. 2021Zero-shot Cross-lingual Transfer of Neural Machine Translation with Multilingual Pretrained Encoderscited by 24
  12. 2018Active Learning for Interactive Neural Machine Translation of Data Streamscited by 21
  13. 2019A Survey on Document-level Neural Machine Translation: Methods and Evaluationcited by 12
  14. 2014Bucking the Trend: Large-Scale Cost-Focused Active Learning for Statistical Machine Translationcited by 10
  15. 2021Towards Making the Most of Multilingual Pretraining for Zero-Shot Neural Machine Translationcited by 8
  16. 2018Massively Parallel Cross-Lingual Learning in Low-Resource Target Language Translationcited by 6
  17. 2018Paraphrases as Foreign Languages in Multilingual Neural Machine Translationcited by 5
  18. 2021Family of Origin and Family of Choice: Massively Parallel Lexiconized Iterative Pretraining for Severely Low Resource Machine Translationcited by 4
  19. 2021Active Learning for Massively Parallel Translation of Constrained Text into Low Resource Languagescited by 4
  20. 2017Transcribing Against Timecited by 3

Built on by

Not cited yet.