mlsanityData to 7 Oct 2026

Massively Multilingual Text Translation For Low-Resource Languages

arXiv 2401.16582 ↗First posted 29 Jan 2024cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Translation into severely low-resource languages has both the cultural goal of saving and reviving those languages and the humanitarian goal of assisting the everyday needs of local communities that are accelerated by the recent COVID-19 pandemic. In many humanitarian efforts, translation into severely low-resource languages often does not require a universal translation engine, but a dedicated text-specific translation engine. For example, healthcare records, hygienic procedures, government communication, emergency procedures and religious texts are all limited texts. While generic translation engines for all languages do not exist, translation of multilingually known limited texts into new, low-resource languages may be possible and reduce human translation effort. We attempt to leverage translation resources from rich-resource languages to efficiently produce best possible translation quality for well known texts, which are available in multiple languages, in a new, low-resource language. To reach this goal, we argue that in translating a closed text into low-resource languages, generalization to out-of-domain texts is not necessary, but generalization to new languages is. Performance gain comes from massive source parallelism by careful choice of close-by language families, style-consistent corpus-level paraphrases within the same language and strategic adaptation of existing large pretrained multilingual models to the domain first and then to the language. Such performance gain makes it possible for machine translation systems to collaborate with human translators to expedite the translation process into new, low-resource languages.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 328 references that are in the map. First posted on arXiv 29 Jan 2024.

Builds on

31 of 328 references.

References · 31

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  4. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  5. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  6. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  7. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
  8. 2014Neural Turing Machinescited by 630
  9. 2015Sequence Level Training with Recurrent Neural Networkscited by 568
  10. 2020Beyond English-Centric Multilingual Machine Translationcited by 559
  11. 2017Deep Learning Scaling is Predictable, Empiricallycited by 556
  12. 2017Non-Autoregressive Neural Machine Translationcited by 457
19 more
  1. 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
  2. 2019Vision-and-Dialog Navigationcited by 246
  3. 2019Competence-based Curriculum Learning for Neural Machine Translationcited by 201
  4. 2016Dual Learning for Machine Translationcited by 146
  5. 2017Data Augmentation for Low-Resource Neural Machine Translationcited by 139
  6. 2016Toward Multilingual Neural Machine Translation with Universal Encoder and Decodercited by 76
  7. 2022Neuro-Symbolic Language Modeling with Automaton-augmented Retrievalcited by 60
  8. 2021DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoderscited by 50
  9. 2017Limits of End-to-End Learningcited by 35
  10. 2020Complete Multilingual Neural Machine Translationcited by 30
  11. 2017Improving Lexical Choice in Neural Machine Translationcited by 17
  12. 2021Phrase-level Active Learning for Neural Machine Translationcited by 13
  13. 2017Neural machine translation for low-resource languagescited by 8
  14. 2020Exploring Benefits of Transfer Learning in Neural Machine Translationcited by 5
  15. 2021Active Learning for Massively Parallel Translation of Constrained Text into Low Resource Languagescited by 4
  16. 2023Exploring Strategies for Modeling Sign Language Phonologycited by 4
  17. 2016Parallel Texts in the Hebrew Bible, New Methods and Visualizationscited by 2
  18. 2022Cost-Effective Training in Low-Resource Neural Machine Translationcited by 2
  19. 2018Embedding Learning Through Multilingual Concept Inductioncited by 1

Built on by

Not cited yet.