mlsanityData to 7 Oct 2026

A Large-Scale Study of Machine Translation in the Turkic Languages

arXiv 2109.04593 ↗First posted 9 Sep 2021cs.CL cs.LGcited by 21

Not on the map. Why?

Abstract (arXiv)

Recent advances in neural machine translation (NMT) have pushed the quality of machine translation systems to the point where they are becoming widely adopted to build competitive systems. However, there is still a large number of languages that are yet to reap the benefits of NMT. In this paper, we provide the first large-scale case study of the practical application of MT in the Turkic language family in order to realize the gains of NMT for Turkic languages under high-resource to extremely low-resource scenarios. In addition to presenting an extensive analysis that identifies the bottlenecks towards building competitive systems to ameliorate data scarcity, our study has several key contributions, including, i) a large parallel corpus covering 22 Turkic languages consisting of common public datasets in combination with new datasets of approximately 2 million parallel sentences, ii) bilingual baselines for 26 language pairs, iii) novel high-quality test sets in three different translation domains and iv) human evaluation scores. All models, scripts, and data will be released to the public.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 20 of its 81 references that are in the map. First posted on arXiv 9 Sep 2021.

Builds on

20 of 81 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  4. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  5. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  6. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
  7. 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
  8. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  9. 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
  10. 2020The Tatoeba Translation Challenge -- Realistic Data Sets for Low Resource and Multilingual MTcited by 127
  11. 2018When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation?cited by 125
  12. 2019The FLoRes Evaluation Datasets for Low-Resource Machine Translation: Nepali-English and Sinhala-Englishcited by 61
8 more
  1. 2019Joey NMT: A Minimalist NMT Toolkit for Novicescited by 39
  2. 2019Pushing the Limits of Low-Resource Morphological Inflectioncited by 29
  3. 2020From SPMRL to NMRL: What Did We Learn (and Unlearn) in a Decade of Parsing Morphologically-Rich Languages (MRLs)?cited by 26
  4. 2020It's Easier to Translate out of English than into it: Measuring Neural Translation Difficulty by Cross-Mutual Informationcited by 26
  5. 2017Linguistically Motivated Vocabulary Reduction for Neural Machine Translation from Turkish to Englishcited by 23
  6. 2019Unsung Challenges of Building and Deploying Language Technologies for Low Resource Language Communitiescited by 19
  7. 2020On Romanization for Model Transfer Between Scripts in Neural Machine Translationcited by 9
  8. 2019Application of Low-resource Machine Translation Techniques to Russian-Tatar Language Paircited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 4; 2023: 4; 2024: 7; 2025: 1; 2026: 4.

21 papers.

Sort:

By area:

  1. 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 292
  2. 2023Glot500: Scaling Multilingual Corpora and Language Models to 500 Languagescited by 116
  3. 2022Building Machine Translation Systems for the Next Thousand Languagescited by 69
  4. 2023An Open Dataset and Model for Language Identificationcited by 49
  5. 2024DIALECTBENCH: A NLP Benchmark for Dialects, Varieties, and Closely-Related Languagescited by 49
  6. 2023GlotLID: Language Identification for Low-Resource Languagescited by 37
  7. 2022What a Creole Wants, What a Creole Needscited by 27
  8. 2024Goldfish: Monolingual Language Models for 350 Languagescited by 27
  9. 2022Parameter-Efficient Neural Reranking for Cross-Lingual and Multilingual Retrievalcited by 17
  10. 2024EMMA-500: Enhancing Massively Multilingual Adaptation of Large Language Modelscited by 16
  11. 2025SMOL: Professionally translated parallel data for 115 under-represented languagescited by 11
  12. 2021Evaluating Multiway Multilingual NMT in the Turkic Languagescited by 8
9 more
  1. 2022Fixing MoE Over-Fitting on Low-Resource Languages in Multilingual Machine Translationcited by 8
  2. 2024Recent Advancements and Challenges of Turkic Central Asian Language Processingcited by 6
  3. 2024Multilingual Arbitrage: Optimizing Data Pools to Accelerate Multilingual Progresscited by 6
  4. 2024KyrgyzNLP: Challenges, Progress, and Futurecited by 4
  5. 2026OpenLID-v3: Improving the Precision of Closely Related Language Identification -- An Experience Reportcited by 4
  6. 2023Benchmarking Multilabel Topic Classification in the Kyrgyz Languagecited by 3
  7. 2026TurkicNLP: An NLP Toolkit for Turkic Languagescited by 1
  8. 2026Vavanagi: a Community-run Platform for Documentation of the Hula Language in Papua New Guineacited by 0
  9. 2026Cross-Lingual Transfer for Machine Translation in Turkic Languagescited by 0