mlsanityData to 14 Oct 2026

Krey`ol-MT: Building MT for Latin American, Caribbean and Colonial African Creole Languages

arXiv 2405.05376 ↗First posted 8 May 2024cs.CLcited by 10

Not on the map. Why?

Abstract (arXiv)

A majority of language technologies are tailored for a small number of high-resource languages, while relatively many low-resource languages are neglected. One such group, Creole languages, have long been marginalized in academic study, though their speakers could benefit from machine translation (MT). These languages are predominantly used in much of Latin America, Africa and the Caribbean. We present the largest cumulative dataset to date for Creole language MT, including 14.5M unique Creole sentences with parallel translations -- 11.6M of which we release publicly, and the largest bitexts gathered to date for 41 languages -- the first ever for 21. In addition, we provide MT models supporting all 41 Creole languages in 172 translation directions. Given our diverse dataset, we produce a model for Creole language MT exposed to more genre diversity than ever before, which outperforms a genre-specific Creole MT model on its own benchmark for 26 of 34 translation directions.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 30 of its 113 references that are in the map. First posted on arXiv 8 May 2024.

Builds on

30 of 113 references.

References · 30

  1. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
  2. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
  3. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
  4. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
  5. 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
  6. 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 593
  7. 2020MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfercited by 445
  8. 2019Massively Multilingual Neural Machine Translation in the Wild: Findings and Challengescited by 257
  9. 2023MADLAD-400: A Multilingual And Document-Level Large Audited Datasetcited by 181
  10. 2019CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEBcited by 177
  11. 2020Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metricscited by 158
  12. 2021MasakhaNER: Named Entity Recognition for African Languagescited by 155
18 more
  1. 2019CCAligned: A Massive Collection of Cross-Lingual Web-Document Pairscited by 136
  2. 2022NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysiscited by 64
  3. 2020QED: A Framework and Dataset for Explanations in Question Answeringcited by 55
  4. 2019Generating Synthetic Audio Data for Attention-Based Speech Recognition Systemscited by 47
  5. 2023SemEval-2023 Task 12: Sentiment Analysis for African Languages (AfriSenti-SemEval)cited by 41
  6. 2019Effective Cross-lingual Transfer of Neural Machine Translation Models without Shared Vocabulariescited by 27
  7. 2022What a Creole Wants, What a Creole Needscited by 27
  8. 2022Lego-MT: Learning Detachable Models for Massively Multilingual Machine Translationcited by 21
  9. 2021XLEnt: Mining a Large Cross-lingual Entity Dataset with Lexical-Semantic-Phonetic Word Alignmentcited by 15
  10. 2020Semantic Enrichment of Nigerian Pidgin English for Contextual Sentiment Classificationcited by 12
  11. 2019PidginUNMT: Unsupervised Neural Machine Translation from West African Pidgin to Englishcited by 11
  12. 2022JamPatoisNLI: A Jamaican Patois Natural Language Inference Datasetcited by 11
  13. 2017Universal Dependencies Parsing for Colloquial Singaporean Englishcited by 10
  14. 2023CreoleVal: Multilingual Multitask Benchmarks for Creolescited by 9
  15. 2022When Is TTS Augmentation Through a Pivot Language Useful?cited by 8
  16. 2021YANMTT: Yet Another Neural Machine Translation Toolkitcited by 7
  17. 2021BitextEdit: Automatic Bitext Editing for Improved Low-Resource Machine Translationcited by 3
  18. 2022Data-adaptive Transfer Learning for Translation: A Case Study in Haitian and Jamaicancited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 7; 2026: 2.

10 papers.

  1. 2025Charting the Landscape of African NLP: Mapping Progress and Shaping the Road Aheadcited by 16
  2. 2025LAG-MMLU: Benchmarking Frontier LLM Understanding in Latvian and Giriamacited by 2
  3. 2025Limitations of Religious Data and the Importance of the Target Domain: Towards Machine Translation for Guinea-Bissau Creolecited by 2
  4. 2024Moly'e: A Corpus-based Approach to Language Contact in Colonial Francecited by 1
  5. 2025DialUp! Modeling the Language Continuum by Adapting Models to Dialects and Dialects to Modelscited by 1
  6. 2025Kr'eyoLID From Language Identification Towards Language Miningcited by 0
  7. 2025Limited-Resource Adapters Are Regularizers, Not Linguistscited by 0
  8. 2025The Rise of AfricaNLP: A Survey of Contributions, Contributors, Community Impact, and Bibliometric Analysiscited by 0
  9. 2026The University of Melbourne WMT 2026 CreoleMT Submission: A Domain-Balanced Approach to Low-Resource Pacific Creole Machine Translationcited by 0
  10. 2026Evaluating Cultural Awareness of LLMs for Haitian Creolecited by 0