MMTAfrica: Multilingual Machine Translation for African Languages
Not on the map. Why?
Abstract (arXiv)
In this paper, we focus on the task of multilingual machine translation for African languages and describe our contribution in the 2021 WMT Shared Task: Large-Scale Multilingual Machine Translation. We introduce MMTAfrica, the first many-to-many multilingual translation system for six African languages: Fon (fon), Igbo (ibo), Kinyarwanda (kin), Swahili/Kiswahili (swa), Xhosa (xho), and Yoruba (yor) and two non-African languages: English (eng) and French (fra). For multilingual translation concerning African languages, we introduce a novel backtranslation and reconstruction objective, BT&REC, inspired by the random online back translation and T5 modeling framework respectively, to effectively leverage monolingual data. Additionally, we report improvements from MMTAfrica over the FLORES 101 benchmarks (spBLEU gains ranging from +0.58 in Swahili to French to +19.46 in French to Xhosa). We release our dataset and code source at https://github.com/edaiofficial/mmtafrica.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 50 of its 73 references that are in the map. First posted on arXiv 8 Apr 2022.
Builds on
50 of 73 references.
References · 50
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
38 more
- 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
- 2020Beyond English-Centric Multilingual Machine Translationcited by 559
- 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 556
- 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 467
- 2020Improving Massively Multilingual Neural Machine Translation and Zero-Shot Translationcited by 277
- 2017Unsupervised Machine Translation Using Monolingual Corpora Onlycited by 272
- 2019Massively Multilingual Neural Machine Translation in the Wild: Findings and Challengescited by 253
- 2019Massively Multilingual Neural Machine Translationcited by 246
- 2016Transfer Learning for Low-Resource Neural Machine Translationcited by 188
- 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
- 2021MasakhaNER: Named Entity Recognition for African Languagescited by 155
- 2016Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanismcited by 117
- 2018Rapid Adaptation of Neural Machine Translation to New Languagescited by 82
- 2016Toward Multilingual Neural Machine Translation with Universal Encoder and Decodercited by 76
- 2019Improved Zero-shot Neural Machine Translation via Ignoring Spurious Correlationscited by 61
- 2019The Missing Ingredient in Zero-Shot Neural Machine Translationcited by 59
- 2016Fully Character-Level Neural Machine Translation without Explicit Segmentationcited by 55
- 2020Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translationcited by 51
- 2020Masakhane -- Machine Translation For Africacited by 48
- 2019Multilingual Neural Machine Translation with Language Clusteringcited by 47
- 2016Zero-Resource Translation with Multi-Lingual Neural Machine Translationcited by 46
- 2019compare-mt: A Tool for Holistic Comparison of Language Generation Systemscited by 43
- 2021The Effect of Domain and Diacritics in Yor`ub'a-English Neural Machine Translationcited by 38
- 2016Semi-Supervised Learning for Neural Machine Translationcited by 36
- 2019Massive vs. Curated Word Embeddings for Low-Resourced Languages. The Case of Yor`ub'a and Twicited by 33
- 2020KINNEWS and KIRNEWS: Benchmarking Cross-Lingual Text Classification for Kinyarwanda and Kirundicited by 31
- 2018A neural interlingua for multilingual machine translationcited by 29
- 2021AfroMT: Pretraining Strategies and Reproducible Benchmarks for Translation of 8 African Languagescited by 24
- 2018A Comparison of Transformer and Recurrent Neural Networks on Multilingual Neural Machine Translationcited by 23
- 2018Unsupervised Sentence Compression using Denoising Auto-Encoderscited by 15
- 2019A Focus on Neural Machine Translation for African Languagescited by 15
- 2020Igbo-English Machine Translation: An Evaluation Benchmarkcited by 14
- 2021OkwuGb'e: End-to-End Speech Recognition for Fon and Igbocited by 13
- 2019Benchmarking Neural Machine Translation for Southern African Languagescited by 9
- 2018Towards Neural Machine Translation for African Languagescited by 7
- 2021Low-Resource Neural Machine Translation for Southern African Languagescited by 7
- 2021Crowdsourced Phrase-Based Tokenization for Low-Resourced Neural Machine Translation: The Case of Fon Languagecited by 6
- 2020FFR V1.0: Fon-French Neural Machine Translationcited by 2
Built on by
Citing papers per year: 2022: 2; 2023: 4; 2024: 2; 2025: 0; 2026: 3.
11 papers.
- 2022A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translationcited by 97
- 2022Building Machine Translation Systems for the Next Thousand Languagescited by 69
- 2023Democratizing LLMs for Low-Resource Languages by Leveraging their English Dominant Abilities with Linguistically-Diverse Promptscited by 45
- 2024State of NLP in Kenya: A Surveycited by 7
- 2023First Tragedy, then Parse: History Repeats Itself in the New Era of Large Language Modelscited by 4
- 2023Building a Parallel Corpus and Training Translation Models Between Luganda and Englishcited by 3
- 2023FonMTL: Towards Multitask Learning for the Fon Languagecited by 1
- 2024Beyond MLE: Investigating SEARNN for Low-Resourced Neural Machine Translationcited by 0
- 2026A Survey of Text and Speech Resources for Hausa and Fongbe: Availability, Quality, and Gaps for NLP Developmentcited by 0
- 2026Embedding Initialization for Unseen Low-resource Languages in Multilingual NMT: A Case Study on Limbum-English Translationcited by 0
- 2026TranslatePsy-AfriSLM: High-Quality Data Scaling For Low-Resource Machine Translationcited by 0
- 2026TranslatePsy-AfriSLM: High-Quality Data Scaling For Low-Resource Machine Translation19 Aug 2026
- 2026Embedding Initialization for Unseen Low-resource Languages in Multilingual NMT: A Case Study on Limbum-English Translation7 Aug 2026
- 2026A Survey of Text and Speech Resources for Hausa and Fongbe: Availability, Quality, and Gaps for NLP Development13 Apr 2026
- 2024State of NLP in Kenya: A Survey13 Oct 2024
- 2024Beyond MLE: Investigating SEARNN for Low-Resourced Neural Machine Translation20 May 2024
- 2023First Tragedy, then Parse: History Repeats Itself in the New Era of Large Language Models8 Nov 2023
- 2023FonMTL: Towards Multitask Learning for the Fon Language28 Aug 2023
- 2023Democratizing LLMs for Low-Resource Languages by Leveraging their English Dominant Abilities with Linguistically-Diverse Prompts20 Jun 2023
- 2023Building a Parallel Corpus and Training Translation Models Between Luganda and English7 Jan 2023
- 2022Building Machine Translation Systems for the Next Thousand Languages9 May 2022
- 2022A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translation4 May 2022