TranslatePsy-AfriSLM: High-Quality Data Scaling For Low-Resource Machine Translation
Not on the map. Why?
Abstract (arXiv)
The rapid progress in Artificial Intelligence has largely bypassed African languages, creating a digital divide that limits AI adoption on the continent. Recent open-source LLMs systematically underperform on African language machine translation, while the lack of large-scale, high-quality, open-source parallel data has constrained the development of competitive small language models (SLMs). We introduce TranslatePsy-AfriSLM, a collection of open-source machine translation resources for 19 Sub-Saharan African languages, including curated parallel data, African-specialized synthetic data, and a family of fine-tuned SLMs. Our empirical study shows that unified quality-estimation filtering removes up to 96% of training tokens without degrading quality, and that filtered synthetic data dominates the quality-efficiency Pareto frontier. Fine-tuned on the resulting data mixture, TranslatePsy-AfriSLMs outperform substantially larger systems, including TranslateGemma-27B and Qwen3.5-122B-A10B, with as few as 0.8B parameters.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 48 references that are in the map. First posted on arXiv 19 Aug 2026.
Builds on
27 of 48 references.
References · 27
- 2025Qwen3 Technical Reportcited by 8,195
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
- 2016Bag of Tricks for Efficient Text Classificationcited by 869
- 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 825
- 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 556
- 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 346
- 2020Improving Massively Multilingual Neural Machine Translation and Zero-Shot Translationcited by 277
- 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 174
- 2024MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Taskcited by 92
- 2025WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialectscited by 79
- 2023AfroBench: How Good are Large Language Models on African Languages?cited by 43
15 more
- 2024IrokoBench: A New Benchmark for African Languages in the Age of Large Language Modelscited by 43
- 2023SemEval-2023 Task 12: Sentiment Analysis for African Languages (AfriSenti-SemEval)cited by 41
- 2020PySBD: Pragmatic Sentence Boundary Disambiguationcited by 38
- 2021The Effect of Domain and Diacritics in Yor`ub'a-English Neural Machine Translationcited by 38
- 2022AfroLID: A Neural Language Identification Tool for African Languagescited by 38
- 2023AfriMTE and AfriCOMET: Enhancing COMET to Embrace Under-resourced African Languagescited by 24
- 2026AfriqueLLM: How Data Mixing and Model Architecture Impact Continued Pre-training for African Languagescited by 12
- 2022MMTAfrica: Multilingual Machine Translation for African Languagescited by 11
- 2025AFRIDOC-MT: Document-level MT Corpus for African Languagescited by 11
- 2025SMOL: Professionally translated parallel data for 115 under-represented languagescited by 11
- 2026TranslateGemma Technical Reportcited by 7
- 2025AfriMTEB and AfriE5: Benchmarking and Adapting Text Embedding Models for African Languagescited by 3
- 2026AfriNLLB: Efficient Translation Models for African Languagescited by 2
- 2024Case Studies of AI Policy Development in Africacited by 1
- 2026Kakugo: Distillation of Low-Resource Languages into Small Language Modelscited by 1
Built on by
Not cited yet.