mlsanityData to 14 Oct 2026

EthioLLM: Multilingual Large Language Models for Ethiopian Languages with Task Evaluation

arXiv 2403.13737 ↗First posted 20 Mar 2024cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) have gained popularity recently due to their outstanding performance in various downstream Natural Language Processing (NLP) tasks. However, low-resource languages are still lagging behind current state-of-the-art (SOTA) developments in the field of NLP due to insufficient resources to train LLMs. Ethiopian languages exhibit remarkable linguistic diversity, encompassing a wide array of scripts, and are imbued with profound religious and cultural significance. This paper introduces EthioLLM -- multilingual large language models for five Ethiopian languages (Amharic, Ge'ez, Afan Oromo, Somali, and Tigrinya) and English, and Ethiobenchmark -- a new benchmark dataset for various downstream NLP tasks. We evaluate the performance of these models across five downstream NLP tasks. We open-source our multilingual language models, new benchmark datasets for various downstream tasks, and task-specific fine-tuned language models and discuss the performance of the models. Our dataset and models are available at the https://huggingface.co/EthioNLP repository.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 33 of its 77 references that are in the map. First posted on arXiv 20 Mar 2024.

Builds on

33 of 77 references.

References · 33

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  6. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  7. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
  8. 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
  9. 2020Language-agnostic BERT Sentence Embeddingcited by 627
  10. 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 407
  11. 2020InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Trainingcited by 237
  12. 2021MasakhaNER: Named Entity Recognition for African Languagescited by 155
21 more
  1. 2020PhoBERT: Pre-trained language models for Vietnamesecited by 149
  2. 2022Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-Tuningcited by 149
  3. 2019Multilingual and Multi-Aspect Hate Speech Analysiscited by 133
  4. 2021Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Modelscited by 132
  5. 2022A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translationcited by 98
  6. 2023AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languagescited by 68
  7. 2022NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysiscited by 64
  8. 2022AfroLM: A Self-Active Learning-based Multilingual Pretrained Language Model for 23 African Languagescited by 46
  9. 2023SemEval-2023 Task 12: Sentiment Analysis for African Languages (AfriSenti-SemEval)cited by 41
  10. 2022SERENGETI: Massively Multilingual Language Models for Africacited by 40
  11. 2023MasakhaNEWS: News Topic Classification for African languagescited by 31
  12. 2020Introducing various Semantic Models for Amharic: Experimentation and Evaluation with multiple Tasks and Datasetscited by 12
  13. 2023Natural Language Processing in Ethiopian Languages: Current State, Challenges, and Opportunitiescited by 11
  14. 2021An Amharic News Text classification Datasetcited by 10
  15. 2021Extended Parallel Corpus for Amharic-English Machine Translationcited by 10
  16. 2023NLNDE at SemEval-2023 Task 12: Adaptive Pretraining and Source Language Selection for Low-Resource Multilingual Sentiment Analysiscited by 10
  17. 2020Transferring Monolingual Model to Low-Resource Language: The Case of Tigrinyacited by 8
  18. 2022ANEC: An Amharic Named Entity Corpus and Transformer Based Recognizercited by 5
  19. 2022The Effect of Normalization for Bi-directional Amharic-English Neural Machine Translationcited by 5
  20. 2019Analysis of the Ethiopic Twitter Dataset for Abusive Speech in Amhariccited by 4
  21. 2020Machine Learning Approaches for Amharic Parts-of-speech Taggingcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 5; 2026: 2.

8 papers.

  1. 2024Evaluating the Capabilities of Large Language Models for Multi-label Emotion Understandingcited by 17
  2. 2025Charting the Landscape of African NLP: Mapping Progress and Shaping the Road Aheadcited by 16
  3. 2025Afrispeech-Dialog: A Benchmark Dataset for Spontaneous English Conversations in Healthcare and Beyondcited by 11
  4. 2025The State of Large Language Models for African Languages: Progress and Challengescited by 8
  5. 2026Afri-MCQA: Multimodal Cultural Question Answering for African Languagescited by 2
  6. 2025Enhancing Multi-Label Emotion Analysis and Corresponding Intensities for Ethiopian Languagescited by 1
  7. 2025Amplify Initiative: Building A Localized Data Platform for Globalized AIcited by 1
  8. 2026CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systemscited by 0