AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languages
Not on the map. Why?
Abstract (arXiv)
Africa is home to over 2,000 languages from more than six language families and has the highest linguistic diversity among all continents. These include 75 languages with at least one million speakers each. Yet, there is little NLP research conducted on African languages. Crucial to enabling such research is the availability of high-quality annotated datasets. In this paper, we introduce AfriSenti, a sentiment analysis benchmark that contains a total of >110,000 tweets in 14 African languages (Amharic, Algerian Arabic, Hausa, Igbo, Kinyarwanda, Moroccan Arabic, Mozambican Portuguese, Nigerian Pidgin, Oromo, Swahili, Tigrinya, Twi, Xitsonga, and Yor`ub'a) from four language families. The tweets were annotated by native speakers and used in the AfriSenti-SemEval shared task (The AfriSenti Shared Task had over 200 participants. See website at https://afrisenti-semeval.github.io). We describe the data collection methodology, annotation process, and the challenges we dealt with when curating each dataset. We further report baseline experiments conducted on the different datasets and discuss their usefulness.
Key facts. Cited by 68 papers in the map (data through 7 Oct 2026). Builds on 26 of its 69 references that are in the map. First posted on arXiv 17 Feb 2023.
Builds on
26 of 69 references.
References · 26
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
- 2021Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotationscited by 306
- 2019SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimizationcited by 253
- 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 219
- 2021MasakhaNER: Named Entity Recognition for African Languagescited by 155
- 2022Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-Tuningcited by 149
- 2019Choosing Transfer Languages for Cross-Lingual Learningcited by 143
- 2018Deep Learning for Sentiment Analysis : A Surveycited by 139
- 2021On Releasing Annotator-Level Labels and Information in Datasetscited by 123
- 2021XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyondcited by 114
14 more
- 2020Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text Corpuscited by 76
- 2016The emotional arcs of stories are dominated by six basic shapescited by 69
- 2020Beneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis Researchcited by 67
- 2022NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysiscited by 64
- 2022Towards Afrocentric NLP for African Languages: Where We Are and Where We Can Gocited by 46
- 2013NRC-Canada: Building the State-of-the-Art in Sentiment Analysis of Tweetscited by 33
- 2022Best Practices in the Creation and Use of Emotion Lexiconscited by 27
- 2014Human language reveals a universal positivity biascited by 23
- 2021Ethics Sheet for Automatic Emotion Recognition and Sentiment Analysiscited by 22
- 2021LightTag: Text Annotation Platformcited by 16
- 2022MSCTD: A Multimodal Sentiment Chat Translation Datasetcited by 15
- 2021Sentiment Classification in Swahili Language Using Multilingual BERTcited by 6
- 2020NLP-CIC at SemEval-2020 Task 9: Analysing sentiment in code-switching language using a simple deep-learning classifiercited by 5
- 2019Analysis of the Ethiopic Twitter Dataset for Abusive Speech in Amhariccited by 4
Built on by
Citing papers per year: 2023: 19; 2024: 15; 2025: 20; 2026: 14.
68 papers.
Sort:
By area:
- 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 174
- 2023AfroBench: How Good are Large Language Models on African Languages?cited by 43
- 2024IrokoBench: A New Benchmark for African Languages in the Age of Large Language Modelscited by 43
- 2023SemEval-2023 Task 12: Sentiment Analysis for African Languages (AfriSenti-SemEval)cited by 41
- 2023XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languagescited by 34
- 2023MasakhaNEWS: News Topic Classification for African languagescited by 30
- 2025BRIGHTER: BRIdging the Gap in Human-Annotated Textual Emotion Recognition Datasets for 28 Languagescited by 27
- 2024Rehearsal-Free Modular and Compositional Continual Learning for Language Modelscited by 26
- 2025NRC VAD Lexicon v2: Norms for Valence, Arousal, and Dominance for over 55k English Termscited by 25
- 2023Zero- and Few-Shot Prompting with LLMs: A Comparative Study with Fine-tuned Models for Bangla Sentiment Analysiscited by 20
- 2024InkubaLM: A small language model for low-resource African languagescited by 18
- 2024Evaluating the Capabilities of Large Language Models for Multi-label Emotion Understandingcited by 17
38 more
- 2025Charting the Landscape of African NLP: Mapping Progress and Shaping the Road Aheadcited by 15
- 2023NollySenti: Leveraging Transfer Learning and Machine Translation for Nigerian Movie Sentiment Classificationcited by 14
- 2024The Impact of Demonstrations on Multilingual In-Context Learning: A Multidimensional Analysiscited by 13
- 2023HaVQA: A Dataset for Visual Question Answering and Multimodal Research in Hausa Languagecited by 12
- 2023Large Human Language Models: A Need and the Challengescited by 11
- 2024Voices Unheard: NLP Resources and Models for Yor`ub'a Regional Dialectscited by 11
- 2024Learning to Route for Dynamic Adapter Composition in Continual Learning with Language Modelscited by 11
- 2023NLNDE at SemEval-2023 Task 12: Adaptive Pretraining and Source Language Selection for Low-Resource Multilingual Sentiment Analysiscited by 10
- 2025AfriHate: A Multilingual Collection of Hate Speech and Abusive Language Datasets for African Languagescited by 10
- 2025Where Are We? Evaluating LLM Performance on African Languagescited by 9
- 2024Walia-LLM: Enhancing Amharic-LLaMA by Integrating Task-Specific and Generative Datasetscited by 8
- 2024EthioLLM: Multilingual Large Language Models for Ethiopian Languages with Task Evaluationcited by 8
- 2024GrEmLIn: A Repository of Green Baseline Embeddings for 87 Low-Resource Languages Injected with Multilingual Graph Knowledgecited by 7
- 2024State of NLP in Kenya: A Surveycited by 7
- 2023GradSim: Gradient-Based Language Grouping for Effective Multilingual Trainingcited by 6
- 2024Cross-lingual transfer of multilingual models on low resource African Languagescited by 5
- 2024BESSTIE: A Benchmark for Sentiment and Sarcasm Classification for Varieties of Englishcited by 5
- 2025Explainable AI: XAI-Guided Context-Aware Data Augmentationcited by 5
- 2025AfroXLMR-Social: Adapting Pre-trained Language Models for African Languages Social Media Textcited by 4
- 2023HausaNLP at SemEval-2023 Task 12: Leveraging African Low Resource TweetData for Sentiment Analysiscited by 3
- 2023The Skipped Beat: A Study of Sociopragmatic Understanding in LLMs for 64 Languagescited by 3
- 2024How Good is Your Wikipedia? Auditing Data Quality for Low-resource and Multilingual NLPcited by 3
- 2025Small Models, Big Impact: Efficient Corpus and Graph-Based Adaptation of Small Multilingual Language Models for Low-Resource Languagescited by 3
- 2026Can Embedding Similarity Predict Cross-Lingual Transfer? A Systematic Study on African Languagescited by 3
- 2023GMNLP at SemEval-2023 Task 12: Sentiment Analysis with Phylogeny-Based Adapterscited by 2
- 2023UIO at SemEval-2023 Task 12: Multilingual fine-tuning for sentiment classification in low-resource languagescited by 2
- 2025RideKE: Leveraging Low-Resource, User-Generated Twitter Content for Sentiment and Emotion Detection in Kenyan Code-Switched Datasetcited by 2
- 2025Bridging Gaps in Natural Language Processing for Yor`ub'a: A Systematic Review of a Decade of Progress and Prospectscited by 2
- 2025HausaNLP: Current Status, Challenges and Future Directions for Hausa Natural Language Processingcited by 2
- 2025Culture Cartography: Mapping the Landscape of Cultural Knowledgecited by 2
- 2023DN at SemEval-2023 Task 12: Low-Resource Language Text Classification via Multilingual Pretrained Language Model Fine-tuningcited by 1
- 2025Sentiment Analysis on the young people's perception about the mobile Internet costs in Senegalcited by 1
- 2025Breaking Bad: Norms for Valence, Arousal, and Dominance for over 10k English Multiword Expressionscited by 1
- 2026Going PLACES: Participatory Localized Red Teaming for Text-to-Image Safety in the Global Southcited by 1
- 2023Masakhane-Afrisenti at SemEval-2023 Task 12: Sentiment Analysis using Afro-centric Language Models and Adapters for Low-resource African Languagescited by 0
- 2023UBC-DLNLP at SemEval-2023 Task 12: Impact of Transfer Learning on African Sentiment Analysiscited by 0
- 2023KINLP at SemEval-2023 Task 12: Kinyarwanda Tweet Sentiment Analysiscited by 0
- 2023UCAS-IIE-NLP at SemEval-2023 Task 12: Enhancing Generalization of Multilingual BERT for Low-resource Sentiment Analysiscited by 0
50 most cited of 68 All 68 (JSON)
- 2026How Many Labels Does a Language Need? Annotation Budgets and Cross-Lingual Pooling for African-Language Text Classification29 Sep 2026
- 2026One Threshold Does Not Fit All Languages: Language-Conditional Deferral for Reliable and Efficient Low-Resource Text Classification29 Sep 2026
- 2026The Register Gap: A Meaning Intelligence Framework for Nigerian Public Discourse18 Jun 2026
- 2026From Script to Semantics: Prompting Strategies for African NLI2 Jun 2026
- 2026Going PLACES: Participatory Localized Red Teaming for Text-to-Image Safety in the Global South18 May 2026
- 2026The Annotation Scarcity Paradox in Low-Resource NLP Evaluation: A Decade of Acceleration and Emerging Constraints18 May 2026
- 2026Beyond Majority Voting: Agreement-Based Clustering to Model Annotator Perspectives in Subjective NLP Tasks11 May 2026
- 2026Dependency Parsing Across the Resource Spectrum: Evaluating Architectures on High and Low-Resource Languages4 May 2026
- 2026When Does Data Augmentation Help? Evaluating LLM and Back-Translation Methods for Hausa and Fongbe NLP14 Apr 2026
- 2026A Survey of Text and Speech Resources for Hausa and Fongbe: Availability, Quality, and Gaps for NLP Development13 Apr 2026
- 2026YoNER: A New Yor`ub'a Multi-domain Named Entity Recognition Dataset7 Apr 2026
- 2026Budget-Xfer: Budget-Constrained Source Language Selection for Cross-Lingual Transfer to African Languages29 Mar 2026
38 more
- 2026Yor-Sarc: A gold-standard dataset for sarcasm detection in a low-resource African language21 Feb 2026
- 2026Can Embedding Similarity Predict Cross-Lingual Transfer? A Systematic Study on African Languages6 Jan 2026
- 2025Breaking Bad: Norms for Valence, Arousal, and Dominance for over 10k English Multiword Expressions25 Nov 2025
- 2025A Cross-Cultural Assessment of Human Ability to Detect LLM-Generated Fake News about South Africa21 Nov 2025
- 2025Culture Cartography: Mapping the Landscape of Cultural Knowledge31 Oct 2025
- 2025When Distributions Shifts: Causal Generalization for Low-Resource Languages31 Oct 2025
- 2025The African Languages Lab: A Collaborative Approach to Advancing Low-Resource African NLP7 Oct 2025
- 2025Automatic Correction of Writing Anomalies in Hausa Texts4 Jun 2025
- 2025Explainable AI: XAI-Guided Context-Aware Data Augmentation4 Jun 2025
- 2025Charting the Landscape of African NLP: Mapping Progress and Shaping the Road Ahead27 May 2025
- 2025On Multilingual Encoder Language Model Compression for Low-Resource Languages22 May 2025
- 2025HausaNLP: Current Status, Challenges and Future Directions for Hausa Natural Language Processing20 May 2025
- 2025Sentiment Analysis on the young people's perception about the mobile Internet costs in Senegal17 Apr 2025
- 2025NRC VAD Lexicon v2: Norms for Valence, Arousal, and Dominance for over 55k English Terms30 Mar 2025
- 2025AfroXLMR-Social: Adapting Pre-trained Language Models for African Languages Social Media Text24 Mar 2025
- 2025Where Are We? Evaluating LLM Performance on African Languages26 Feb 2025
- 2025AfroXLMR-Comet: Multilingual Knowledge Distillation with Attention Matching for Low-Resource languages25 Feb 2025
- 2025Bridging Gaps in Natural Language Processing for Yor`ub'a: A Systematic Review of a Decade of Progress and Prospects24 Feb 2025
- 2025BRIGHTER: BRIdging the Gap in Human-Annotated Textual Emotion Recognition Datasets for 28 Languages17 Feb 2025
- 2025Small Models, Big Impact: Efficient Corpus and Graph-Based Adaptation of Small Multilingual Language Models for Low-Resource Languages14 Feb 2025
- 2025RideKE: Leveraging Low-Resource, User-Generated Twitter Content for Sentiment and Emotion Detection in Kenyan Code-Switched Dataset10 Feb 2025
- 2025AfriHate: A Multilingual Collection of Hate Speech and Abusive Language Datasets for African Languages14 Jan 2025
- 2024Evaluating the Capabilities of Large Language Models for Multi-label Emotion Understanding17 Dec 2024
- 2024BESSTIE: A Benchmark for Sentiment and Sarcasm Classification for Varieties of English6 Dec 2024
- 2024How Good is Your Wikipedia? Auditing Data Quality for Low-resource and Multilingual NLP8 Nov 2024
- 2024State of NLP in Kenya: A Survey13 Oct 2024
- 2024GrEmLIn: A Repository of Green Baseline Embeddings for 87 Low-Resource Languages Injected with Multilingual Graph Knowledge26 Sep 2024
- 2024Cross-lingual transfer of multilingual models on low resource African Languages17 Sep 2024
- 2024InkubaLM: A small language model for low-resource African languages30 Aug 2024
- 2024Learning to Route for Dynamic Adapter Composition in Continual Learning with Language Models16 Aug 2024
- 2024Voices Unheard: NLP Resources and Models for Yor`ub'a Regional Dialects27 Jun 2024
- 2024IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models5 Jun 2024
- 2024Rehearsal-Free Modular and Compositional Continual Learning for Language Models31 Mar 2024
- 2024EthioLLM: Multilingual Large Language Models for Ethiopian Languages with Task Evaluation20 Mar 2024
- 2024The Impact of Demonstrations on Multilingual In-Context Learning: A Multidimensional Analysis20 Feb 2024
- 2024Walia-LLM: Enhancing Amharic-LLaMA by Integrating Task-Specific and Generative Datasets12 Feb 2024
- 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning9 Feb 2024
- 2023AfroBench: How Good are Large Language Models on African Languages?14 Nov 2023
50 newest of 68 All 68 (JSON)
- 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 174
- 2023AfroBench: How Good are Large Language Models on African Languages?cited by 43
- 2024IrokoBench: A New Benchmark for African Languages in the Age of Large Language Modelscited by 43
- 2023SemEval-2023 Task 12: Sentiment Analysis for African Languages (AfriSenti-SemEval)cited by 41
- 2023XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languagescited by 34
- 2023MasakhaNEWS: News Topic Classification for African languagescited by 30
- 2025BRIGHTER: BRIdging the Gap in Human-Annotated Textual Emotion Recognition Datasets for 28 Languagescited by 27
- 2024Rehearsal-Free Modular and Compositional Continual Learning for Language Modelscited by 26
- 2025NRC VAD Lexicon v2: Norms for Valence, Arousal, and Dominance for over 55k English Termscited by 25
- 2023Zero- and Few-Shot Prompting with LLMs: A Comparative Study with Fine-tuned Models for Bangla Sentiment Analysiscited by 20
- 2024InkubaLM: A small language model for low-resource African languagescited by 18
- 2025Charting the Landscape of African NLP: Mapping Progress and Shaping the Road Aheadcited by 15
12 most cited of 66 All 66 (JSON)
- 2026How Many Labels Does a Language Need? Annotation Budgets and Cross-Lingual Pooling for African-Language Text Classification29 Sep 2026
- 2026One Threshold Does Not Fit All Languages: Language-Conditional Deferral for Reliable and Efficient Low-Resource Text Classification29 Sep 2026
- 2026The Register Gap: A Meaning Intelligence Framework for Nigerian Public Discourse18 Jun 2026
- 2026From Script to Semantics: Prompting Strategies for African NLI2 Jun 2026
- 2026The Annotation Scarcity Paradox in Low-Resource NLP Evaluation: A Decade of Acceleration and Emerging Constraints18 May 2026
- 2026Beyond Majority Voting: Agreement-Based Clustering to Model Annotator Perspectives in Subjective NLP Tasks11 May 2026
- 2026Dependency Parsing Across the Resource Spectrum: Evaluating Architectures on High and Low-Resource Languages4 May 2026
- 2026When Does Data Augmentation Help? Evaluating LLM and Back-Translation Methods for Hausa and Fongbe NLP14 Apr 2026
- 2026A Survey of Text and Speech Resources for Hausa and Fongbe: Availability, Quality, and Gaps for NLP Development13 Apr 2026
- 2026YoNER: A New Yor`ub'a Multi-domain Named Entity Recognition Dataset7 Apr 2026
- 2026Budget-Xfer: Budget-Constrained Source Language Selection for Cross-Lingual Transfer to African Languages29 Mar 2026
- 2026Yor-Sarc: A gold-standard dataset for sarcasm detection in a low-resource African language21 Feb 2026
12 newest of 66 All 66 (JSON)