SemEval-2023 Task 12: Sentiment Analysis for African Languages (AfriSenti-SemEval)
Not on the map. Why?
Abstract (arXiv)
We present the first Africentric SemEval Shared task, Sentiment Analysis for African Languages (AfriSenti-SemEval) - The dataset is available at https://github.com/afrisenti-semeval/afrisent-semeval-2023. AfriSenti-SemEval is a sentiment classification challenge in 14 African languages: Amharic, Algerian Arabic, Hausa, Igbo, Kinyarwanda, Moroccan Arabic, Mozambican Portuguese, Nigerian Pidgin, Oromo, Swahili, Tigrinya, Twi, Xitsonga, and Yor`ub'a (Muhammad et al., 2023), using data labeled with 3 sentiment classes. We present three subtasks: (1) Task A: monolingual classification, which received 44 submissions; (2) Task B: multilingual classification, which received 32 submissions; and (3) Task C: zero-shot classification, which received 34 submissions. The best performance for tasks A and B was achieved by NLNDE team with 71.31 and 75.06 weighted F1, respectively. UCAS-IIE-NLP achieved the best average score for task C with 58.15 weighted F1. We describe the various approaches adopted by the top 10 systems and their approaches.
Key facts. Cited by 41 papers in the map (data through 14 Oct 2026). Builds on 42 of its 119 references that are in the map. First posted on arXiv 13 Apr 2023.
Builds on
42 of 119 references.
References · 42
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2020MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfercited by 445
- 2019SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimizationcited by 254
- 2020MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformerscited by 245
- 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 221
- 2020ARBERT & MARBERT: Deep Bidirectional Transformers for Arabiccited by 166
- 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
30 more
- 2021MasakhaNER: Named Entity Recognition for African Languagescited by 155
- 2022Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-Tuningcited by 149
- 2018Deep Learning for Sentiment Analysis : A Surveycited by 139
- 2021The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Modelscited by 119
- 2021XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyondcited by 114
- 2022A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translationcited by 98
- 2016The emotional arcs of stories are dominated by six basic shapescited by 71
- 2023AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languagescited by 68
- 2020Beneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis Researchcited by 67
- 2022NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysiscited by 64
- 2020SemEval-2020 Task 9: Overview of Sentiment Analysis of Code-Mixed Tweetscited by 62
- 2022Towards Afrocentric NLP for African Languages: Where We Are and Where We Can Gocited by 47
- 2022TwHIN-BERT: A Socially-Enriched Pre-trained Language Model for Multilingual Tweet Representations at Twittercited by 45
- 2022SERENGETI: Massively Multilingual Language Models for Africacited by 40
- 2022AfroLID: A Neural Language Identification Tool for African Languagescited by 39
- 2013NRC-Canada: Building the State-of-the-Art in Sentiment Analysis of Tweetscited by 33
- 2022KinyaBERT: a Morphology-aware Kinyarwanda Language Modelcited by 27
- 2022Best Practices in the Creation and Use of Emotion Lexiconscited by 27
- 2022Phylogeny-Inspired Adaptation of Multilingual Models to New Languagescited by 24
- 2014Human language reveals a universal positivity biascited by 23
- 2021Ethics Sheet for Automatic Emotion Recognition and Sentiment Analysiscited by 22
- 2019SemEval-2014 Task 9: Sentiment Analysis in Twittercited by 20
- 2017Forward-Backward Selection with Early Droppingcited by 18
- 2021DziriBERT: a Pre-trained Language Model for the Algerian Dialectcited by 18
- 2013From Once Upon a Time to Happily Ever After: Tracking Emotions in Novels and Fairy Talescited by 16
- 2019SemEval-2015 Task 10: Sentiment Analysis in Twittercited by 16
- 2022MSCTD: A Multimodal Sentiment Chat Translation Datasetcited by 15
- 2022Separating Grains from the Chaff: Using Data Filtering to Improve Multilingual Translation for Low-Resourced African Languagescited by 6
- 2022ANEC: An Amharic Named Entity Corpus and Transformer Based Recognizercited by 5
- 2022The Effect of Normalization for Bi-directional Amharic-English Neural Machine Translationcited by 5
Built on by
Citing papers per year: 2023: 15; 2024: 9; 2025: 9; 2026: 8.
41 papers.
Sort:
By area:
- 2023Bactrian-X: Multilingual Replicable Instruction-Following Models with Low-Rank Adaptationcited by 81
- 2025BRIGHTER: BRIdging the Gap in Human-Annotated Textual Emotion Recognition Datasets for 28 Languagescited by 27
- 2024InkubaLM: A small language model for low-resource African languagescited by 18
- 2023Evaluating Emotion Arcs Across Languages: Bridging the Global Divide in Sentiment Analysiscited by 16
- 2023HaVQA: A Dataset for Visual Question Answering and Multimodal Research in Hausa Languagecited by 12
- 2023NLNDE at SemEval-2023 Task 12: Adaptive Pretraining and Source Language Selection for Low-Resource Multilingual Sentiment Analysiscited by 10
- 2024Krey`ol-MT: Building MT for Latin American, Caribbean and Colonial African Creole Languagescited by 10
- 2025Where Are We? Evaluating LLM Performance on African Languagescited by 10
- 2023CreoleVal: Multilingual Multitask Benchmarks for Creolescited by 9
- 2025M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment Analysiscited by 9
- 2024EthioLLM: Multilingual Large Language Models for Ethiopian Languages with Task Evaluationcited by 8
- 2024Zero-shot Sentiment Analysis in Low-Resource Languages Using a Multilingual Sentiment Lexiconcited by 7
29 more
- 2024GrEmLIn: A Repository of Green Baseline Embeddings for 87 Low-Resource Languages Injected with Multilingual Graph Knowledgecited by 7
- 2024State of NLP in Kenya: A Surveycited by 7
- 2023GradSim: Gradient-Based Language Grouping for Effective Multilingual Trainingcited by 6
- 2024A Systematic Review of NLP for Ghanaian Languages: Datasets, Models, and a Research Roadmapcited by 5
- 2023HausaNLP at SemEval-2023 Task 12: Leveraging African Low Resource TweetData for Sentiment Analysiscited by 3
- 2023The Skipped Beat: A Study of Sociopragmatic Understanding in LLMs for 64 Languagescited by 3
- 2023LowResource at BLP-2023 Task 2: Leveraging BanglaBert for Low Resource Sentiment Analysis of Bangla Languagecited by 3
- 2025Small Models, Big Impact: Efficient Corpus and Graph-Based Adaptation of Small Multilingual Language Models for Low-Resource Languagescited by 3
- 2023GMNLP at SemEval-2023 Task 12: Sentiment Analysis with Phylogeny-Based Adapterscited by 2
- 2023UIO at SemEval-2023 Task 12: Multilingual fine-tuning for sentiment classification in low-resource languagescited by 2
- 2024ANGOFA: Leveraging OFA Embedding Initialization and Synthetic Data for Angolan Language Modelcited by 2
- 2025RideKE: Leveraging Low-Resource, User-Generated Twitter Content for Sentiment and Emotion Detection in Kenyan Code-Switched Datasetcited by 2
- 2023DN at SemEval-2023 Task 12: Low-Resource Language Text Classification via Multilingual Pretrained Language Model Fine-tuningcited by 1
- 2024Multilingual Topic Classification in X: Dataset and Analysiscited by 1
- 2025MAGE: Multi-Head Attention Guided Embeddings for Low Resource Sentiment Classificationcited by 1
- 2023UBC-DLNLP at SemEval-2023 Task 12: Impact of Transfer Learning on African Sentiment Analysiscited by 0
- 2023KINLP at SemEval-2023 Task 12: Kinyarwanda Tweet Sentiment Analysiscited by 0
- 2023UCAS-IIE-NLP at SemEval-2023 Task 12: Enhancing Generalization of Multilingual BERT for Low-resource Sentiment Analysiscited by 0
- 2025AfroXLMR-Comet: Multilingual Knowledge Distillation with Attention Matching for Low-Resource languagescited by 0
- 2025On Multilingual Encoder Language Model Compression for Low-Resource Languagescited by 0
- 2025Limited-Resource Adapters Are Regularizers, Not Linguistscited by 0
- 2026NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Surveycited by 0
- 2026Temporal Simultaneity Predicts Annotation Quality in Sentiment Corporacited by 0
- 2026Language-Specific Gaps in AI Safety Training Datasetscited by 0
- 2026TranslatePsy-AfriSLM: High-Quality Data Scaling For Low-Resource Machine Translationcited by 0
- 2026Disentangling Topology and Diversity in Multi-Agent LLMs for Multilingual Low-Resource Emotion Detectioncited by 0
- 2026When Audit Quality Fails to Predict Downstream Utility: A Counterfactual Study of Synthetic-Data Selectors for Low-Resource African NLPcited by 0
- 2026One Threshold Does Not Fit All Languages: Language-Conditional Deferral for Reliable and Efficient Low-Resource Text Classificationcited by 0
- 2026How Many Labels Does a Language Need? Annotation Budgets and Cross-Lingual Pooling for African-Language Text Classificationcited by 0
- 2026How Many Labels Does a Language Need? Annotation Budgets and Cross-Lingual Pooling for African-Language Text Classification29 Sep 2026
- 2026One Threshold Does Not Fit All Languages: Language-Conditional Deferral for Reliable and Efficient Low-Resource Text Classification29 Sep 2026
- 2026Disentangling Topology and Diversity in Multi-Agent LLMs for Multilingual Low-Resource Emotion Detection13 Sep 2026
- 2026TranslatePsy-AfriSLM: High-Quality Data Scaling For Low-Resource Machine Translation19 Aug 2026
- 2026Language-Specific Gaps in AI Safety Training Datasets13 Aug 2026
- 2026When Audit Quality Fails to Predict Downstream Utility: A Counterfactual Study of Synthetic-Data Selectors for Low-Resource African NLP15 Jul 2026
- 2026Temporal Simultaneity Predicts Annotation Quality in Sentiment Corpora26 May 2026
- 2026NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Survey26 Jan 2026
- 2025Limited-Resource Adapters Are Regularizers, Not Linguists30 May 2025
- 2025On Multilingual Encoder Language Model Compression for Low-Resource Languages22 May 2025
- 2025Where Are We? Evaluating LLM Performance on African Languages26 Feb 2025
- 2025AfroXLMR-Comet: Multilingual Knowledge Distillation with Attention Matching for Low-Resource languages25 Feb 2025
29 more
- 2025MAGE: Multi-Head Attention Guided Embeddings for Low Resource Sentiment Classification25 Feb 2025
- 2025BRIGHTER: BRIdging the Gap in Human-Annotated Textual Emotion Recognition Datasets for 28 Languages17 Feb 2025
- 2025M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment Analysis17 Feb 2025
- 2025Small Models, Big Impact: Efficient Corpus and Graph-Based Adaptation of Small Multilingual Language Models for Low-Resource Languages14 Feb 2025
- 2025RideKE: Leveraging Low-Resource, User-Generated Twitter Content for Sentiment and Emotion Detection in Kenyan Code-Switched Dataset10 Feb 2025
- 2024State of NLP in Kenya: A Survey13 Oct 2024
- 2024Multilingual Topic Classification in X: Dataset and Analysis4 Oct 2024
- 2024GrEmLIn: A Repository of Green Baseline Embeddings for 87 Low-Resource Languages Injected with Multilingual Graph Knowledge26 Sep 2024
- 2024InkubaLM: A small language model for low-resource African languages30 Aug 2024
- 2024A Systematic Review of NLP for Ghanaian Languages: Datasets, Models, and a Research Roadmap10 May 2024
- 2024Krey`ol-MT: Building MT for Latin American, Caribbean and Colonial African Creole Languages8 May 2024
- 2024ANGOFA: Leveraging OFA Embedding Initialization and Synthetic Data for Angolan Language Model3 Apr 2024
- 2024EthioLLM: Multilingual Large Language Models for Ethiopian Languages with Task Evaluation20 Mar 2024
- 2024Zero-shot Sentiment Analysis in Low-Resource Languages Using a Multilingual Sentiment Lexicon3 Feb 2024
- 2023LowResource at BLP-2023 Task 2: Leveraging BanglaBert for Low Resource Sentiment Analysis of Bangla Language21 Nov 2023
- 2023CreoleVal: Multilingual Multitask Benchmarks for Creoles30 Oct 2023
- 2023GradSim: Gradient-Based Language Grouping for Effective Multilingual Training23 Oct 2023
- 2023The Skipped Beat: A Study of Sociopragmatic Understanding in LLMs for 64 Languages23 Oct 2023
- 2023Evaluating Emotion Arcs Across Languages: Bridging the Global Divide in Sentiment Analysis3 Jun 2023
- 2023UCAS-IIE-NLP at SemEval-2023 Task 12: Enhancing Generalization of Multilingual BERT for Low-resource Sentiment Analysis1 Jun 2023
- 2023HaVQA: A Dataset for Visual Question Answering and Multimodal Research in Hausa Language28 May 2023
- 2023Bactrian-X: Multilingual Replicable Instruction-Following Models with Low-Rank Adaptation24 May 2023
- 2023DN at SemEval-2023 Task 12: Low-Resource Language Text Classification via Multilingual Pretrained Language Model Fine-tuning4 May 2023
- 2023NLNDE at SemEval-2023 Task 12: Adaptive Pretraining and Source Language Selection for Low-Resource Multilingual Sentiment Analysis28 Apr 2023
- 2023UIO at SemEval-2023 Task 12: Multilingual fine-tuning for sentiment classification in low-resource languages27 Apr 2023
- 2023HausaNLP at SemEval-2023 Task 12: Leveraging African Low Resource TweetData for Sentiment Analysis26 Apr 2023
- 2023GMNLP at SemEval-2023 Task 12: Sentiment Analysis with Phylogeny-Based Adapters25 Apr 2023
- 2023KINLP at SemEval-2023 Task 12: Kinyarwanda Tweet Sentiment Analysis25 Apr 2023
- 2023UBC-DLNLP at SemEval-2023 Task 12: Impact of Transfer Learning on African Sentiment Analysis21 Apr 2023
- 2023Bactrian-X: Multilingual Replicable Instruction-Following Models with Low-Rank Adaptationcited by 81
- 2025BRIGHTER: BRIdging the Gap in Human-Annotated Textual Emotion Recognition Datasets for 28 Languagescited by 27
- 2024InkubaLM: A small language model for low-resource African languagescited by 18
- 2023Evaluating Emotion Arcs Across Languages: Bridging the Global Divide in Sentiment Analysiscited by 16
- 2023HaVQA: A Dataset for Visual Question Answering and Multimodal Research in Hausa Languagecited by 12
- 2023NLNDE at SemEval-2023 Task 12: Adaptive Pretraining and Source Language Selection for Low-Resource Multilingual Sentiment Analysiscited by 10
- 2024Krey`ol-MT: Building MT for Latin American, Caribbean and Colonial African Creole Languagescited by 10
- 2025Where Are We? Evaluating LLM Performance on African Languagescited by 10
- 2023CreoleVal: Multilingual Multitask Benchmarks for Creolescited by 9
- 2025M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment Analysiscited by 9
- 2024EthioLLM: Multilingual Large Language Models for Ethiopian Languages with Task Evaluationcited by 8
- 2024Zero-shot Sentiment Analysis in Low-Resource Languages Using a Multilingual Sentiment Lexiconcited by 7
12 most cited of 37 All 37 (JSON)
- 2026How Many Labels Does a Language Need? Annotation Budgets and Cross-Lingual Pooling for African-Language Text Classification29 Sep 2026
- 2026One Threshold Does Not Fit All Languages: Language-Conditional Deferral for Reliable and Efficient Low-Resource Text Classification29 Sep 2026
- 2026TranslatePsy-AfriSLM: High-Quality Data Scaling For Low-Resource Machine Translation19 Aug 2026
- 2026Language-Specific Gaps in AI Safety Training Datasets13 Aug 2026
- 2026When Audit Quality Fails to Predict Downstream Utility: A Counterfactual Study of Synthetic-Data Selectors for Low-Resource African NLP15 Jul 2026
- 2026Temporal Simultaneity Predicts Annotation Quality in Sentiment Corpora26 May 2026
- 2026NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Survey26 Jan 2026
- 2025Limited-Resource Adapters Are Regularizers, Not Linguists30 May 2025
- 2025Where Are We? Evaluating LLM Performance on African Languages26 Feb 2025
- 2025MAGE: Multi-Head Attention Guided Embeddings for Low Resource Sentiment Classification25 Feb 2025
- 2025BRIGHTER: BRIdging the Gap in Human-Annotated Textual Emotion Recognition Datasets for 28 Languages17 Feb 2025
- 2025M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment Analysis17 Feb 2025
12 newest of 37 All 37 (JSON)