UBC-DLNLP at SemEval-2023 Task 12: Impact of Transfer Learning on African Sentiment Analysis
Not on the map. Why?
Abstract (arXiv)
We describe our contribution to the SemEVAl 2023 AfriSenti-SemEval shared task, where we tackle the task of sentiment analysis in 14 different African languages. We develop both monolingual and multilingual models under a full supervised setting (subtasks A and B). We also develop models for the zero-shot setting (subtask C). Our approach involves experimenting with transfer learning using six language models, including further pertaining of some of these models as well as a final finetuning stage. Our best performing models achieve an F1-score of 70.36 on development data and an F1-score of 66.13 on test data. Unsurprisingly, our results demonstrate the effectiveness of transfer learning and fine-tuning techniques for sentiment analysis across multiple languages. Our approach can be applied to other sentiment analysis tasks in different languages and domains.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 39 references that are in the map. First posted on arXiv 21 Apr 2023.
Builds on
19 of 39 references.
References · 19
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2021Towards a Unified View of Parameter-Efficient Transfer Learningcited by 863
- 2022Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-Tuningcited by 149
- 2019Utilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary Sentencecited by 121
- 2023AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languagescited by 68
- 2018Aspect Based Sentiment Analysis with Gated Convolutional Networkscited by 65
- 2022NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysiscited by 64
- 2022Towards Afrocentric NLP for African Languages: Where We Are and Where We Can Gocited by 46
- 2023SemEval-2023 Task 12: Sentiment Analysis for African Languages (AfriSenti-SemEval)cited by 41
- 2022SERENGETI: Massively Multilingual Language Models for Africacited by 40
7 more
- 2022AfroLID: A Neural Language Identification Tool for African Languagescited by 38
- 2022yosm: A new yoruba sentiment corpus for movie reviewscited by 14
- 2020Semantic Enrichment of Nigerian Pidgin English for Contextual Sentiment Classificationcited by 12
- 2021Are the Multilingual Models Better? Improving Czech Sentiment with Transformerscited by 7
- 2022A Generative Language Model for Few-shot Aspect-Based Sentiment Analysiscited by 7
- 2021Bambara Language Dataset for Sentiment Analysiscited by 4
- 2020Development of a General Purpose Sentiment Lexicon for Igbo Languagecited by 3
Built on by
Not cited yet.