GMNLP at SemEval-2023 Task 12: Sentiment Analysis with Phylogeny-Based Adapters
Not on the map. Why?
Abstract (arXiv)
This report describes GMU's sentiment analysis system for the SemEval-2023 shared task AfriSenti-SemEval. We participated in all three sub-tasks: Monolingual, Multilingual, and Zero-Shot. Our approach uses models initialized with AfroXLMR-large, a pre-trained multilingual language model trained on African languages and fine-tuned correspondingly. We also introduce augmented training data along with original training data. Alongside finetuning, we perform phylogeny-based adapter tuning to create several models and ensemble the best models for the final submission. Our system achieves the best F1-score on track 5: Amharic, with 6.2 points higher F1-score than the second-best performing system on this track. Overall, our system ranks 5th among the 10 systems participating in all 15 tracks.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 20 of its 31 references that are in the map. First posted on arXiv 25 Apr 2023.
Builds on
20 of 31 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
- 2022Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-Tuningcited by 149
- 2020When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Modelscited by 131
- 2021Systematic Inequalities in Language Technology Performance across the World's Languagescited by 118
- 2023AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languagescited by 68
- 2022NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysiscited by 64
- 2019Generalized Data Augmentation for Low-Resource Translationcited by 53
8 more
- 2022AfroLM: A Self-Active Learning-based Multilingual Pretrained Language Model for 23 African Languagescited by 46
- 2023SemEval-2023 Task 12: Sentiment Analysis for African Languages (AfriSenti-SemEval)cited by 41
- 2021Efficient Hierarchical Domain Adaptation for Pretrained Language Modelscited by 32
- 2022Phylogeny-Inspired Adaptation of Multilingual Models to New Languagescited by 24
- 2021Ethics Sheet for Automatic Emotion Recognition and Sentiment Analysiscited by 22
- 2022yosm: A new yoruba sentiment corpus for movie reviewscited by 14
- 2021Sentiment Classification in Swahili Language Using Multilingual BERTcited by 6
- 2023Noisy Parallel Data Alignmentcited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 1.
2 papers.