RSM-NLP at BLP-2023 Task 2: Bangla Sentiment Analysis using Weighted and Majority Voted Fine-Tuned Transformers
Not on the map. Why?
Abstract (arXiv)
This paper describes our approach to submissions made at Shared Task 2 at BLP Workshop - Sentiment Analysis of Bangla Social Media Posts. Sentiment Analysis is an action research area in the digital age. With the rapid and constant growth of online social media sites and services and the increasing amount of textual data, the application of automatic Sentiment Analysis is on the rise. However, most of the research in this domain is based on the English language. Despite being the world's sixth most widely spoken language, little work has been done in Bangla. This task aims to promote work on Bangla Sentiment Analysis while identifying the polarity of social media content by determining whether the sentiment expressed in the text is Positive, Negative, or Neutral. Our approach consists of experimenting and finetuning various multilingual and pre-trained BERT-based models on our downstream tasks and using a Majority Voting and Weighted ensemble model that outperforms individual baseline model scores. Our system scored 0.711 for the multiclass classification task and scored 10th place among the participants on the leaderboard for the shared task. Our code is available at https://github.com/ptnv-s/RSM-NLP-BLP-Task2 .
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 42 references that are in the map. First posted on arXiv 22 Oct 2023.
Builds on
16 of 42 references.
References · 16
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2021MuRIL: Multilingual Representations for Indian Languagescited by 177
- 2021BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Banglacited by 123
- 2023Is ChatGPT a Good Sentiment Analyzer? A Preliminary Studycited by 96
- 2020Not Low-Resource Anymore: Aligner Ensembling, Batch Filtering, and New Datasets for Bengali-English Machine Translationcited by 53
- 2020Classification Benchmarks for Under-resourced Bengali Language based on Multichannel Convolutional-LSTM Networkcited by 30
- 2022Data Bootstrapping Approaches to Improve Low Resource Abusive Language Detection for Indic Languagescited by 23
- 2023Zero- and Few-Shot Prompting with LLMs: A Comparative Study with Fine-tuned Models for Bangla Sentiment Analysiscited by 20
- 2021A Review of Bangla Natural Language Processing Tasks and the Utility of Transformer Modelscited by 13
- 2020Sentiment analysis in Bengali via transfer learning using multi-lingual BERTcited by 11
4 more
- 2020Sentiment Classification in Bangla Textual Content: A Comparative Studycited by 8
- 2021Bangla Natural Language Processing: A Comprehensive Analysis of Classical, Machine Learning, and Deep Learning Based Methodscited by 8
- 2016Sentiment Analysis on Bangla and Romanized Bangla Text (BRBT) using Deep Recurrent modelscited by 7
- 2021Emotion Classification in a Resource Constrained Language Using Transformer-based Approachcited by 7
Built on by
Citing papers per year: 2023: 1.
1 paper.
- 2023BLP-2023 Task 2: Sentiment Analysiscited by 7
- 2023BLP-2023 Task 2: Sentiment Analysis24 Oct 2023