NLP-CUET@LT-EDI-EACL2021: Multilingual Code-Mixed Hope Speech Detection using Cross-lingual Representation Learner
Not on the map. Why?
Abstract (arXiv)
In recent years, several systems have been developed to regulate the spread of negativity and eliminate aggressive, offensive or abusive contents from the online platforms. Nevertheless, a limited number of researches carried out to identify positive, encouraging and supportive contents. In this work, our goal is to identify whether a social media post/comment contains hope speech or not. We propose three distinct models to identify hope speech in English, Tamil and Malayalam language to serve this purpose. To attain this goal, we employed various machine learning (support vector machine, logistic regression, ensemble), deep learning (convolutional neural network + long short term memory) and transformer (m-BERT, Indic-BERT, XLNet, XLM-Roberta) based methods. Results indicate that XLM-Roberta outdoes all other techniques by gaining a weighted f1-score of 0.93, 0.60 and 0.85 respectively for English, Tamil and Malayalam language. Our team has achieved 1st, 2nd and 1st rank in these three tasks respectively.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 11 of its 25 references that are in the map. First posted on arXiv 28 Feb 2021.
Builds on
11 of 25 references.
References · 11
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2016Enriching Word Vectors with Subword Informationcited by 1,578
- 2018Learning Word Vectors for 157 Languagescited by 279
- 2020ktrain: A Low-Code Library for Augmented Machine Learningcited by 23
- 2021Experimental Evaluation of Deep Learning models for Marathi Text Classificationcited by 19
- 2021Transformer-based Language Model Fine-tuning Methods for COVID-19 Fake News Detectioncited by 15
- 2019Voice for the Voiceless: Active Sampling to Detect Comments Supporting the Rohingyascited by 8
- 2021Combating Hostility: Covid-19 Fake News and Hostile Post Detection in Social Mediacited by 6
- 2020TechTexC: Classification of Technical Texts using Convolution and Bidirectional Long Short Term Memory Networkcited by 2
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 1; 2024: 1; 2025: 1; 2026: 1.
7 papers.
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2022PolyHope: Two-Level Hope Speech Detection from Tweetscited by 14
- 2021Hope Speech detection in under-resourced Kannada languagecited by 7
- 2024Code-mixed Sentiment and Hate-speech Predictioncited by 4
- 2025Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalitiescited by 4
- 2023Beyond Negativity: Re-Analysis and Follow-Up Experiments on Hope Speech Detectioncited by 0
- 2026cantnlp@DravidianLangTech 2026: organic domain adaptation improves multi-class hope speech detection in Tulucited by 0
- 2026cantnlp@DravidianLangTech 2026: organic domain adaptation improves multi-class hope speech detection in Tulu10 May 2026
- 2025Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalities8 Oct 2025
- 2024Code-mixed Sentiment and Hate-speech Prediction21 May 2024
- 2023Beyond Negativity: Re-Analysis and Follow-Up Experiments on Hope Speech Detection10 May 2023
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challenges19 Dec 2022
- 2022PolyHope: Two-Level Hope Speech Detection from Tweets25 Oct 2022
- 2021Hope Speech detection in under-resourced Kannada language10 Aug 2021