NLPineers@ NLU of Devanagari Script Languages 2025: Hate Speech Detection using Ensembling of BERT-based models
Not on the map. Why?
Abstract (arXiv)
This paper explores hate speech detection in Devanagari-scripted languages, focusing on Hindi and Nepali, for Subtask B of the CHIPSAL@COLING 2025 Shared Task. Using a range of transformer-based models such as XLM-RoBERTa, MURIL, and IndicBERT, we examine their effectiveness in navigating the nuanced boundary between hate speech and free expression. Our best performing model, implemented as ensemble of multilingual BERT models achieve Recall of 0.7762 (Rank 3/31 in terms of recall) and F1 score of 0.6914 (Rank 17/31). To address class imbalance, we used backtranslation for data augmentation, and cosine similarity to preserve label consistency after augmentation. This work emphasizes the need for hate speech detection in Devanagari-scripted languages and presents a foundation for further research.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 11 of its 24 references that are in the map. First posted on arXiv 11 Dec 2024.
Builds on
11 of 24 references.
References · 11
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
- 2018Learning Word Vectors for 157 Languagescited by 280
- 2020HateBERT: Retraining BERT for Abusive Language Detection in Englishcited by 207
- 2021MuRIL: Multilingual Representations for Indian Languagescited by 179
- 2021L3CubeMahaSent: A Marathi Tweet-based Sentiment Analysis Datasetcited by 31
- 2022Data Bootstrapping Approaches to Improve Low Resource Abusive Language Detection for Indic Languagescited by 23
- 2021Itihasa: A large-scale corpus for Sanskrit to English translationcited by 13
- 2023Uncovering Political Hate Speech During Indian Election Campaign: A New Low-Resource Dataset and Baselinescited by 8
- 2024Can Perplexity Predict Fine-tuning Performance? An Investigation of Tokenization Effects on Sequential Language Models for Nepalicited by 3
- 2020Linguistic Taboos and Euphemisms in Nepalicited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025Code-Mixed Telugu-English Hate Speech Detectioncited by 0
- 2026Cascading versus Joint Modeling for Hierarchical Offensive Language Detectioncited by 0
- 2026ShriNep@EEUCA 2026: RAKSHAK - Multi-Task DeBERTa with Rationale Distillation and Jigsaw-Augmented Training for Toxic Intent Classificationcited by 0
- 2026Cascading versus Joint Modeling for Hierarchical Offensive Language Detection18 Jul 2026
- 2026ShriNep@EEUCA 2026: RAKSHAK - Multi-Task DeBERTa with Rationale Distillation and Jigsaw-Augmented Training for Toxic Intent Classification14 May 2026
- 2025Code-Mixed Telugu-English Hate Speech Detection15 Feb 2025