mlsanityData to 7 Oct 2026

Hate-Alert@DravidianLangTech-EACL2021: Ensembling strategies for Transformer-based Offensive language Detection

arXiv 2102.10084 ↗First posted 19 Feb 2021cs.CL cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

Social media often acts as breeding grounds for different forms of offensive content. For low resource languages like Tamil, the situation is more complex due to the poor performance of multilingual or language-specific models and lack of proper benchmark datasets. Based on this shared task, Offensive Language Identification in Dravidian Languages at EACL 2021, we present an exhaustive exploration of different transformer models, We also provide a genetic algorithm technique for ensembling different models. Our ensembled models trained separately for each language secured the first position in Tamil, the second position in Kannada, and the first position in Malayalam sub-tasks. The models and codes are provided.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 13 of its 41 references that are in the map. First posted on arXiv 19 Feb 2021.

Builds on

13 of 41 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  5. 2016Enriching Word Vectors with Subword Informationcited by 1,578
  6. 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 724
  7. 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
  8. 2019BERTs of a feather do not generalize together: Large variability in generalization across models with similar test set performancecited by 89
  9. 2020Corpus Creation for Sentiment Analysis in Code-Mixed Tamil-English Textcited by 67
  10. 2020A Sentiment Analysis Dataset for Code-Mixed Malayalam-Englishcited by 50
  11. 2020Offensive Language Identification in Greekcited by 49
  12. 2019Offensive Language and Hate Speech Detection for Danishcited by 48
1 more
  1. 2020Processing South Asian Languages Written in the Latin Script: the Dakshina Datasetcited by 35

Built on by

Cited by year

Citing papers per year: 2021: 4; 2022: 2; 2023: 1; 2024: 1.

8 papers.

  1. 2022Vietnamese Hate and Offensive Detection using PhoBERT-CNN and Social Media Streaming Datacited by 9
  2. 2023Cyberbullying Detection for Low-resource Languages and Dialects: Review of the State of the Artcited by 8
  3. 2024EkoHate: Abusive Language and Hate Speech Detection for Code-switched Political Discussions on Nigerian Twittercited by 7
  4. 2021Offensive Language Identification in Low-resourced Code-mixed Dravidian languages using Pseudo-labelingcited by 6
  5. 2021Towards Offensive Language Identification for Tamil Code-Mixed YouTube Comments and Postscited by 4
  6. 2022bitsa_nlp@LT-EDI-ACL2022: Leveraging Pretrained Language Models for Detecting Homophobia and Transphobia in Social Media Commentscited by 3
  7. 2021Developing Successful Shared Tasks on Offensive Language Identification for Dravidian Languagescited by 1
  8. 2021Multilingual Text Classification for Dravidian Languagescited by 0