mlsanityData to 14 Oct 2026

One to rule them all: Towards Joint Indic Language Hate Speech Detection

arXiv 2109.13711 ↗First posted 28 Sep 2021cs.CLcited by 7

Not on the map. Why?

Abstract (arXiv)

This paper is a contribution to the Hate Speech and Offensive Content Identification in Indo-European Languages (HASOC) 2021 shared task. Social media today is a hotbed of toxic and hateful conversations, in various languages. Recent news reports have shown that current models struggle to automatically identify hate posted in minority languages. Therefore, efficiently curbing hate speech is a critical challenge and problem of interest. We present a multilingual architecture using state-of-the-art transformer language models to jointly learn hate and offensive speech detection across three languages namely, English, Hindi, and Marathi. On the provided testing corpora, we achieve Macro F1 scores of 0.7996, 0.7748, 0.8651 for sub-task 1A and 0.6268, 0.5603 during the fine-grained classification of sub-task 1B. These results show the efficacy of exploiting a multilingual training scheme.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 11 of its 29 references that are in the map. First posted on arXiv 28 Sep 2021.

Builds on

11 of 29 references.

References · 11

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  5. 2016Enriching Word Vectors with Subword Informationcited by 1,583
  6. 2019A BERT-Based Transfer Learning Approach for Hate Speech Detection in Online Social Mediacited by 96
  7. 2016Analyzing the Targets of Hate in Online Social Mediacited by 49
  8. 2020Deep Learning Models for Multilingual Hate Speech Detectioncited by 49
  9. 2018Hate Speech Detection: A Solved Problem? The Challenging Case of Long Tail on Twittercited by 36
  10. 2016emoji2vec: Learning Emoji Representations from their Descriptioncited by 28
  11. 2021Cross-lingual Offensive Language Identification for Low Resource Languages: The Case of Marathicited by 28

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 2; 2022: 2; 2023: 1; 2024: 1; 2025: 0; 2026: 1.

7 papers.

  1. 2022L3Cube-MahaHate: A Tweet-based Marathi Hate Speech Detection Dataset and BERT modelscited by 21
  2. 2021Overview of the HASOC Subtrack at FIRE 2021: Hate Speech and Offensive Content Identification in English and Indo-Aryan Languagescited by 17
  3. 2022Overview of the HASOC Subtrack at FIRE 2022: Offensive Language Identification in Marathicited by 5
  4. 2023Hate Speech and Offensive Content Detection in Indo-Aryan Languages: A Battle of LSTM and Transformerscited by 4
  5. 2024A Survey on Automatic Online Hate Speech Detection in Low-Resource Languagescited by 2
  6. 2026BhashaSutra: A Task-Centric Unified Survey of Indian NLP Datasets, Corpora, and Resourcescited by 1
  7. 2021Hypers at ComMA@ICON: Modelling Aggressiveness, Gender Bias and Communal Bias Identificationcited by 0