mlsanityData to 14 Oct 2026

Ceasing hate withMoH: Hate Speech Detection in Hindi-English Code-Switched Language

arXiv 2110.09393 ↗First posted 18 Oct 2021cs.CL cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Social media has become a bedrock for people to voice their opinions worldwide. Due to the greater sense of freedom with the anonymity feature, it is possible to disregard social etiquette online and attack others without facing severe consequences, inevitably propagating hate speech. The current measures to sift the online content and offset the hatred spread do not go far enough. One factor contributing to this is the prevalence of regional languages in social media and the paucity of language flexible hate speech detectors. The proposed work focuses on analyzing hate speech in Hindi-English code-switched language. Our method explores transformation techniques to capture precise text representation. To contain the structure of data and yet use it with existing algorithms, we developed MoH or Map Only Hindi, which means "Love" in Hindi. MoH pipeline consists of language identification, Roman to Devanagari Hindi transliteration using a knowledge base of Roman Hindi words. Finally, it employs the fine-tuned Multilingual Bert and MuRIL language models. We conducted several quantitative experiment studies on three datasets and evaluated performance using Precision, Recall, and F1 metrics. The first experiment studies MoH mapped text's performance with classical machine learning models and shows an average increase of 13% in F1 scores. The second compares the proposed work's scores with those of the baseline models and offers a rise in performance by 6%. Finally, the third reaches the proposed MoH technique with various data simulations using the existing transliteration library. Here, MoH outperforms the rest by 15%. Our results demonstrate a significant improvement in the state-of-the-art scores on all three datasets.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 19 of its 81 references that are in the map. First posted on arXiv 18 Oct 2021.

Builds on

19 of 81 references.

References · 19

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 784
  3. 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
  4. 2019How multilingual is Multilingual BERT?cited by 645
  5. 2017Deep Learning for Hate Speech Detection in Tweetscited by 180
  6. 2021MuRIL: Multilingual Representations for Indian Languagescited by 179
  7. 2019A BERT-Based Transfer Learning Approach for Hate Speech Detection in Online Social Mediacited by 96
  8. 2017The IIT Bombay English-Hindi Parallel Corpuscited by 75
  9. 2018Universal Language Model Fine-tuning for Text Classificationcited by 52
  10. 2017One-step and Two-step Classification for Abusive Language Detection on Twittercited by 46
  11. 2018Aggression-annotated Corpus of Hindi-English Code-mixed Datacited by 40
  12. 2018Hate Speech Detection: A Solved Problem? The Challenging Case of Long Tail on Twittercited by 36
7 more
  1. 2016Towards Sub-Word Level Compositions for Sentiment Analysis of Hindi-English Code Mixed Textcited by 31
  2. 2019Improved Word Sense Disambiguation Using Pre-Trained Contextualized Word Representationscited by 21
  3. 2018Hate Speech Detection from Code-mixed Hindi-English Tweets Using Deep Learning Modelscited by 16
  4. 2019Improved Sentiment Detection via Label Transfer from Monolingual to Synthetic Code-Switched Textcited by 8
  5. 2019UM-IU@LING at SemEval-2019 Task 6: Identifying Offensive Tweets Using BERT and SVMscited by 7
  6. 2018RiTUAL-UH at TRAC 2018 Shared Task: Aggression Identificationcited by 3
  7. 2020Cross-lingual Word Sense Disambiguation using mBERT Embeddings with Syntactic Dependenciescited by 3

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 1; 2025: 1.

3 papers.