mlsanityData to 7 Oct 2026

Multilingual Hate Speech and Offensive Content Detection using Modified Cross-entropy Loss

arXiv 2202.02635 ↗First posted 5 Feb 2022cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

The number of increased social media users has led to a lot of people misusing these platforms to spread offensive content and use hate speech. Manual tracking the vast amount of posts is impractical so it is necessary to devise automated methods to identify them quickly. Large language models are trained on a lot of data and they also make use of contextual embeddings. We fine-tune the large language models to help in our task. The data is also quite unbalanced; so we used a modified cross-entropy loss to tackle the issue. We observed that using a model which is fine-tuned in hindi corpora performs better. Our team (HNLP) achieved the macro F1-scores of 0.808, 0.639 in English Subtask A and English Subtask B respectively. For Hindi Subtask A, Hindi Subtask B our team achieved macro F1-scores of 0.737, 0.443 respectively in HASOC 2021.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 29 references that are in the map. First posted on arXiv 5 Feb 2022.

Builds on

11 of 29 references.

References · 11

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  4. 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 724
  5. 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 268
  6. 2017Understanding Abuse: A Typology of Abusive Language Detection Subtaskscited by 115
  7. 2021Towards generalisable hate speech detection: a review on obstacles and solutionscited by 66
  8. 2018Spread of hate speech in online social mediacited by 59
  9. 2021Overview of the HASOC track at FIRE 2020: Hate Speech and Offensive Content Identification in Indo-European Languagescited by 38
  10. 2021Overview of the HASOC Subtrack at FIRE 2021: Hate Speech and Offensive Content Identification in English and Indo-Aryan Languagescited by 17
  11. 2020HinglishNLP: Fine-tuned Language Models for Hinglish Sentiment Detectioncited by 5

Built on by

Not cited yet.