mlsanityData to 7 Oct 2026

Overview of the HASOC Subtrack at FIRE 2021: Hate Speech and Offensive Content Identification in English and Indo-Aryan Languages

arXiv 2112.09301 ↗First posted 17 Dec 2021cs.CL cs.AI cs.SIcited by 17

Not on the map. Why?

Abstract (arXiv)

The widespread of offensive content online such as hate speech poses a growing societal problem. AI tools are necessary for supporting the moderation process at online platforms. For the evaluation of these identification tools, continuous experimentation with data sets in different languages are necessary. The HASOC track (Hate Speech and Offensive Content Identification) is dedicated to develop benchmark data for this purpose. This paper presents the HASOC subtrack for English, Hindi, and Marathi. The data set was assembled from Twitter. This subtrack has two sub-tasks. Task A is a binary classification problem (Hate and Not Offensive) offered for all three languages. Task B is a fine-grained classification problem for three classes (HATE) Hate speech, OFFENSIVE and PROFANITY offered for English and Hindi. Overall, 652 runs were submitted by 65 teams. The performance of the best classification algorithms for task A are F1 measures 0.91, 0.78 and 0.83 for Marathi, Hindi and English, respectively. This overview presents the tasks and the data development as well as the detailed results. The systems submitted to the competition applied a variety of technologies. The best performing algorithms were mainly variants of transformer architectures.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 21 of its 86 references that are in the map. First posted on arXiv 17 Dec 2021.

Builds on

21 of 86 references.

References · 21

  1. 2020Language-agnostic BERT Sentence Embeddingcited by 621
  2. 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 268
  3. 2019SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)cited by 206
  4. 2020Directions in Abusive Language Training Data: Garbage In, Garbage Outcited by 139
  5. 2020Multilingual Offensive Language Identification with Cross-lingual Embeddingscited by 71
  6. 2021Towards generalisable hate speech detection: a review on obstacles and solutionscited by 66
  7. 2020FakeCovid -- A Multilingual Cross-domain Fact Check News Dataset for COVID-19cited by 60
  8. 2020SOLID: A Large-Scale Semi-Supervised Dataset for Offensive Language Identificationcited by 53
  9. 2020Offensive Language Identification in Greekcited by 49
  10. 2019Offensive Language and Hate Speech Detection for Danishcited by 48
  11. 2021Overview of the HASOC track at FIRE 2020: Hate Speech and Offensive Content Identification in Indo-European Languagescited by 38
  12. 2020An Exploratory Study of COVID-19 Misinformation on Twittercited by 33
9 more
  1. 2021Cross-lingual Offensive Language Identification for Low Resource Languages: The Case of Marathicited by 28
  2. 2021Overview of the CLEF--2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake Newscited by 23
  3. 2021Multilingual Offensive Language Identification for Low-resource Languagescited by 22
  4. 2021Hate and Offensive Speech Detection in Hindi and Marathicited by 17
  5. 2021Exploring Transformer Based Models to Identify Hate Speech and Offensive Content in English and Indo-Aryan Languagescited by 9
  6. 2020AMUSED: An Annotation Framework of Multi-modal Social Media Datacited by 7
  7. 2021One to rule them all: Towards Joint Indic Language Hate Speech Detectioncited by 6
  8. 2021Fine-tuning of Pre-trained Transformers for Hate, Offensive, and Profane Content Detection in English and Marathicited by 6
  9. 2021Combining Textual Features for the Detection of Hateful and Offensive Languagecited by 2

Built on by

Cited by year

Citing papers per year: 2022: 11; 2023: 2; 2024: 1; 2025: 3.

17 papers.

Sort:

By area:

  1. 2022Multilingual HateCheck: Functional Tests for Multilingual Hate Speech Detection Modelscited by 51
  2. 2022L3Cube-MahaCorpus and MahaBERT: Marathi Monolingual Corpus, Marathi BERT Language Models, and Resourcescited by 49
  3. 2022Mono vs Multilingual BERT for Hate Speech Detection and Text Classification: A Case Study in Marathicited by 16
  4. 2023CoSyn: Detecting Implicit Hate Speech in Online Conversations Using a Context Synergized Hyperbolic Networkcited by 12
  5. 2022HaT5: Hate Language Identification using Text-to-Text Transfer Transformercited by 8
  6. 2025A Modular Taxonomy for Hate Speech Definitions and Its Impact on Zero-Shot LLM Classification Performancecited by 6
  7. 2022Overview of the HASOC Subtrack at FIRE 2022: Offensive Language Identification in Marathicited by 5
  8. 2022A Review of Challenges in Machine Learning based Automated Hate Speech Detectioncited by 3
  9. 2022A Twitter BERT Approach for Offensive Language Detection in Marathicited by 3
  10. 2022A simple language-agnostic yet very strong baseline system for hate speech and offensive content identificationcited by 2
  11. 2025CMLFormer: A Dual Decoder Transformer with Switching Point Learning for Code-Mixed Language Modelingcited by 2
  12. 2022A Feature Extraction based Model for Hate Speech Identificationcited by 1
5 more
  1. 2022POTATO: exPlainable infOrmation exTrAcTion framewOrkcited by 1
  2. 2023Evaluating the Effectiveness of Natural Language Inference for Hate Speech Detection in Languages with Limited Labeled Datacited by 1
  3. 2024HarmPot: An Annotation Framework for Evaluating Offline Harm Potential of Social Media Textcited by 1
  4. 2022Multilingual Hate Speech and Offensive Content Detection using Modified Cross-entropy Losscited by 0
  5. 2025Cyberbullying Detection in Hinglish Text Using MURIL and Explainable AIcited by 0