Overview of the HASOC track at FIRE 2020: Hate Speech and Offensive Content Identification in Indo-European Languages
Not on the map. Why?
Abstract (arXiv)
With the growth of social media, the spread of hate speech is also increasing rapidly. Social media are widely used in many countries. Also Hate Speech is spreading in these countries. This brings a need for multilingual Hate Speech detection algorithms. Much research in this area is dedicated to English at the moment. The HASOC track intends to provide a platform to develop and optimize Hate Speech detection algorithms for Hindi, German and English. The dataset is collected from a Twitter archive and pre-classified by a machine learning system. HASOC has two sub-task for all three languages: task A is a binary classification problem (Hate and Not Offensive) while task B is a fine-grained classification problem for three classes (HATE) Hate speech, OFFENSIVE and PROFANITY. Overall, 252 runs were submitted by 40 teams. The performance of the best classification algorithms for task A are F1 measures of 0.51, 0.53 and 0.52 for English, Hindi, and German, respectively. For task B, the best classification algorithms achieved F1 measures of 0.26, 0.33 and 0.29 for English, Hindi, and German, respectively. This article presents the tasks and the data development as well as the results. The best performing algorithms were mainly variants of the transformer architecture BERT. However, also other systems were applied with good success
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Builds on 8 of its 48 references that are in the map. First posted on arXiv 12 Aug 2021.
Builds on
8 of 48 references.
References · 8
- 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 485
- 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 268
- 2019Racial Bias in Hate Speech and Abusive Language Detection Datasetscited by 208
- 2020FakeCovid -- A Multilingual Cross-domain Fact Check News Dataset for COVID-19cited by 60
- 2020Offensive Language Identification in Greekcited by 49
- 2019Offensive Language and Hate Speech Detection for Danishcited by 48
- 2020An Exploratory Study of COVID-19 Misinformation on Twittercited by 33
- 2020AMUSED: An Annotation Framework of Multi-modal Social Media Datacited by 7
Built on by
Citing papers per year: 2021: 6; 2022: 14; 2023: 10; 2024: 4; 2025: 2; 2026: 2.
38 papers.
Sort:
By area:
- 2022A New Generation of Perspective API: Efficient Multilingual Character-level Transformerscited by 181
- 2023Robust Hate Speech Detection in Social Media: A Cross-Dataset Empirical Evaluationcited by 28
- 2022Data Bootstrapping Approaches to Improve Low Resource Abusive Language Detection for Indic Languagescited by 23
- 2021Few-shot Instruction Prompts for Pretrained Language Models to Detect Social Biasescited by 21
- 2023Cultural Compass: Predicting Transfer Learning Success in Offensive Language Detection with Cultural Featurescited by 18
- 2021Overview of the HASOC Subtrack at FIRE 2021: Hate Speech and Offensive Content Identification in English and Indo-Aryan Languagescited by 17
- 2024ToxiCraft: A Novel Framework for Synthetic Generation of Harmful Informationcited by 17
- 2021Multi-Task Learning with Sentiment, Emotion, and Target Detection to Recognize Hate Speech and Offensive Languagecited by 12
- 2023Multilingual Content Moderation: A Case Study on Redditcited by 8
- 2023Cyberbullying Detection for Low-resource Languages and Dialects: Review of the State of the Artcited by 8
- 2022Hidden behind the obvious: misleading keywords and implicitly abusive language on social mediacited by 6
- 2023Evaluating ChatGPT's Performance for Multilingual and Emoji-based Hate Speech Detectioncited by 6
26 more
- 2022Overview of Abusive and Threatening Language Detection in Urdu at FIRE 2021cited by 5
- 2022Overview of the HASOC Subtrack at FIRE 2022: Offensive Language Identification in Marathicited by 5
- 2024On the Risk of Evidence Pollution for Malicious Social Text Detection in the Era of LLMscited by 5
- 2021The ComMA Dataset V0.2: Annotating Aggression and Bias in Multilingual Social Media Discoursecited by 4
- 2022Human-in-the-Loop Hate Speech Classification in a Multilingual Contextcited by 3
- 2021Combining Textual Features for the Detection of Hateful and Offensive Languagecited by 2
- 2023TOT: Topology-Aware Optimal Transport For Multimodal Hate Detectioncited by 2
- 2021Reducing Target Group Bias in Hate Speech Detectorscited by 1
- 2022POTATO: exPlainable infOrmation exTrAcTion framewOrkcited by 1
- 2022IIITDWD-ShankarB@ Dravidian-CodeMixi-HASOC2021: mBERT based model for identification of offensive content in south Indian languagescited by 1
- 2022Cross-Platform and Cross-Domain Abusive Language Detection with Supervised Contrastive Learningcited by 1
- 2023Sociocultural knowledge is needed for selection of shots in hate speech detection taskscited by 1
- 2023Evaluating the Effectiveness of Natural Language Inference for Hate Speech Detection in Languages with Limited Labeled Datacited by 1
- 2023Studying Socially Unacceptable Discourse Classification (SUD) through different eyes: "Are we on the same page ?"cited by 1
- 2024HarmPot: An Annotation Framework for Evaluating Offline Harm Potential of Social Media Textcited by 1
- 2024COT: A Generative Approach for Hate Speech Counter-Narratives via Contrastive Optimal Transportcited by 1
- 2025Fine-Tuning Large Language Models with QLoRA for Offensive Language Detection in Roman Urdu-English Code-Mixed Textcited by 1
- 2026X-MuTeST: A Multilingual Benchmark for Explainable Hate Speech Detection and A Novel LLM-consulted Explanation Frameworkcited by 1
- 2022An exploratory experiment on Hindi, Bengali hate-speech detection and transfer learning using neural networkscited by 0
- 2022Multilingual Hate Speech and Offensive Content Detection using Modified Cross-entropy Losscited by 0
- 2022Hindi/Bengali Sentiment Analysis Using Transfer Learning and Joint Dual Input Learning with Self Attentioncited by 0
- 2022Detecting Offensive Language on Social Networks: An End-to-end Detection Method based on Graph Attention Networkscited by 0
- 2022SATLab at SemEval-2022 Task 4: Trying to Detect Patronizing and Condescending Language with only Character and Word N-gramscited by 0
- 2023Regex-augmented Domain Transfer Topic Classification based on a Pre-trained Language Model: An application in Financial Domaincited by 0
- 2025Defining, Understanding, and Detecting Online Toxicity: Challenges and Machine Learning Approachescited by 0
- 2026FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditingcited by 0
- 2026FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditing21 Sep 2026
- 2026X-MuTeST: A Multilingual Benchmark for Explainable Hate Speech Detection and A Novel LLM-consulted Explanation Framework6 Jan 2026
- 2025Fine-Tuning Large Language Models with QLoRA for Offensive Language Detection in Roman Urdu-English Code-Mixed Text4 Oct 2025
- 2025Defining, Understanding, and Detecting Online Toxicity: Challenges and Machine Learning Approaches14 Sep 2025
- 2024On the Risk of Evidence Pollution for Malicious Social Text Detection in the Era of LLMs16 Oct 2024
- 2024ToxiCraft: A Novel Framework for Synthetic Generation of Harmful Information23 Sep 2024
- 2024COT: A Generative Approach for Hate Speech Counter-Narratives via Contrastive Optimal Transport18 Jun 2024
- 2024HarmPot: An Annotation Framework for Evaluating Offline Harm Potential of Social Media Text17 Mar 2024
- 2023Cultural Compass: Predicting Transfer Learning Success in Offensive Language Detection with Cultural Features10 Oct 2023
- 2023Cyberbullying Detection for Low-resource Languages and Dialects: Review of the State of the Art30 Aug 2023
- 2023Studying Socially Unacceptable Discourse Classification (SUD) through different eyes: "Are we on the same page ?"8 Aug 2023
- 2023Robust Hate Speech Detection in Social Media: A Cross-Dataset Empirical Evaluation4 Jul 2023
26 more
- 2023Evaluating the Effectiveness of Natural Language Inference for Hate Speech Detection in Languages with Limited Labeled Data6 Jun 2023
- 2023Regex-augmented Domain Transfer Topic Classification based on a Pre-trained Language Model: An application in Financial Domain23 May 2023
- 2023Evaluating ChatGPT's Performance for Multilingual and Emoji-based Hate Speech Detection22 May 2023
- 2023Sociocultural knowledge is needed for selection of shots in hate speech detection tasks4 Apr 2023
- 2023TOT: Topology-Aware Optimal Transport For Multimodal Hate Detection27 Feb 2023
- 2023Multilingual Content Moderation: A Case Study on Reddit19 Feb 2023
- 2022Human-in-the-Loop Hate Speech Classification in a Multilingual Context5 Dec 2022
- 2022Overview of the HASOC Subtrack at FIRE 2022: Offensive Language Identification in Marathi18 Nov 2022
- 2022Cross-Platform and Cross-Domain Abusive Language Detection with Supervised Contrastive Learning11 Nov 2022
- 2022Overview of Abusive and Threatening Language Detection in Urdu at FIRE 202114 Jul 2022
- 2022Hidden behind the obvious: misleading keywords and implicitly abusive language on social media3 May 2022
- 2022Data Bootstrapping Approaches to Improve Low Resource Abusive Language Detection for Indic Languages26 Apr 2022
- 2022IIITDWD-ShankarB@ Dravidian-CodeMixi-HASOC2021: mBERT based model for identification of offensive content in south Indian languages13 Apr 2022
- 2022SATLab at SemEval-2022 Task 4: Trying to Detect Patronizing and Condescending Language with only Character and Word N-grams10 Mar 2022
- 2022Detecting Offensive Language on Social Networks: An End-to-end Detection Method based on Graph Attention Networks4 Mar 2022
- 2022A New Generation of Perspective API: Efficient Multilingual Character-level Transformers22 Feb 2022
- 2022Hindi/Bengali Sentiment Analysis Using Transfer Learning and Joint Dual Input Learning with Self Attention11 Feb 2022
- 2022Multilingual Hate Speech and Offensive Content Detection using Modified Cross-entropy Loss5 Feb 2022
- 2022POTATO: exPlainable infOrmation exTrAcTion framewOrk31 Jan 2022
- 2022An exploratory experiment on Hindi, Bengali hate-speech detection and transfer learning using neural networks6 Jan 2022
- 2021Overview of the HASOC Subtrack at FIRE 2021: Hate Speech and Offensive Content Identification in English and Indo-Aryan Languages17 Dec 2021
- 2021Few-shot Instruction Prompts for Pretrained Language Models to Detect Social Biases15 Dec 2021
- 2021Combining Textual Features for the Detection of Hateful and Offensive Language9 Dec 2021
- 2021Reducing Target Group Bias in Hate Speech Detectors7 Dec 2021
- 2021The ComMA Dataset V0.2: Annotating Aggression and Bias in Multilingual Social Media Discourse19 Nov 2021
- 2021Multi-Task Learning with Sentiment, Emotion, and Target Detection to Recognize Hate Speech and Offensive Language21 Sep 2021
- 2022A New Generation of Perspective API: Efficient Multilingual Character-level Transformerscited by 181
- 2023Robust Hate Speech Detection in Social Media: A Cross-Dataset Empirical Evaluationcited by 28
- 2022Data Bootstrapping Approaches to Improve Low Resource Abusive Language Detection for Indic Languagescited by 23
- 2021Few-shot Instruction Prompts for Pretrained Language Models to Detect Social Biasescited by 21
- 2023Cultural Compass: Predicting Transfer Learning Success in Offensive Language Detection with Cultural Featurescited by 18
- 2021Overview of the HASOC Subtrack at FIRE 2021: Hate Speech and Offensive Content Identification in English and Indo-Aryan Languagescited by 17
- 2021Multi-Task Learning with Sentiment, Emotion, and Target Detection to Recognize Hate Speech and Offensive Languagecited by 12
- 2023Multilingual Content Moderation: A Case Study on Redditcited by 8
- 2023Cyberbullying Detection for Low-resource Languages and Dialects: Review of the State of the Artcited by 8
- 2022Hidden behind the obvious: misleading keywords and implicitly abusive language on social mediacited by 6
- 2023Evaluating ChatGPT's Performance for Multilingual and Emoji-based Hate Speech Detectioncited by 6
- 2022Overview of Abusive and Threatening Language Detection in Urdu at FIRE 2021cited by 5
12 most cited of 36 All 36 (JSON)
- 2026FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditing21 Sep 2026
- 2026X-MuTeST: A Multilingual Benchmark for Explainable Hate Speech Detection and A Novel LLM-consulted Explanation Framework6 Jan 2026
- 2025Fine-Tuning Large Language Models with QLoRA for Offensive Language Detection in Roman Urdu-English Code-Mixed Text4 Oct 2025
- 2025Defining, Understanding, and Detecting Online Toxicity: Challenges and Machine Learning Approaches14 Sep 2025
- 2024On the Risk of Evidence Pollution for Malicious Social Text Detection in the Era of LLMs16 Oct 2024
- 2024COT: A Generative Approach for Hate Speech Counter-Narratives via Contrastive Optimal Transport18 Jun 2024
- 2024HarmPot: An Annotation Framework for Evaluating Offline Harm Potential of Social Media Text17 Mar 2024
- 2023Cultural Compass: Predicting Transfer Learning Success in Offensive Language Detection with Cultural Features10 Oct 2023
- 2023Cyberbullying Detection for Low-resource Languages and Dialects: Review of the State of the Art30 Aug 2023
- 2023Studying Socially Unacceptable Discourse Classification (SUD) through different eyes: "Are we on the same page ?"8 Aug 2023
- 2023Robust Hate Speech Detection in Social Media: A Cross-Dataset Empirical Evaluation4 Jul 2023
- 2023Evaluating the Effectiveness of Natural Language Inference for Hate Speech Detection in Languages with Limited Labeled Data6 Jun 2023
12 newest of 36 All 36 (JSON)