MetaHate: A Dataset for Unifying Efforts on Hate Speech Detection
Not on the map. Why?
Abstract (arXiv)
Hate speech represents a pervasive and detrimental form of online discourse, often manifested through an array of slurs, from hateful tweets to defamatory posts. As such speech proliferates, it connects people globally and poses significant social, psychological, and occasionally physical threats to targeted individuals and communities. Current computational linguistic approaches for tackling this phenomenon rely on labelled social media datasets for training. For unifying efforts, our study advances in the critical need for a comprehensive meta-collection, advocating for an extensive dataset to help counteract this problem effectively. We scrutinized over 60 datasets, selectively integrating those pertinent into MetaHate. This paper offers a detailed examination of existing collections, highlighting their strengths and limitations. Our findings contribute to a deeper understanding of the existing datasets, paving the way for training more robust and adaptable models. These enhanced models are essential for effectively combating the dynamic and complex nature of hate speech in the digital realm.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 27 of its 82 references that are in the map. First posted on arXiv 12 Jan 2024.
Builds on
27 of 82 references.
References · 27
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 724
- 2019Quantifying the Carbon Emissions of Machine Learningcited by 516
- 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 403
- 2020The Pushshift Reddit Datasetcited by 289
- 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 268
- 2018Large Scale Crowdsourcing and Characterization of Twitter Abusive Behaviorcited by 265
- 2016Ex Machina: Personal Attacks Seen at Scalecited by 208
- 2018Hate Speech Dataset from a White Supremacy Forumcited by 196
- 2013Crowdsourcing a Word-Emotion Association Lexiconcited by 193
- 2020Directions in Abusive Language Training Data: Garbage In, Garbage Outcited by 139
- 2019Multilingual and Multi-Aspect Hate Speech Analysiscited by 133
- 2019A Benchmark Dataset for Learning to Intervene in Online Hate Speechcited by 128
15 more
- 2020Toxicity Detection: Does Context Really Matter?cited by 93
- 2020Measuring a hate speech spectrum with faceted Rasch item response theory and perspective-aware, explainable-by-design deep learningcited by 67
- 2020ETHOS: an Online Hate Speech Detection Datasetcited by 66
- 2018Hate Lingo: A Target-based Linguistic Analysis of Hate Speech in Social Mediacited by 59
- 2018Spread of hate speech in online social mediacited by 59
- 2016Analyzing the Targets of Hate in Online Social Mediacited by 48
- 2020"Call me sexist, but...": Revisiting Sexism Detection Using Psychological Scales and Adversarial Samplescited by 48
- 2023HateMM: A Multi-Modal Dataset for Hate Video Classificationcited by 41
- 2018Aggression-annotated Corpus of Hindi-English Code-mixed Datacited by 40
- 2022Large-Scale Hate Speech Detection with Cross-Domain Transfercited by 39
- 2020Developing a Multilingual Annotated Corpus of Misogyny and Aggressioncited by 31
- 2018Peer to Peer Hate: Hate Speech Instigators and Their Targetscited by 30
- 2019#MeTooMA: Multi-Aspect Annotations of Tweets Related to the MeToo Movementcited by 15
- 2019The FRENK Datasets of Socially Unacceptable Discourse in Slovene and Englishcited by 8
- 2023Auditing Elon Musk's Impact on Hate Speech and Botscited by 8
Built on by
Citing papers per year: 2024: 2; 2025: 8; 2026: 4.
14 papers.
Sort:
By area:
- 2024Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicitiescited by 13
- 2024Towards Efficient and Explainable Hate Speech Detection via Model Distillationcited by 5
- 2025Advancing Hate Speech Detection with Transformers: Insights from the MetaHatecited by 4
- 2025RL-Guided Data Selection for Language Model Finetuningcited by 2
- 2025Bridging Gaps in Hate Speech Detection: Meta-Collections and Benchmarks for Low-Resource Iberian Languagescited by 2
- 2026Benchmarking Open-Source Safety Guard Models: A Comprehensive Evaluationcited by 1
- 2025From BERT to Qwen: Hate Detection across architecturescited by 0
- 2025WATCHED: A Web AI Agent Tool for Combating Hate Speech by Expanding Datacited by 0
- 2025A Use-Case Specific Dataset for Measuring Dimensions of Responsible Performance in LLM-generated Textcited by 0
- 2025Efficient Hate Speech Detection: A Three-Layer LoRA-Tuned BERTweet Frameworkcited by 0
- 2025A Multi-Perspective Benchmark and Moderation Model for Evaluating Safety and Adversarial Robustnesscited by 0
- 2026Do We Still Need Humans in the Loop? Human vs. LLM Annotation in Active Learning for TikTok Hate Speech Detectioncited by 0
- 2026An Explainable DistilBERT-BiLSTM-Attention Framework for Binary and Multi-Class Hate Speech Detection23 Sep 2026
- 2026Against Political Polarization: A Unified Framework for Tracing Evolving Political Ideologies on Social Media18 Aug 2026
- 2026Do We Still Need Humans in the Loop? Human vs. LLM Annotation in Active Learning for TikTok Hate Speech Detection15 Apr 2026
- 2026Benchmarking Open-Source Safety Guard Models: A Comprehensive Evaluation10 Apr 2026
- 2025A Multi-Perspective Benchmark and Moderation Model for Evaluating Safety and Adversarial Robustness22 Dec 2025
- 2025Efficient Hate Speech Detection: A Three-Layer LoRA-Tuned BERTweet Framework8 Nov 2025
- 2025A Use-Case Specific Dataset for Measuring Dimensions of Responsible Performance in LLM-generated Text23 Oct 2025
- 2025Bridging Gaps in Hate Speech Detection: Meta-Collections and Benchmarks for Low-Resource Iberian Languages13 Oct 2025
- 2025RL-Guided Data Selection for Language Model Finetuning30 Sep 2025
- 2025WATCHED: A Web AI Agent Tool for Combating Hate Speech by Expanding Data1 Sep 2025
- 2025Advancing Hate Speech Detection with Transformers: Insights from the MetaHate6 Aug 2025
- 2025From BERT to Qwen: Hate Detection across architectures14 Jul 2025
- 2024Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicitiescited by 13
- 2024Towards Efficient and Explainable Hate Speech Detection via Model Distillationcited by 5
- 2025Advancing Hate Speech Detection with Transformers: Insights from the MetaHatecited by 4
- 2025RL-Guided Data Selection for Language Model Finetuningcited by 2
- 2025Bridging Gaps in Hate Speech Detection: Meta-Collections and Benchmarks for Low-Resource Iberian Languagescited by 2
- 2026Benchmarking Open-Source Safety Guard Models: A Comprehensive Evaluationcited by 1
- 2025From BERT to Qwen: Hate Detection across architecturescited by 0
- 2025A Use-Case Specific Dataset for Measuring Dimensions of Responsible Performance in LLM-generated Textcited by 0
- 2025Efficient Hate Speech Detection: A Three-Layer LoRA-Tuned BERTweet Frameworkcited by 0
- 2026Do We Still Need Humans in the Loop? Human vs. LLM Annotation in Active Learning for TikTok Hate Speech Detectioncited by 0
- 2026Against Political Polarization: A Unified Framework for Tracing Evolving Political Ideologies on Social Mediacited by 0
- 2026An Explainable DistilBERT-BiLSTM-Attention Framework for Binary and Multi-Class Hate Speech Detectioncited by 0
- 2026An Explainable DistilBERT-BiLSTM-Attention Framework for Binary and Multi-Class Hate Speech Detection23 Sep 2026
- 2026Against Political Polarization: A Unified Framework for Tracing Evolving Political Ideologies on Social Media18 Aug 2026
- 2026Do We Still Need Humans in the Loop? Human vs. LLM Annotation in Active Learning for TikTok Hate Speech Detection15 Apr 2026
- 2026Benchmarking Open-Source Safety Guard Models: A Comprehensive Evaluation10 Apr 2026
- 2025Efficient Hate Speech Detection: A Three-Layer LoRA-Tuned BERTweet Framework8 Nov 2025
- 2025A Use-Case Specific Dataset for Measuring Dimensions of Responsible Performance in LLM-generated Text23 Oct 2025
- 2025Bridging Gaps in Hate Speech Detection: Meta-Collections and Benchmarks for Low-Resource Iberian Languages13 Oct 2025
- 2025RL-Guided Data Selection for Language Model Finetuning30 Sep 2025
- 2025Advancing Hate Speech Detection with Transformers: Insights from the MetaHate6 Aug 2025
- 2025From BERT to Qwen: Hate Detection across architectures14 Jul 2025
- 2024Towards Efficient and Explainable Hate Speech Detection via Model Distillation18 Dec 2024
- 2024Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicities11 Jun 2024