mlsanityData to 14 Oct 2026

Empirical Evaluation of Public HateSpeech Datasets

arXiv 2407.12018 ↗First posted 27 Jun 2024cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Despite the extensive communication benefits offered by social media platforms, numerous challenges must be addressed to ensure user safety. One of the most significant risks faced by users on these platforms is targeted hate speech. Social media platforms are widely utilised for generating datasets employed in training and evaluating machine learning algorithms for hate speech detection. However, existing public datasets exhibit numerous limitations, hindering the effective training of these algorithms and leading to inaccurate hate speech classification. This study provides a comprehensive empirical evaluation of several public datasets commonly used in automated hate speech classification. Through rigorous analysis, we present compelling evidence highlighting the limitations of current hate speech datasets. Additionally, we conduct a range of statistical analyses to elucidate the strengths and weaknesses inherent in these datasets. This work aims to advance the development of more accurate and reliable machine learning models for hate speech detection by addressing the dataset limitations identified.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 44 references that are in the map. First posted on arXiv 27 Jun 2024.

Builds on

10 of 44 references.

References · 10

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
  3. 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 221
  4. 2018Hate Speech Dataset from a White Supremacy Forumcited by 198
  5. 2019A Benchmark Dataset for Learning to Intervene in Online Hate Speechcited by 129
  6. 2019Exploring Hate Speech Detection in Multimodal Publicationscited by 103
  7. 2020Measuring a hate speech spectrum with faceted Rasch item response theory and perspective-aware, explainable-by-design deep learningcited by 68
  8. 2021Detection of Hate Speech using BERT and Hate Speech Word Embedding with Deep Modelcited by 26
  9. 2021Character-level HyperNetworks for Hate Speech Detectioncited by 7
  10. 2022BERT-based Ensemble Approaches for Hate Speech Detectioncited by 4

Built on by

Not cited yet.