mlsanityData to 14 Oct 2026

Towards Generalizable Generic Harmful Speech Datasets for Implicit Hate Speech Detection

arXiv 2506.16476 ↗First posted 19 Jun 2025cs.CL cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Implicit hate speech has recently emerged as a critical challenge for social media platforms. While much of the research has traditionally focused on harmful speech in general, the need for generalizable techniques to detect veiled and subtle forms of hate has become increasingly pressing. Based on lexicon analysis, we hypothesize that implicit hate speech is already present in publicly available harmful speech datasets but may not have been explicitly recognized or labeled by annotators. Additionally, crowdsourced datasets are prone to mislabeling due to the complexity of the task and often influenced by annotators' subjective interpretations. In this paper, we propose an approach to address the detection of implicit hate speech and enhance generalizability across diverse datasets by leveraging existing harmful speech datasets. Our method comprises three key components: influential sample identification, reannotation, and augmentation using Llama-3 70B and GPT-4o. Experimental results demonstrate the effectiveness of our approach in improving implicit hate detection, achieving a +12.9-point F1 score improvement compared to the baseline.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 32 references that are in the map. First posted on arXiv 19 Jun 2025.

Builds on

18 of 32 references.

References · 18

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  4. 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
  5. 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
  6. 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 580
  7. 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 422
  8. 2020Early-Learning Regularization Prevents Memorization of Noisy Labelscited by 416
  9. 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 380
  10. 2019Unsupervised Label Noise Modeling and Loss Correctioncited by 328
  11. 2014Training Deep Neural Networks on Noisy Labels with Bootstrappingcited by 322
  12. 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 271
6 more
  1. 2018Large Scale Crowdsourcing and Characterization of Twitter Abusive Behaviorcited by 270
  2. 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 221
  3. 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 217
  4. 2023Is ChatGPT better than Human Annotators? Potential and Limitations of ChatGPT in Explaining Implicit Hate Speechcited by 166
  5. 2019Multilingual and Multi-Aspect Hate Speech Analysiscited by 133
  6. 2023THOS: A Benchmark Dataset for Targeted Hate and Offensive Speechcited by 4

Built on by

Not cited yet.