mlsanityData to 7 Oct 2026

Hate Speech Dataset from a White Supremacy Forum

arXiv 1809.04444 ↗First posted 12 Sep 2018cs.CLcited by 196

Not on the map. Why?

Abstract (arXiv)

Hate speech is commonly defined as any communication that disparages a target group of people based on some characteristic such as race, colour, ethnicity, gender, sexual orientation, nationality, religion, or other characteristic. Due to the massive rise of user-generated web content on social media, the amount of hate speech is also steadily increasing. Over the past years, interest in online hate speech detection and, particularly, the automation of this task has continuously grown, along with the societal impact of the phenomenon. This paper describes a hate speech dataset composed of thousands of sentences manually labelled as containing hate speech or not. The sentences have been extracted from Stormfront, a white supremacist forum. A custom annotation tool has been developed to carry out the manual labelling task which, among other things, allows the annotators to choose whether to read the context of a sentence before labelling it. The paper also provides a thoughtful qualitative and quantitative study of the resulting dataset and several baseline experiments with different classification models. The dataset is publicly available.

Key facts. Cited by 196 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Sep 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 33; 2022: 37; 2023: 50; 2024: 46; 2025: 20; 2026: 10.

196 papers.

Sort:

By area:

  1. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
  2. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
  3. 2021MetaICL: Learning to Learn In Contextcited by 450
  4. 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 419
  5. 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 337
  6. 2023Large Language Model Alignment: A Surveycited by 241
  7. 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 216
  8. 2023Is ChatGPT better than Human Annotators? Potential and Limitations of ChatGPT in Explaining Implicit Hate Speechcited by 165
  9. 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfercited by 147
  10. 2021CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLPcited by 142
  11. 2022Ground-Truth Labels Matter: A Deeper Look into Input-Label Demonstrationscited by 116
  12. 2023Instructions as Backdoors: Backdoor Vulnerabilities of Instruction Tuning for Large Language Modelscited by 100
38 more
  1. 2023Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluationscited by 96
  2. 2022Picking on the Same Person: Does Algorithmic Monoculture lead to Outcome Homogenization?cited by 89
  3. 2023Mitigating Label Biases for In-context Learningcited by 88
  4. 2021Human-in-the-Loop for Data Collection: a Multi-Target Counter Narrative Dataset to Fight Online Hate Speechcited by 81
  5. 2021A Survey of Race, Racism, and Anti-Racism in NLPcited by 74
  6. 2021Towards generalisable hate speech detection: a review on obstacles and solutionscited by 66
  7. 2022Handling Bias in Toxic Speech Detection: A Surveycited by 60
  8. 2022A Close Look into the Calibration of Pre-trained Language Modelscited by 57
  9. 2021T-Miner: A Generative Approach to Defend Against Trojan Attacks on DNN-based Text Classificationcited by 56
  10. 2023Active Learning Principles for In-Context Learning with Large Language Modelscited by 53
  11. 2023In-Context Learning Learns Label Relationships but Is Not Conventional Learningcited by 48
  12. 2022BITE: Textual Backdoor Attacks with Iterative Trigger Injectioncited by 47
  13. 2021Hate Towards the Political Opponent: A Twitter Corpus Study of the 2020 US Elections on the Basis of Offensive Speech and Stance Detectioncited by 45
  14. 2023"HOT" ChatGPT: The promise of ChatGPT in detecting and discriminating hateful, offensive, and toxic comments on social mediacited by 45
  15. 2023Exploring Cross-Cultural Differences in English Hate Speech Annotations: From Dataset Construction to Analysiscited by 44
  16. 2024A Survey of Recent Backdoor Attacks and Defenses in Large Language Modelscited by 36
  17. 2023SAIL: Search-Augmented Instruction Learningcited by 33
  18. 2021UNIREX: A Unified Learning Framework for Language Model Rationale Extractioncited by 32
  19. 2023Split-and-Denoise: Protect large language model inference with local differential privacycited by 30
  20. 2023Learning Interpretable Style Embeddings via Prompting LLMscited by 29
  21. 2023Social Bias Probing: Fairness Benchmarking for Language Modelscited by 29
  22. 2021Refining Language Models with Compositional Explanationscited by 27
  23. 2021A systematic review of Hate Speech automatic detection using Natural Language Processingcited by 26
  24. 2021Detection of Hate Speech using BERT and Hate Speech Word Embedding with Deep Modelcited by 26
  25. 2023Interpretable Unified Language Checkingcited by 26
  26. 2024Recent Advances in Hate Speech Moderation: Multimodality and the Role of Large Modelscited by 26
  27. 2024MultiHateClip: A Multilingual Benchmark Dataset for Hateful Video Detection on YouTube and Bilibilicited by 25
  28. 2024From Languages to Geographies: Towards Evaluating Cultural Bias in Hate Speech Datasetscited by 23
  29. 2024MERA: A Comprehensive LLM Evaluation in Russiancited by 22
  30. 2021Dataset for Identification of Homophobia and Transophobia in Multilingual YouTube Commentscited by 20
  31. 2024Estimating the Hallucination Rate of Generative AIcited by 20
  32. 2021Mitigating Racial Biases in Toxic Language Detection with an Equity-Based Ensemble Frameworkcited by 19
  33. 2024Online Cascade Learning for Efficient Inference over Streamscited by 19
  34. 2024Stress-Testing Long-Context Language Models with Lifelong ICL and Task Haystackcited by 19
  35. 2022Hate Speech Criteria: A Modular Approach to Task-Specific Hate Speech Definitionscited by 18
  36. 2021Textual Backdoor Attacks Can Be More Harmful via Two Simple Trickscited by 17
  37. 2022Proactively Reducing the Hate Intensity of Online Posts via Hate Speech Normalizationcited by 17
  38. 2022HateCheckHIn: Evaluating Hindi Hate Speech Detection Modelscited by 15

50 most cited of 196 All 196 (JSON)