mlsanityData to 7 Oct 2026

Directions in Abusive Language Training Data: Garbage In, Garbage Out

arXiv 2004.01670 ↗First posted 3 Apr 2020cs.CLcited by 139

Not on the map. Why?

Abstract (arXiv)

Data-driven analysis and detection of abusive online content covers many different tasks, phenomena, contexts, and methodologies. This paper systematically reviews abusive language dataset creation and content in conjunction with an open website for cataloguing abusive language data. This collection of knowledge leads to a synthesis providing evidence-based recommendations for practitioners working with this complex and highly diverse data.

Key facts. Cited by 139 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Apr 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 12; 2022: 26; 2023: 23; 2024: 29; 2025: 27; 2026: 22.

139 papers.

Sort:

By area:

  1. 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 337
  2. 2021Human-in-the-Loop for Data Collection: a Multi-Target Counter Narrative Dataset to Fight Online Hate Speechcited by 81
  3. 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 74
  4. 2022Detecting and Understanding Harmful Memes: A Surveycited by 58
  5. 2022Multilingual HateCheck: Functional Tests for Multilingual Hate Speech Detection Modelscited by 51
  6. 2023When Do Annotator Demographics Matter? Measuring the Influence of Annotator Demographics with the POPQUORN Datasetcited by 51
  7. 2023SemEval-2023 Task 10: Explainable Detection of Online Sexismcited by 48
  8. 2021ConvAbuse: Data, Analysis, and Benchmarks for Nuanced Abuse Detection in Conversational AIcited by 46
  9. 2022Handling and Presenting Harmful Text in NLP Researchcited by 43
  10. 2021SWSR: A Chinese Dataset and Lexicon for Online Sexism Detectioncited by 42
  11. 2022Human-Machine Collaboration Approaches to Build a Dialogue Dataset for Hate Speech Counteringcited by 40
  12. 2021Detecting Harmful Content On Online Platforms: What Platforms Need Vs. Where Research Efforts Gocited by 32
38 more
  1. 2022Using Pre-Trained Language Models for Producing Counter Narratives Against Hate Speech: a Comparative Studycited by 30
  2. 2023Assessing Language Model Deployment with Risk Cardscited by 30
  3. 2023Safer-Instruct: Aligning Language Models with Automated Preference Datacited by 27
  4. 2024MultiHateClip: A Multilingual Benchmark Dataset for Hateful Video Detection on YouTube and Bilibilicited by 25
  5. 2022How Hate Speech Varies by Target Identity: A Computational Analysiscited by 23
  6. 2024From Languages to Geographies: Towards Evaluating Cultural Bias in Hate Speech Datasetscited by 23
  7. 2024NLP for Counterspeech against Hate: A Survey and How-To Guidecited by 21
  8. 2022Hate Speech Criteria: A Modular Approach to Task-Specific Hate Speech Definitionscited by 18
  9. 2021Overview of the HASOC Subtrack at FIRE 2021: Hate Speech and Offensive Content Identification in English and Indo-Aryan Languagescited by 17
  10. 2023Safety and Fairness for Content Moderation in Generative Modelscited by 15
  11. 2022Improving Generalizability in Implicitly Abusive Language Detection with Concept Activation Vectorscited by 14
  12. 2022KOLD: Korean Offensive Language Datasetcited by 14
  13. 2024MetaHate: A Dataset for Unifying Efforts on Hate Speech Detectioncited by 14
  14. 2022K-MHaS: A Multi-label Hate Speech Detection Dataset in Korean Online News Commentcited by 13
  15. 2024Improving Adversarial Data Collection by Supporting Annotators: Lessons from GAHD, a German Hate Speech Datasetcited by 13
  16. 2021Two Contrasting Data Annotation Paradigms for Subjective NLP Taskscited by 12
  17. 2024HateDay: Insights from a Global Hate Speech Dataset Representative of a Day on Twittercited by 12
  18. 2022Justice in Misinformation Detection Systems: An Analysis of Algorithms, Stakeholders, and Potential Harmscited by 10
  19. 2023iLab at SemEval-2023 Task 11 Le-Wi-Di: Modelling Disagreement or Modelling Perspectives?cited by 10
  20. 2024DetoxLLM: A Framework for Detoxification with Explanationscited by 10
  21. 2021An Information Retrieval Approach to Building Datasets for Hate Speech Detectioncited by 9
  22. 2023Closing the Loop: Testing ChatGPT to Generate Model Explanations to Improve Human Labelling of Sponsored Content on Social Mediacited by 9
  23. 2022Transfer Language Selection for Zero-Shot Cross-Lingual Abusive Language Detectioncited by 8
  24. 2022Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languagescited by 7
  25. 2022"It's Not Just Hate'': A Multi-Dimensional Perspective on Detecting Harmful Speech Onlinecited by 7
  26. 2024"Define Your Terms" : Enhancing Efficient Offensive Speech Classification with Definitioncited by 7
  27. 2022Korean Online Hate Speech Dataset for Multilabel Classification: How Can Social Science Improve Dataset on Hate Speech?cited by 6
  28. 2023BAN-PL: a Novel Polish Dataset of Banned Harmful and Offensive Content from Wykop.pl web servicecited by 6
  29. 2024The Unseen Targets of Hate -- A Systematic Review of Hateful Communication Datasetscited by 6
  30. 2024DefVerify: Do Hate Speech Models Reflect Their Dataset's Definition?cited by 6
  31. 2021In Search of Ambiguity: A Three-Stage Workflow Design to Clarify Annotation Guidelines for Crowd Workerscited by 5
  32. 2022Cyberbullying Classifiers are Sensitive to Model-Agnostic Perturbationscited by 5
  33. 2022Overview of Abusive and Threatening Language Detection in Urdu at FIRE 2021cited by 5
  34. 2025Unified Game Moderation: Soft-Prompting and LLM-Assisted Label Transfer for Resource-Efficient Toxicity Detectioncited by 5
  35. 2021The ComMA Dataset V0.2: Annotating Aggression and Bias in Multilingual Social Media Discoursecited by 4
  36. 2021"Stop Asian Hate!" : Refining Detection of Anti-Asian Hate Speech During the COVID-19 Pandemiccited by 4
  37. 2022CoRAL: a Context-aware Croatian Abusive Language Datasetcited by 4
  38. 2024HateCOT: An Explanation-Enhanced Dataset for Generalizable Offensive Speech Detection via Large Language Modelscited by 4

50 most cited of 139 All 139 (JSON)