mlsanityData to 7 Oct 2026

HateBERT: Retraining BERT for Abusive Language Detection in English

arXiv 2010.12472 ↗First posted 23 Oct 2020cs.CLcited by 206

Not on the map. Why?

Cited by 20 in LLM safety and security, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

In this paper, we introduce HateBERT, a re-trained BERT model for abusive language detection in English. The model was trained on RAL-E, a large-scale dataset of Reddit comments in English from communities banned for being offensive, abusive, or hateful that we have collected and made available to the public. We present the results of a detailed comparison between a general pre-trained language model and the abuse-inclined version obtained by retraining with posts from the banned communities on three English datasets for offensive, abusive language and hate speech detection tasks. In all datasets, HateBERT outperforms the corresponding general BERT model. We also discuss a battery of experiments comparing the portability of the generic pre-trained language model and its corresponding abusive language-inclined counterpart across the datasets, indicating that portability is affected by compatibility of the annotated phenomena.

Key facts. Cited by 206 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Oct 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 14; 2022: 21; 2023: 48; 2024: 54; 2025: 49; 2026: 20.

206 papers.

Sort:

By area:

  1. 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 419
  2. 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 369
  3. 2023ToxicChat: Unveiling Hidden Challenges of Toxicity Detection in Real-World User-AI Conversationcited by 224
  4. 2023Orca 2: Teaching Small Language Models How to Reasoncited by 157
  5. 2021AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processingcited by 131
  6. 2023Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedbackcited by 86
  7. 2021Towards generalisable hate speech detection: a review on obstacles and solutionscited by 66
  8. 2023SemEval-2023 Task 10: Explainable Detection of Online Sexismcited by 48
  9. 2021ConvAbuse: Data, Analysis, and Benchmarks for Nuanced Abuse Detection in Conversational AIcited by 46
  10. 2023Facilitating Fine-grained Detection of Chinese Toxic Language: Hierarchical Taxonomy, Resources, and Benchmarkscited by 45
  11. 2023Exploring Cross-Cultural Differences in English Hate Speech Annotations: From Dataset Construction to Analysiscited by 44
  12. 2022Large-Scale Hate Speech Detection with Cross-Domain Transfercited by 39
38 more
  1. 2022Tell Me What Happened: Unifying Text-guided Video Completion via Multimodal Masked Video Generationcited by 32
  2. 2021FBERT: A Neural Transformer for Identifying Offensive Contentcited by 30
  3. 2023HARE: Explainable Hate Speech Detection with Step-by-Step Reasoningcited by 30
  4. 2021Cross-lingual Offensive Language Identification for Low Resource Languages: The Case of Marathicited by 28
  5. 2023Multimodality Representation Learning: A Survey on Evolution, Pretraining and Its Applicationscited by 27
  6. 2021A systematic review of Hate Speech automatic detection using Natural Language Processingcited by 26
  7. 2021Ruddit: Norms of Offensiveness for English Reddit Commentscited by 26
  8. 2023Unveiling Safety Vulnerabilities of Large Language Modelscited by 26
  9. 2024"They are uncultured": Unveiling Covert Harms and Social Threats in LLM Generated Conversationscited by 24
  10. 2023Helping the Helper: Supporting Peer Counselors via AI-Empowered Practice and Feedbackcited by 23
  11. 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 22
  12. 2021Few-shot Instruction Prompts for Pretrained Language Models to Detect Social Biasescited by 21
  13. 2023Efficient Toxic Content Detection by Bootstrapping and Distilling Large Language Modelscited by 21
  14. 2022Modeling Motivational Interviewing Strategies On An Online Peer-to-Peer Counseling Platformcited by 20
  15. 2025From Judgment to Interference: Early Stopping LLM Harmful Outputs via Streaming Content Monitoringcited by 20
  16. 2024Fairness and Bias in Multimodal AI: A Surveycited by 19
  17. 2024HarmAug: Effective Data Augmentation for Knowledge Distillation of Safety Guard Modelscited by 17
  18. 2024Towards Interpretable Hate Speech Detection using Large Language Model-extracted Rationalescited by 16
  19. 2023''Fifty Shades of Bias'': Normative Ratings of Gender Bias in GPT Generated English Textcited by 15
  20. 2023Towards Safer Generative Language Models: A Survey on Safety Risks, Evaluations, and Improvementscited by 14
  21. 2024Realistic Evaluation of Toxicity in Large Language Modelscited by 14
  22. 2021Fight Fire with Fire: Fine-tuning Hate Detectors using Large Samples of Generated Hate Speechcited by 13
  23. 2022Pre-trained Language Models for Keyphrase Generation: A Thorough Empirical Studycited by 13
  24. 2023Towards Agile Text Classifiers for Everyonecited by 13
  25. 2024LLMScan: Causal Scan for LLM Misbehavior Detectioncited by 13
  26. 2025Is LLM an Overconfident Judge? Unveiling the Capabilities of LLMs in Detecting Offensive Language with Annotation Disagreementcited by 13
  27. 2023Offensive Language Identification in Transliterated and Code-Mixed Banglacited by 12
  28. 2023A benchmark for toxic comment classification on Civil Comments datasetcited by 11
  29. 2023Characterizing Large Language Model Geometry Helps Solve Toxicity Detection and Generationcited by 11
  30. 2025Building Safe GenAI Applications: An End-to-End Overview of Red Teaming for Large Language Modelscited by 11
  31. 2023SPIN: Sparsifying and Integrating Internal Neurons in Large Language Models for Text Classificationcited by 10
  32. 2024SGHateCheck: Functional Tests for Detecting Hate Speech in Low-Resource Languages of Singaporecited by 10
  33. 2026LLM Safety From Within: Detecting Harmful Content with Internal Representationscited by 10
  34. 2023Rethinking Multimodal Content Moderation from an Asymmetric Angle with Mixed-modalitycited by 9
  35. 2023Causality Guided Disentanglement for Cross-Platform Hate Speech Detectioncited by 9
  36. 2024NaijaHate: Evaluating Hate Speech Detection on Nigerian Twitter Using Representative Datacited by 9
  37. 2024How Are LLMs Mitigating Stereotyping Harms? Learning from Search Engine Studiescited by 9
  38. 2025STATE ToxiCN: A Benchmark for Span-level Target-Aware Toxicity Extraction in Chinese Hate Speech Detectioncited by 9

50 most cited of 206 All 206 (JSON)