mlsanityData to 14 Oct 2026

HatePrototypes: Interpretable and Transferable Representations for Implicit and Explicit Hate Speech Detection

arXiv 2511.06391 ↗First posted 9 Nov 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Optimization of offensive content moderation models for different types of hateful messages is typically achieved through continued pre-training or fine-tuning on new hate speech benchmarks. However, existing benchmarks mainly address explicit hate toward protected groups and often overlook implicit or indirect hate, such as demeaning comparisons, calls for exclusion or violence, and subtle discriminatory language that still causes harm. While explicit hate can often be captured through surface features, implicit hate requires deeper, full-model semantic processing. In this work, we question the need for repeated fine-tuning and analyze the role of HatePrototypes, class-level vector representations derived from language models optimized for hate speech detection and safety moderation. We find that these prototypes, built from as few as 50 examples per class, enable cross-task transfer between explicit and implicit hate, with interchangeable prototypes across benchmarks. Moreover, we show that parameter-free early exiting with prototypes is effective for both hate types. We release the code, prototype resources, and evaluation scripts to support future research on efficient and transferable hate speech detection.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 51 references that are in the map. First posted on arXiv 9 Nov 2025.

Builds on

27 of 51 references.

References · 27

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  3. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  4. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  5. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
  6. 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 710
  7. 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 422
  8. 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 380
  9. 2020DeeBERT: Dynamic Early Exiting for Accelerating BERT Inferencecited by 332
  10. 2024LayerSkip: Enabling Early Exit Inference and Self-Speculative Decodingcited by 307
  11. 2020BERT Loses Patience: Fast and Robust Inference with Early Exitcited by 273
  12. 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 271
15 more
  1. 2020FastBERT: a Self-distilling BERT with Adaptive Inference Timecited by 226
  2. 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 217
  3. 2020HateCheck: Functional Tests for Hate Speech Detection Modelscited by 216
  4. 2022A New Generation of Perspective API: Efficient Multilingual Character-level Transformerscited by 185
  5. 2020Directions in Abusive Language Training Data: Garbage In, Garbage Outcited by 140
  6. 2023Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decodingcited by 80
  7. 2022Efficient Methods for Natural Language Processing: A Surveycited by 78
  8. 2021Text Detoxification using Large Pre-trained Neural Modelscited by 52
  9. 2025Explicit vs. Implicit: Investigating Social Bias in Large Language Models through Self-Reflectioncited by 27
  10. 2022Hate Speech Criteria: A Modular Approach to Task-Specific Hate Speech Definitionscited by 18
  11. 2024HateDay: Insights from a Global Hate Speech Dataset Representative of a Day on Twittercited by 13
  12. 2023DEED: Dynamic Early Exit on Decoder for Accelerating Encoder-Decoder Transformer Modelscited by 7
  13. 2023Towards Detecting Contextual Real-Time Toxicity for In-Game Chatcited by 5
  14. 2024DE3-BERT: Distance-Enhanced Early Exiting for BERT based on Prototypical Networkscited by 3
  15. 2023Noisy Self-Training with Data Augmentations for Offensive and Hate Speech Detection Taskscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025RV-HATE: Reinforced Multi-Module Voting for Implicit Hate Speech Detection
  2. 2025Selective Demonstration Retrieval for Improved Implicit Hate Speech Detection
  3. 2026Sledgehammer or Scalpel? A Fine-grained Adaptive Framework for Implicit Hate Speech
  4. 2023Probing LLMs for hate speech detection: strengths and vulnerabilities
  5. 2025AmpleHate: Amplifying the Attention for Versatile Implicit Hate Detection
  6. 2025HateBench: Benchmarking Hate Speech Detectors on LLM-Generated Content and Hate Campaigns
  7. 2026Enhancing Hate Speech Detection on Social Media: A Comparative Analysis of Machine Learning Models and Text Transformation Approaches
  8. 2025Dealing with Annotator Disagreement in Hate Speech Classification