Contextualizing Hate Speech Classifiers with Post-hoc Explanation
Not on the map. Why?
Abstract (arXiv)
Hate speech classifiers trained on imbalanced datasets struggle to determine if group identifiers like "gay" or "black" are used in offensive or prejudiced ways. Such biases manifest in false positives when these identifiers are present, due to models' inability to learn the contexts which constitute a hateful usage of identifiers. We extract SOC post-hoc explanations from fine-tuned BERT classifiers to efficiently detect bias towards identity terms. Then, we propose a novel regularization technique based on these explanations that encourages models to learn from the context of group identifiers in addition to the identifiers themselves. Our approach improved over baselines in limiting false positives on out-of-domain data while maintaining or improving in-domain performance. Project page: https://inklab.usc.edu/contextualize-hate-speech/.
Key facts. Cited by 84 papers in the map (data through 14 Oct 2026). First posted on arXiv 5 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 23; 2023: 18; 2024: 11; 2025: 9; 2026: 3.
84 papers.
Sort:
By area:
- 2023XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Modelscited by 505
- 2021A Survey on Gender Bias in Natural Language Processingcited by 89
- 2021On Measures of Biases and Harms in NLPcited by 81
- 2021A Survey of Race, Racism, and Anti-Racism in NLPcited by 75
- 2021Towards generalisable hate speech detection: a review on obstacles and solutionscited by 66
- 2022Handling Bias in Toxic Speech Detection: A Surveycited by 61
- 2022Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Listscited by 55
- 2023Nationality Bias in Text Generationcited by 50
- 2023SemEval-2023 Task 10: Explainable Detection of Online Sexismcited by 48
- 2023HateMM: A Multi-Modal Dataset for Hate Video Classificationcited by 42
- 2022On Explaining Multimodal Hateful Meme Detection Modelscited by 29
- 2023Sociodemographic Bias in Language Models: A Survey and Forward Pathcited by 28
38 more
- 2021Refining Language Models with Compositional Explanationscited by 27
- 2024Recent Advances in Hate Speech Moderation: Multimodality and the Role of Large Modelscited by 26
- 2022An Empirical Study on Explanations in Out-of-Domain Settingscited by 21
- 2022Challenges in Applying Explainability Methods to Improve the Fairness of NLP Modelscited by 20
- 2021Fairness-aware Class Imbalanced Learningcited by 19
- 2021Mitigating Racial Biases in Toxic Language Detection with an Equity-Based Ensemble Frameworkcited by 19
- 2021Detecting Community Sensitive Norm Violations in Online Conversationscited by 18
- 2021Enjoy the Salience: Towards Better Transformer-based Faithful Explanations with Word Saliencecited by 16
- 2023Unmasking Nationality Bias: A Study of Human Perception of Nationalities in AI-Generated Articlescited by 16
- 2022KOLD: Korean Offensive Language Datasetcited by 14
- 2021Fight Fire with Fire: Fine-tuning Hate Detectors using Large Samples of Generated Hate Speechcited by 13
- 2021Identification of Bias Against People with Disabilities in Sentiment Analysis and Toxicity Detection Modelscited by 13
- 2021Hate Speech Classifiers Learn Human-Like Social Stereotypescited by 12
- 2022VisFIS: Visual Feature Importance Supervision with Right-for-the-Right-Reason Objectivescited by 12
- 2022Counterfactually Augmented Data and Unintended Bias: The Case of Sexism and Hate Speech Detectioncited by 11
- 2022Explainable Abuse Detection as Intent Classification and Slot Fillingcited by 11
- 2023Should We Attend More or Less? Modulating Attention for Fairnesscited by 11
- 2021Improving Counterfactual Generation for Fair Hate Speech Detectioncited by 10
- 2022Multilingual Auxiliary Tasks Training: Bridging the Gap between Languages for Zero-Shot Transfer of Hate Speech Detection Modelscited by 10
- 2024ToxVidLM: A Multimodal Framework for Toxicity Detection in Code-Mixed Videoscited by 10
- 2024Are Large Language Models Really Bias-Free? Jailbreak Prompts for Assessing Adversarial Robustness to Bias Elicitationcited by 9
- 2021Deciphering Implicit Hate: Evaluating Automated Detection Algorithms for Multimodal Hatecited by 8
- 2022XMD: An End-to-End Framework for Interactive Explanation-Based Debugging of NLP Modelscited by 8
- 2021Character-level HyperNetworks for Hate Speech Detectioncited by 7
- 2022Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languagescited by 7
- 2023Generative AI for Hate Speech Detection: Evaluation and Findingscited by 7
- 2024ToXCL: A Unified Framework for Toxic Speech Detection and Explanationcited by 7
- 2024Hate Speech Detection with Generalizable Target-aware Fairnesscited by 7
- 2022ER-Test: Evaluating Explanation Regularization Methods for Language Modelscited by 6
- 2022Assessing Out-of-Domain Language Model Performance from Few Examplescited by 6
- 2022Towards Procedural Fairness: Uncovering Biases in How a Toxic Language Classifier Uses Sentiment Informationcited by 6
- 2022Power of Explanations: Towards automatic debiasing in hate speech detectioncited by 5
- 2026Self-Explaining Hate Speech Detection with Moral Rationalescited by 5
- 2021On a Benefit of Mask Language Modeling: Robustness to Simplicity Biascited by 4
- 2023REFER: An End-to-end Rationale Extraction Framework for Explanation Regularizationcited by 4
- 2024Exploring Boundaries and Intensities in Offensive and Hate Speech: Unveiling the Complex Spectrum of Social Media Discoursecited by 4
- 2025Characterizing Selective Refusal Bias in Large Language Modelscited by 4
- 2022Dynamically Refined Regularization for Improving Cross-corpora Hate Speech Detectioncited by 3
50 most cited of 84 All 84 (JSON)
- 2026From a Word-Level Dictionary to Sentence-Level Semantics: Multilingual Grievance Labelling with Contextual Models23 Jul 2026
- 2026Explain the Flag: Contextualizing Hate Speech Beyond Censorship16 Apr 2026
- 2026Self-Explaining Hate Speech Detection with Moral Rationales7 Jan 2026
- 2025Characterizing Selective Refusal Bias in Large Language Models31 Oct 2025
- 2025Language, Culture, and Ideology: Personalizing Offensiveness Detection in Political Tweets with Reasoning LLMs27 Sep 2025
- 2025Bridging Fairness and Explainability: Can Input-Based Explanations Promote Fairness in Hate Speech Detection?26 Sep 2025
- 2025Compositional Generalisation for Explainable Hate Speech Detection4 Jun 2025
- 2025Don't Erase, Inform! Detecting and Contextualizing Harmful Language in Cultural Heritage Collections30 May 2025
- 2025On Fairness of Task Arithmetic: The Role of Task Vectors30 May 2025
- 2025Data-Efficient Hate Speech Detection via Cross-Lingual Nearest Neighbor Retrieval with Limited Labeled Data20 May 2025
- 2025Explanations as Bias Detectors: A Critical Study of Local Post-hoc XAI Methods for Fairness Exploration1 May 2025
- 2025U-GIFT: Uncertainty-Guided Firewall for Toxic Speech in Few-Shot Scenario1 Jan 2025
38 more
- 2024Interacting Large Language Model Agents. Interpretable Models and Social Learning2 Nov 2024
- 2024A Target-Aware Analysis of Data Augmentation for Hate Speech Detection10 Oct 2024
- 2024Fairness-Aware Multi-Group Target Detection in Online Discussion16 Jul 2024
- 2024Are Large Language Models Really Bias-Free? Jailbreak Prompts for Assessing Adversarial Robustness to Bias Elicitation11 Jul 2024
- 2024ToxVidLM: A Multimodal Framework for Toxicity Detection in Code-Mixed Videos31 May 2024
- 2024Hate Speech Detection with Generalizable Target-aware Fairness28 May 2024
- 2024Exploring Boundaries and Intensities in Offensive and Hate Speech: Unveiling the Complex Spectrum of Social Media Discourse18 Apr 2024
- 2024ToXCL: A Unified Framework for Toxic Speech Detection and Explanation25 Mar 2024
- 2024Recourse for reclamation: Chatting with generative language models21 Mar 2024
- 2024Recent Advances in Hate Speech Moderation: Multimodality and the Role of Large Models30 Jan 2024
- 2024Cross-lingual Offensive Language Detection: A Systematic Review of Datasets, Transfer Approaches and Challenges17 Jan 2024
- 2023Latent Feature-based Data Splits to Improve Generalisation Evaluation: A Hate Speech Detection Case Study16 Nov 2023
- 2023Generative AI for Hate Speech Detection: Evaluation and Findings16 Nov 2023
- 2023Overview of the HASOC Subtrack at FIRE 2023: Identification of Tokens Contributing to Explicit Hate in English by Span Detection16 Nov 2023
- 2023REFER: An End-to-end Rationale Extraction Framework for Explanation Regularization22 Oct 2023
- 2023Towards a Unified Framework for Adaptable Problematic Content Detection via Continual Learning29 Sep 2023
- 2023Hateful Messages: A Conversational Data Set of Hate Speech produced by Adolescents on Discord4 Sep 2023
- 2023Unmasking Nationality Bias: A Study of Human Perception of Nationalities in AI-Generated Articles8 Aug 2023
- 2023XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models2 Aug 2023
- 2023Sociodemographic Bias in Language Models: A Survey and Forward Path13 Jun 2023
- 2023Evaluating the Effectiveness of Natural Language Inference for Hate Speech Detection in Languages with Limited Labeled Data6 Jun 2023
- 2023Exploiting Explainability to Design Adversarial Attacks and Evaluate Attack Resilience in Hate-Speech Detection Models29 May 2023
- 2023Should We Attend More or Less? Modulating Attention for Fairness22 May 2023
- 2023Analyzing Norm Violations in Live-Stream Chat18 May 2023
- 2023HateMM: A Multi-Modal Dataset for Hate Video Classification6 May 2023
- 2023SemEval-2023 Task 10: Explainable Detection of Online Sexism7 Mar 2023
- 2023Explaining text classifiers through progressive neighborhood approximation with realistic samples11 Feb 2023
- 2023Nationality Bias in Text Generation5 Feb 2023
- 2023Language Model Detoxification in Dialogue with Contextualized Stance Control25 Jan 2023
- 2022XMD: An End-to-End Framework for Interactive Explanation-Based Debugging of NLP Models30 Oct 2022
- 2022Multilingual Auxiliary Tasks Training: Bridging the Gap between Languages for Zero-Shot Transfer of Hate Speech Detection Models24 Oct 2022
- 2022TCAB: A Large-Scale Text Classification Attack Benchmark21 Oct 2022
- 2022Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languages20 Oct 2022
- 2022Towards Procedural Fairness: Uncovering Biases in How a Toxic Language Classifier Uses Sentiment Information19 Oct 2022
- 2022Assessing Out-of-Domain Language Model Performance from Few Examples13 Oct 2022
- 2022From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models11 Oct 2022
- 2022Explainable Abuse Detection as Intent Classification and Slot Filling6 Oct 2022
- 2022Domain Classification-based Source-specific Term Penalization for Domain Adaptation in Hate-speech Detection18 Sep 2022
50 newest of 84 All 84 (JSON)
- 2024Are Large Language Models Really Bias-Free? Jailbreak Prompts for Assessing Adversarial Robustness to Bias Elicitationcited by 9
- 2025Characterizing Selective Refusal Bias in Large Language Modelscited by 4
- 2023Latent Feature-based Data Splits to Improve Generalisation Evaluation: A Hate Speech Detection Case Studycited by 0
- 2025Characterizing Selective Refusal Bias in Large Language Models31 Oct 2025
- 2024Are Large Language Models Really Bias-Free? Jailbreak Prompts for Assessing Adversarial Robustness to Bias Elicitation11 Jul 2024
- 2023Latent Feature-based Data Splits to Improve Generalisation Evaluation: A Hate Speech Detection Case Study16 Nov 2023
- 2023XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Modelscited by 505
- 2021A Survey on Gender Bias in Natural Language Processingcited by 89
- 2021On Measures of Biases and Harms in NLPcited by 81
- 2021A Survey of Race, Racism, and Anti-Racism in NLPcited by 75
- 2021Towards generalisable hate speech detection: a review on obstacles and solutionscited by 66
- 2022Handling Bias in Toxic Speech Detection: A Surveycited by 61
- 2022Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Listscited by 55
- 2023Nationality Bias in Text Generationcited by 50
- 2023SemEval-2023 Task 10: Explainable Detection of Online Sexismcited by 48
- 2023HateMM: A Multi-Modal Dataset for Hate Video Classificationcited by 42
- 2022On Explaining Multimodal Hateful Meme Detection Modelscited by 29
- 2023Sociodemographic Bias in Language Models: A Survey and Forward Pathcited by 28
12 most cited of 78 All 78 (JSON)
- 2026From a Word-Level Dictionary to Sentence-Level Semantics: Multilingual Grievance Labelling with Contextual Models23 Jul 2026
- 2026Explain the Flag: Contextualizing Hate Speech Beyond Censorship16 Apr 2026
- 2026Self-Explaining Hate Speech Detection with Moral Rationales7 Jan 2026
- 2025Bridging Fairness and Explainability: Can Input-Based Explanations Promote Fairness in Hate Speech Detection?26 Sep 2025
- 2025Compositional Generalisation for Explainable Hate Speech Detection4 Jun 2025
- 2025Don't Erase, Inform! Detecting and Contextualizing Harmful Language in Cultural Heritage Collections30 May 2025
- 2025On Fairness of Task Arithmetic: The Role of Task Vectors30 May 2025
- 2025Data-Efficient Hate Speech Detection via Cross-Lingual Nearest Neighbor Retrieval with Limited Labeled Data20 May 2025
- 2025Explanations as Bias Detectors: A Critical Study of Local Post-hoc XAI Methods for Fairness Exploration1 May 2025
- 2025U-GIFT: Uncertainty-Guided Firewall for Toxic Speech in Few-Shot Scenario1 Jan 2025
- 2024A Target-Aware Analysis of Data Augmentation for Hate Speech Detection10 Oct 2024
- 2024Fairness-Aware Multi-Group Target Detection in Online Discussion16 Jul 2024
12 newest of 78 All 78 (JSON)