Tox-BART: Leveraging Toxicity Attributes for Explanation Generation of Implicit Hate Speech
Not on the map. Why?
Abstract (arXiv)
Employing language models to generate explanations for an incoming implicit hate post is an active area of research. The explanation is intended to make explicit the underlying stereotype and aid content moderators. The training often combines top-k relevant knowledge graph (KG) tuples to provide world knowledge and improve performance on standard metrics. Interestingly, our study presents conflicting evidence for the role of the quality of KG tuples in generating implicit explanations. Consequently, simpler models incorporating external toxicity signals outperform KG-infused models. Compared to the KG-based setup, we observe a comparable performance for SBIC (LatentHatred) datasets with a performance variation of +0.44 (+0.49), +1.83 (-1.56), and -4.59 (+0.77) in BLEU, ROUGE-L, and BERTScore. Further human evaluation and error analysis reveal that our proposed setup produces more precise explanations than zero-shot GPT-3.5, highlighting the intricate nature of the task.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 36 of its 50 references that are in the map. First posted on arXiv 6 Jun 2024.
Builds on
36 of 50 references.
References · 36
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
- 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
- 2022Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learningcited by 886
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 403
24 more
- 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 377
- 2020Social Chemistry 101: Learning to Reason about Social and Moral Normscited by 253
- 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 216
- 2020Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answeringcited by 122
- 2020A Survey of Knowledge-Enhanced Text Generationcited by 119
- 2020A Knowledge-Enhanced Pretraining Model for Commonsense Story Generationcited by 116
- 2022On the Intrinsic and Extrinsic Fairness Evaluation Metrics for Contextualized Language Representationscited by 75
- 2022Z-ICL: Zero-Shot In-Context Learning with Pseudo-Demonstrationscited by 70
- 2022Handling Bias in Toxic Speech Detection: A Surveycited by 60
- 2022A Decade of Knowledge Graphs in Natural Language Processing: A Surveycited by 40
- 2018A Unified Deep Learning Architecture for Abuse Detectioncited by 37
- 2022Input-Tuning: Adapting Unfamiliar Inputs to Frozen Pretrained Modelscited by 34
- 2023COBRA Frames: Contextual Reasoning about Effects and Harms of Offensive Statementscited by 34
- 2022When did you become so smart, oh wise one?! Sarcasm Explanation in Multi-modal Multi-party Dialoguescited by 32
- 2022Chain of Explanation: New Prompting Method to Generate Higher Quality Natural Language Explanation for Implicit Hate Speechcited by 25
- 2021Incorporating Commonsense Knowledge Graph in Pretrained Models for Social Commonsense Taskscited by 24
- 2023Beyond Denouncing Hate: Strategies for Countering Implied Biases and Stereotypes in Languagecited by 22
- 2022Necessity and Sufficiency for Explaining Text Classifiers: A Case Study in Hate Speech Detectioncited by 18
- 2017Recognizing Explicit and Implicit Hate Speech Using a Weakly Supervised Two-path Bootstrapping Approachcited by 17
- 2022Proactively Reducing the Hate Intensity of Online Posts via Hate Speech Normalizationcited by 17
- 2022ToKen: Task Decomposition and Knowledge Infusion for Few-Shot Hate Speech Detectioncited by 15
- 2022StereoKG: Data-Driven Knowledge Graph Construction for Cultural Knowledge and Stereotypescited by 14
- 2023BiasX: "Thinking Slow" in Toxic Content Moderation with Explanations of Implied Social Biasescited by 7
- 2023Revisiting Hate Speech Benchmarks: From Data Curation to System Deploymentcited by 7
Built on by
Citing papers per year: 2024: 4; 2025: 6; 2026: 1.
11 papers.
- 2024"Cold, Calculated, and Condescending": How AI Identifies and Explains Ableism Compared to Disabled Peoplecited by 9
- 2024On the Risk of Evidence Pollution for Malicious Social Text Detection in the Era of LLMscited by 5
- 2024SAFE-MEME: Structured Reasoning Framework for Robust Hate Speech Detection in Memescited by 4
- 2024Graph-Guided Textual Explanation Generation Frameworkcited by 3
- 2025Revealing Hidden Mechanisms of Cross-Country Content Moderation with Natural Language Processingcited by 2
- 2025Counterspeech the ultimate shield! Multi-Conditioned Counterspeech Generation through Attributed Prefix Learningcited by 2
- 2025Chinese Toxic Language Mitigation via Sentiment Polarity Consistent Rewritescited by 2
- 2025Cracking the Code: Enhancing Implicit Hate Speech Detection through Coding Classificationcited by 2
- 2026Bye Bye Perspective API: Lessons for Building and Governing Measurement Infrastructurecited by 1
- 2025Reliable Evaluation Protocol for Low-Precision Retrievalcited by 0
- 2025Listening Between the Lines: Decoding Podcast Narratives with Language Modelingcited by 0
- 2026Bye Bye Perspective API: Lessons for Building and Governing Measurement Infrastructure28 Apr 2026
- 2025Listening Between the Lines: Decoding Podcast Narratives with Language Modeling7 Nov 2025
- 2025Reliable Evaluation Protocol for Low-Precision Retrieval5 Aug 2025
- 2025Cracking the Code: Enhancing Implicit Hate Speech Detection through Coding Classification5 Jun 2025
- 2025Chinese Toxic Language Mitigation via Sentiment Polarity Consistent Rewrites21 May 2025
- 2025Counterspeech the ultimate shield! Multi-Conditioned Counterspeech Generation through Attributed Prefix Learning17 May 2025
- 2025Revealing Hidden Mechanisms of Cross-Country Content Moderation with Natural Language Processing7 Mar 2025
- 2024SAFE-MEME: Structured Reasoning Framework for Robust Hate Speech Detection in Memes29 Dec 2024
- 2024Graph-Guided Textual Explanation Generation Framework16 Dec 2024
- 2024On the Risk of Evidence Pollution for Malicious Social Text Detection in the Era of LLMs16 Oct 2024
- 2024"Cold, Calculated, and Condescending": How AI Identifies and Explains Ableism Compared to Disabled People4 Oct 2024