Thou shalt not hate: Countering Online Hate Speech
Not on the map. Why?
Abstract (arXiv)
Hate content in social media is ever-increasing. While Facebook, Twitter, Google have attempted to take several steps to tackle the hateful content, they have mostly been unsuccessful. Counterspeech is seen as an effective way of tackling the online hate without any harm to the freedom of speech. Thus, an alternative strategy for these platforms could be to promote counterspeech as a defense against hate content. However, in order to have a successful promotion of such counterspeech, one has to have a deep understanding of its dynamics in the online world. Lack of carefully curated data largely inhibits such understanding. In this paper, we create and release the first ever dataset for counterspeech using comments from YouTube. The data contains 13,924 manually annotated comments where the labels indicate whether a comment is a counterspeech or not. This data allows us to perform a rigorous measurement study characterizing the linguistic structure of counterspeech for the first time. This analysis results in various interesting insights such as: the counterspeech comments receive much more likes as compared to the non-counterspeech comments, for certain communities majority of the non-counterspeech comments tend to be hate speech, the different types of counterspeech are not all equally effective and the language choice of users posting counterspeech is largely different from those posting non-counterspeech as revealed by a detailed psycholinguistic analysis. Finally, we build a set of machine learning models that are able to automatically detect counterspeech in YouTube videos with an F1-score of 0.71. We also build multilabel models that can detect different types of counterspeech in a comment with an F1-score of 0.60.
Key facts. Cited by 64 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 9; 2023: 8; 2024: 19; 2025: 13; 2026: 7.
64 papers.
Sort:
By area:
- 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 216
- 2023Can ChatGPT Reproduce Human-Generated Labels? A Study of Social Computing Taskscited by 88
- 2021Human-in-the-Loop for Data Collection: a Multi-Target Counter Narrative Dataset to Fight Online Hate Speechcited by 81
- 2022Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Surveycited by 80
- 2021On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmarkcited by 73
- 2021Generate, Prune, Select: A Pipeline for Counterspeech Generation against Online Hate Speechcited by 42
- 2022Human-Machine Collaboration Approaches to Build a Dialogue Dataset for Hate Speech Counteringcited by 40
- 2022Hate Speech and Counter Speech Detection: Conversational Context Does Mattercited by 32
- 2022Using Pre-Trained Language Models for Producing Counter Narratives Against Hate Speech: a Comparative Studycited by 30
- 2022CounterGeDi: A controllable approach to generate polite, detoxified and emotional counterspeechcited by 28
- 2024Recent Advances in Hate Speech Moderation: Multimodality and the Role of Large Modelscited by 26
- 2023Beyond Denouncing Hate: Strategies for Countering Implied Biases and Stereotypes in Languagecited by 22
38 more
- 2024NLP for Counterspeech against Hate: A Survey and How-To Guidecited by 21
- 2024NLP Systems That Can't Tell Use from Mention Censor Counterspeech, but Teaching the Distinction Helpscited by 19
- 2023Understanding Counterspeech for Online Harm Mitigationcited by 17
- 2024On Zero-Shot Counterspeech Generation by LLMscited by 17
- 2023DisCGen: A Framework for Discourse-Informed Counterspeech Generationcited by 14
- 2021Empowering NGOs in Countering Online Hate Messagescited by 13
- 2023Counterspeeches up my sleeve! Intent Distribution Learning and Persistent Fusion for Intent-Conditioned Counterspeech Generationcited by 13
- 2021Countering Online Hate Speech: An NLP Perspectivecited by 12
- 2022Explainable Abuse Detection as Intent Classification and Slot Fillingcited by 11
- 2023Hate Cannot Drive out Hate: Forecasting Conversation Incivility following Replies to Hate Speechcited by 10
- 2021Multilingual Counter Narrative Type Classificationcited by 9
- 2022ELF22: A Context-based Counter Trolling Dataset to Combat Internet Trollscited by 7
- 2024Basque and Spanish Counter Narrative Generation: Data Creation and Evaluationcited by 7
- 2021RECAST: Enabling User Recourse and Interpretability of Toxicity Detection Models with Interactive Visualizationcited by 6
- 2024Decoding Hate: Exploring Language Models' Reactions to Hate Speechcited by 6
- 2022Counter Hate Speech in Social Media: A Surveycited by 5
- 2024Low-Resource Counterspeech Generation for Indic Languages: The Case of Bengali and Hindicited by 5
- 2024CrowdCounter: A benchmark type-specific multi-target counterspeech datasetcited by 5
- 2024An Active Learning Framework for Inclusive Generation by Large Language Modelscited by 5
- 2025Echoes of Discord: Forecasting Hater Reactions to Counterspeechcited by 5
- 2024SWE2: SubWord Enriched and Significant Word Emphasized Framework for Hate Speech Detectioncited by 4
- 2025Toxicity Begets Toxicity: Unraveling Conversational Chains in Political Podcastscited by 4
- 2025CSEval: Towards Automated, Multi-Dimensional, and Reference-Free Counterspeech Evaluation using Auto-Calibrated LLMscited by 4
- 2025Distilling Knowledge from Large Language Models: A Concept Bottleneck Model for Hate and Counter Speech Recognitioncited by 4
- 2026PEST: Parameter Efficient Steering of Blackbox VLMs via Agentic Few-shot Alignment for Hateful Meme Moderationcited by 4
- 2022Selecting and combining complementary feature representations and classifiers for hate speech detectioncited by 3
- 2023Toxic language detection: a systematic review of Arabic datasetscited by 3
- 2024Challenging Negative Gender Stereotypes: A Study on the Effectiveness of Automated Counter-Stereotypescited by 3
- 2024Social Support Detection from Social Media Textscited by 3
- 2023Towards Countering Essentialism through Social Bias Reasoningcited by 2
- 2024Hatred Stems from Ignorance! Distillation of the Persuasion Modes in Countering Conversational Hate Speechcited by 2
- 2024LaMSUM: Amplifying Voices Against Harassment through LLM Guided Extractive Summarization of User Incident Reportscited by 2
- 2025Hope vs. Hate: Understanding User Interactions with LGBTQ+ News Content in Mainstream US News Media through the Lens of Hope Speechcited by 2
- 2025Counterspeech the ultimate shield! Multi-Conditioned Counterspeech Generation through Attributed Prefix Learningcited by 2
- 2025Effectiveness of Counter-Speech against Abusive Content: A Multidimensional Annotation and Classification Studycited by 2
- 2025Beating Harmful Stereotypes Through Facts: RAG-based Counter-speech Generationcited by 2
- 2024COT: A Generative Approach for Hate Speech Counter-Narratives via Contrastive Optimal Transportcited by 1
- 2024Exploring the Plausibility of Hate and Counter Speech Detectors with Explainable AIcited by 1
50 most cited of 64 All 64 (JSON)
- 2026Deconstructing Stereotypes: Scope-Conditioned Generation for Effective Multilingual Counterspeech15 Sep 2026
- 2026Counter with Evidence! A Multi-Agent Memory Efficient Reasoning Framework for Hate Category Informed Counterspeech Generation24 Aug 2026
- 2026CATCH-ME if you RAG: a dataset of Contextually Annotated multi-Turn Counterspeech against Hate and Misinformation Exchanges18 Jun 2026
- 2026Assisted Counterspeech Writing at the Crossroads of Hate Speech and Misinformation21 May 2026
- 2026Multilingual Hate Speech Detection and Counterspeech Generation: A Comprehensive Survey and Practical Guide1 Mar 2026
- 2026PEACE 2.0: Grounded Explanations and Counter-Speech for Combating Hate Expressions19 Feb 2026
- 2026PEST: Parameter Efficient Steering of Blackbox VLMs via Agentic Few-shot Alignment for Hateful Meme Moderation8 Jan 2026
- 2025A Comparison of Human and ChatGPT Classification Performance on Complex Social Media Data29 Nov 2025
- 2025Context-Aware Detection and Victim-Centered Response Generation for Online Harassment in Private Messaging28 Nov 2025
- 2025Beating Harmful Stereotypes Through Facts: RAG-based Counter-speech Generation14 Oct 2025
- 2025Counterspeech for Mitigating the Influence of Media Bias: Comparing Human and LLM-Generated Responses20 Aug 2025
- 2025Distilling Knowledge from Large Language Models: A Concept Bottleneck Model for Hate and Counter Speech Recognition30 Jul 2025
38 more
- 2025Dialogues of Dissent: Thematic and Rhetorical Dimensions of Hate and Counter-Hate Speech in Social Media Conversations28 Jul 2025
- 2025HatePRISM: Policies, Platforms, and Research Integration. Advancing NLP for Hate Speech Proactive Mitigation6 Jul 2025
- 2025Effectiveness of Counter-Speech against Abusive Content: A Multidimensional Annotation and Classification Study13 Jun 2025
- 2025Counterspeech the ultimate shield! Multi-Conditioned Counterspeech Generation through Attributed Prefix Learning17 May 2025
- 2025Hope vs. Hate: Understanding User Interactions with LGBTQ+ News Content in Mainstream US News Media through the Lens of Hope Speech13 Feb 2025
- 2025CSEval: Towards Automated, Multi-Dimensional, and Reference-Free Counterspeech Evaluation using Auto-Calibrated LLMs29 Jan 2025
- 2025Echoes of Discord: Forecasting Hater Reactions to Counterspeech27 Jan 2025
- 2025Toxicity Begets Toxicity: Unraveling Conversational Chains in Political Podcasts22 Jan 2025
- 2024Social Support Detection from Social Media Texts4 Nov 2024
- 2024An Active Learning Framework for Inclusive Generation by Large Language Models17 Oct 2024
- 2024Designing Human-AI Collaboration to Support Learning in Counterspeech Writing3 Oct 2024
- 2024CrowdCounter: A benchmark type-specific multi-target counterspeech dataset2 Oct 2024
- 2024Decoding Hate: Exploring Language Models' Reactions to Hate Speech1 Oct 2024
- 2024An Effective, Robust and Fairness-aware Hate Speech Detection Framework25 Sep 2024
- 2024SWE2: SubWord Enriched and Significant Word Emphasized Framework for Hate Speech Detection25 Sep 2024
- 2024Exploring the Plausibility of Hate and Counter Speech Detectors with Explainable AI25 Jul 2024
- 2024Exploring the Capability of ChatGPT to Reproduce Human Labels for Social Computing Tasks (Extended Version)8 Jul 2024
- 2024LaMSUM: Amplifying Voices Against Harassment through LLM Guided Extractive Summarization of User Incident Reports22 Jun 2024
- 2024COT: A Generative Approach for Hate Speech Counter-Narratives via Contrastive Optimal Transport18 Jun 2024
- 2024Challenging Negative Gender Stereotypes: A Study on the Effectiveness of Automated Counter-Stereotypes18 Apr 2024
- 2024NLP Systems That Can't Tell Use from Mention Censor Counterspeech, but Teaching the Distinction Helps2 Apr 2024
- 2024NLP for Counterspeech against Hate: A Survey and How-To Guide29 Mar 2024
- 2024On Zero-Shot Counterspeech Generation by LLMs22 Mar 2024
- 2024Hatred Stems from Ignorance! Distillation of the Persuasion Modes in Countering Conversational Hate Speech18 Mar 2024
- 2024Basque and Spanish Counter Narrative Generation: Data Creation and Evaluation14 Mar 2024
- 2024Low-Resource Counterspeech Generation for Indic Languages: The Case of Bengali and Hindi11 Feb 2024
- 2024Recent Advances in Hate Speech Moderation: Multimodality and the Role of Large Models30 Jan 2024
- 2023Toxic language detection: a systematic review of Arabic datasets12 Dec 2023
- 2023Hate Cannot Drive out Hate: Forecasting Conversation Incivility following Replies to Hate Speech8 Dec 2023
- 2023DisCGen: A Framework for Discourse-Informed Counterspeech Generation29 Nov 2023
- 2023Beyond Denouncing Hate: Strategies for Countering Implied Biases and Stereotypes in Language31 Oct 2023
- 2023Understanding Counterspeech for Online Harm Mitigation1 Jul 2023
- 2023Counterspeeches up my sleeve! Intent Distribution Learning and Persistent Fusion for Intent-Conditioned Counterspeech Generation23 May 2023
- 2023Can ChatGPT Reproduce Human-Generated Labels? A Study of Social Computing Tasks20 Apr 2023
- 2023Towards Countering Essentialism through Social Bias Reasoning28 Mar 2023
- 2022Human-Machine Collaboration Approaches to Build a Dialogue Dataset for Hate Speech Countering7 Nov 2022
- 2022Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey14 Oct 2022
- 2022Explainable Abuse Detection as Intent Classification and Slot Filling6 Oct 2022
50 newest of 64 All 64 (JSON)
- 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 216
- 2023Can ChatGPT Reproduce Human-Generated Labels? A Study of Social Computing Taskscited by 88
- 2021Human-in-the-Loop for Data Collection: a Multi-Target Counter Narrative Dataset to Fight Online Hate Speechcited by 81
- 2022Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Surveycited by 80
- 2021On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmarkcited by 73
- 2021Generate, Prune, Select: A Pipeline for Counterspeech Generation against Online Hate Speechcited by 42
- 2022Human-Machine Collaboration Approaches to Build a Dialogue Dataset for Hate Speech Counteringcited by 40
- 2022Hate Speech and Counter Speech Detection: Conversational Context Does Mattercited by 32
- 2022Using Pre-Trained Language Models for Producing Counter Narratives Against Hate Speech: a Comparative Studycited by 30
- 2022CounterGeDi: A controllable approach to generate polite, detoxified and emotional counterspeechcited by 28
- 2024Recent Advances in Hate Speech Moderation: Multimodality and the Role of Large Modelscited by 26
- 2023Beyond Denouncing Hate: Strategies for Countering Implied Biases and Stereotypes in Languagecited by 22
12 most cited of 63 All 63 (JSON)
- 2026Deconstructing Stereotypes: Scope-Conditioned Generation for Effective Multilingual Counterspeech15 Sep 2026
- 2026Counter with Evidence! A Multi-Agent Memory Efficient Reasoning Framework for Hate Category Informed Counterspeech Generation24 Aug 2026
- 2026CATCH-ME if you RAG: a dataset of Contextually Annotated multi-Turn Counterspeech against Hate and Misinformation Exchanges18 Jun 2026
- 2026Assisted Counterspeech Writing at the Crossroads of Hate Speech and Misinformation21 May 2026
- 2026Multilingual Hate Speech Detection and Counterspeech Generation: A Comprehensive Survey and Practical Guide1 Mar 2026
- 2026PEACE 2.0: Grounded Explanations and Counter-Speech for Combating Hate Expressions19 Feb 2026
- 2026PEST: Parameter Efficient Steering of Blackbox VLMs via Agentic Few-shot Alignment for Hateful Meme Moderation8 Jan 2026
- 2025A Comparison of Human and ChatGPT Classification Performance on Complex Social Media Data29 Nov 2025
- 2025Context-Aware Detection and Victim-Centered Response Generation for Online Harassment in Private Messaging28 Nov 2025
- 2025Counterspeech for Mitigating the Influence of Media Bias: Comparing Human and LLM-Generated Responses20 Aug 2025
- 2025Distilling Knowledge from Large Language Models: A Concept Bottleneck Model for Hate and Counter Speech Recognition30 Jul 2025
- 2025Dialogues of Dissent: Thematic and Rhetorical Dimensions of Hate and Counter-Hate Speech in Social Media Conversations28 Jul 2025
12 newest of 63 All 63 (JSON)