mlsanityData to 14 Oct 2026

Human-Machine Collaboration Approaches to Build a Dialogue Dataset for Hate Speech Countering

arXiv 2211.03433 ↗First posted 7 Nov 2022cs.CL cs.CYcited by 40

Not on the map. Why?

Abstract (arXiv)

Fighting online hate speech is a challenge that is usually addressed using Natural Language Processing via automatic detection and removal of hate content. Besides this approach, counter narratives have emerged as an effective tool employed by NGOs to respond to online hate on social media platforms. For this reason, Natural Language Generation is currently being studied as a way to automatize counter narrative writing. However, the existing resources necessary to train NLG models are limited to 2-turn interactions (a hate speech and a counter narrative as response), while in real life, interactions can consist of multiple turns. In this paper, we present a hybrid approach for dialogical data collection, which combines the intervention of human expert annotators over machine generated dialogues obtained using 19 different configurations. The result of this work is DIALOCONAN, the first dataset comprising over 3000 fictitious multi-turn dialogues between a hater and an NGO operator, covering 6 targets of hate.

Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). Builds on 27 of its 54 references that are in the map. First posted on arXiv 7 Nov 2022.

Builds on

27 of 54 references.

References · 27

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  3. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  4. 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 407
  5. 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 221
  6. 2019Racial Bias in Hate Speech and Abusive Language Detection Datasetscited by 209
  7. 2020Reformulating Unsupervised Style Transfer as Paraphrase Generationcited by 183
  8. 2019Build it Break it Fix it for Dialogue Safety: Robustness from Adversarial Human Attackcited by 176
  9. 2020Directions in Abusive Language Training Data: Garbage In, Garbage Outcited by 140
  10. 2019A Benchmark Dataset for Learning to Intervene in Online Hate Speechcited by 129
  11. 2019CONAN -- COunter NArratives through Nichesourcing: a Multilingual Dataset of Responses to Fight Online Hate Speechcited by 110
  12. 2021Human-in-the-Loop for Data Collection: a Multi-Target Counter Narrative Dataset to Fight Online Hate Speechcited by 82
15 more
  1. 2018Thou shalt not hate: Countering Online Hate Speechcited by 64
  2. 2020Demoting Racial Bias in Hate Speech Detectioncited by 62
  3. 2020Generating Counter Narratives against Online Hate Speech: Data and Strategiescited by 59
  4. 2020Confronting Abusive Language Online: A Survey from the Ethical and Human Rights Perspectivecited by 43
  5. 2021Generate, Prune, Select: A Pipeline for Counterspeech Generation against Online Hate Speechcited by 42
  6. 2021Towards Knowledge-Grounded Counter Narrative Generation for Hate Speechcited by 42
  7. 2017Like trainer, like bot? Inheritance of bias in algorithmic content moderationcited by 35
  8. 2022Hate Speech and Counter Speech Detection: Conversational Context Does Mattercited by 32
  9. 2022Using Pre-Trained Language Models for Producing Counter Narratives Against Hate Speech: a Comparative Studycited by 30
  10. 2021DeepHate: Hate Speech Detection via Multi-Faceted Text Representationscited by 29
  11. 2018Augmenting Neural Response Generation with Context-Aware Topical Attentioncited by 27
  12. 2018Analyzing the hate and counter speech accounts on Twittercited by 21
  13. 2021ProtAugment: Unsupervised diverse short-texts paraphrasing for intent detection meta-learningcited by 18
  14. 2021Empowering NGOs in Countering Online Hate Messagescited by 13
  15. 2015Detection of Cyberbullying Incidents on the Instagram Social Networkcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 10; 2024: 14; 2025: 10; 2026: 6.

40 papers.

Sort:

By area:

  1. 2024Navigating the OverKill in Large Language Modelscited by 44
  2. 2023Using In-Context Learning to Improve Dialogue Safetycited by 42
  3. 2023Beyond Denouncing Hate: Strategies for Countering Implied Biases and Stereotypes in Languagecited by 24
  4. 2024NLP for Counterspeech against Hate: A Survey and How-To Guidecited by 22
  5. 2024NLP Systems That Can't Tell Use from Mention Censor Counterspeech, but Teaching the Distinction Helpscited by 20
  6. 2024Position: Towards Bidirectional Human-AI Alignmentcited by 18
  7. 2023Understanding Counterspeech for Online Harm Mitigationcited by 17
  8. 2023DisCGen: A Framework for Discourse-Informed Counterspeech Generationcited by 14
  9. 2023CoSyn: Detecting Implicit Hate Speech in Online Conversations Using a Context Synergized Hyperbolic Networkcited by 12
  10. 2024Outcome-Constrained Large Language Models for Countering Hate Speechcited by 12
  11. 2024Is Safer Better? The Impact of Guardrails on the Argumentative Strength of LLMs in Hate Speech Counteringcited by 11
  12. 2023Weigh Your Own Words: Improving Hate Speech Counter Narrative Generation via Attention Regularizationcited by 7
28 more
  1. 2023Response Generation in Longitudinal Dialogues: Which Knowledge Representation Helps?cited by 6
  2. 2024A Multi-Aspect Framework for Counter Narrative Evaluation using Large Language Modelscited by 6
  3. 2024A LLM-Based Ranking Method for the Evaluation of Automatic Counter-Narrative Generationcited by 6
  4. 2024Decoding Hate: Exploring Language Models' Reactions to Hate Speechcited by 6
  5. 2023Does Collaborative Human-LM Dialogue Generation Help Information Extraction from Human Dialogues?cited by 5
  6. 2025Echoes of Discord: Forecasting Hater Reactions to Counterspeechcited by 5
  7. 2025CSEval: Towards Automated, Multi-Dimensional, and Reference-Free Counterspeech Evaluation using Auto-Calibrated LLMscited by 4
  8. 2024Consolidating Strategies for Countering Hate Speech Using Persuasive Dialoguescited by 2
  9. 2024Hatred Stems from Ignorance! Distillation of the Persuasion Modes in Countering Conversational Hate Speechcited by 2
  10. 2025Debunking with Dialogue? Exploring AI-Generated Counterspeech to Challenge Conspiracy Theoriescited by 2
  11. 2025Counterspeech the ultimate shield! Multi-Conditioned Counterspeech Generation through Attributed Prefix Learningcited by 2
  12. 2025Beating Harmful Stereotypes Through Facts: RAG-based Counter-speech Generationcited by 2
  13. 2026METRO: Towards Strategy Induction from Expert Dialogue Transcripts for Non-collaborative Dialoguescited by 2
  14. 2024Alternative Speech: Complementary Method to Counter-Narrative for Better Discoursecited by 1
  15. 2024Causal Inference for Human-Language Model Collaborationcited by 1
  16. 2025Think Like a Person Before Responding: A Multi-Faceted Evaluation of Persona-Guided LLMs for Countering Hatecited by 1
  17. 2025EMBRACE: Shaping Inclusive Opinion Representation by Aligning Implicit Conversations with Social Normscited by 1
  18. 2023Hate Speech Targets Detection in Parler using BERTcited by 0
  19. 2023Let the Models Respond: Interpreting Language Model Detoxification Through the Lens of Prompt Dependencecited by 0
  20. 2024Revealing Trends in Datasets from the 2022 ACL and EMNLP Conferencescited by 0
  21. 2025Policy Learning with a Natural Language Action Space: A Causal Approachcited by 0
  22. 2025Can NLP Tackle Hate Speech in the Real World? Stakeholder-Informed Feedback and Survey on Counterspeechcited by 0
  23. 2025SPOT: An Annotated French Corpus and Benchmark for Detecting Critical Interventions in Online Conversationscited by 0
  24. 2026FC-CONAN: An Exhaustively Paired Dataset for Robust Evaluation of Retrieval Systemscited by 0
  25. 2026LLMberjack: Guided Trimming of Debate Trees for Multi-Party Conversation Creationcited by 0
  26. 2026CATCH-ME if you RAG: a dataset of Contextually Annotated multi-Turn Counterspeech against Hate and Misinformation Exchangescited by 0
  27. 2026From Specialization to Generalization: Instruction-tuned LLMs for Robust Harmful Content Mitigationcited by 0
  28. 2026Deconstructing Stereotypes: Scope-Conditioned Generation for Effective Multilingual Counterspeechcited by 0