mlsanityData to 7 Oct 2026

Contextualized Counterspeech Can Be More Persuasive Than Generic Counterspeech

arXiv 2607.26236 ↗First posted 28 Jul 2026cs.HC cs.AI cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

AI-generated counterspeech offers a scalable and effective strategy to mitigate online toxicity by promoting more constructive dialogue. Yet, existing approaches adopt a generic, one-size-fits-all paradigm, overlooking the conversational context and characteristics of the targeted users. Here, we propose and evaluate multiple strategies for generating contextualized counterspeech that is adapted to the moderation setting and personalized to the moderated user. In detail, we explore a range of configurations that integrate different forms of contextual information and fine-tuning techniques. We conduct a comprehensive evaluation combining quantitative indicators with a pre-registered, mixed-design crowdsourcing experiment. To ensure robustness, we implement algorithmic measures of counterspeech quality based on ROUGE, BLEU, and BERTScore, observing overall consistent results across metrics. Furthermore, we analyze which characteristics of both the generated counterspeech and the moderated toxic message most strongly influence perceived persuasiveness, yielding insights into how contextualized interventions can be made more effective. Our findings show that personalization can be effective, but not uniformly so. Lightweight strategies combining conversational context and user history improve perceived adequacy and persuasiveness, whereas several other contextualization strategies degrade human-perceived counterspeech quality. Taken together, these results provide actionable directions for developing more personalized, effective, and responsible counterspeech systems, ultimately advancing human-AI collaboration in online content moderation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 48 of its 79 references that are in the map. First posted on arXiv 28 Jul 2026.

Builds on

48 of 79 references.

References · 48

  1. 2020The Pushshift Reddit Datasetcited by 289
  2. 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traitscited by 229
  3. 2022A New Generation of Perspective API: Efficient Multilingual Character-level Transformerscited by 181
  4. 2019A Benchmark Dataset for Learning to Intervene in Online Hate Speechcited by 128
  5. 2022Pretrained Language Models for Text Generation: A Surveycited by 121
  6. 2024On the Conversational Persuasiveness of Large Language Models: A Randomized Controlled Trialcited by 105
  7. 2021Human-in-the-Loop for Data Collection: a Multi-Target Counter Narrative Dataset to Fight Online Hate Speechcited by 81
  8. 2023Sensitivity, Performance, Robustness: Deconstructing the Effect of Sociodemographic Promptingcited by 80
  9. 2024Hidden Persuaders: LLMs' Political Leaning and Their Influence on Voterscited by 71
  10. 2020Generating Counter Narratives against Online Hate Speech: Data and Strategiescited by 58
  11. 2021Towards Knowledge-Grounded Counter Narrative Generation for Hate Speechcited by 41
  12. 2023Reinforcement Learning-based Counter-Misinformation Response Generation: A Case Study of COVID-19 Vaccine Misinformationcited by 39
36 more
  1. 2024Measuring and Benchmarking Large Language Models' Capabilities to Generate Persuasive Languagecited by 31
  2. 2024Human and LLM Biases in Hate Speech Annotations: A Socio-Demographic Analysis of Annotators and Targetscited by 31
  3. 2022Using Pre-Trained Language Models for Producing Counter Narratives Against Hate Speech: a Comparative Studycited by 30
  4. 2022CounterGeDi: A controllable approach to generate polite, detoxified and emotional counterspeechcited by 28
  5. 2025Persuade Me if You Can: A Framework for Evaluating Persuasion Effectiveness and Susceptibility Among Large Language Modelscited by 25
  6. 2024NLP for Counterspeech against Hate: A Survey and How-To Guidecited by 21
  7. 2024Evaluation of LLM Vulnerabilities to Being Misused for Personalized Disinformation Generationcited by 20
  8. 2023Understanding Counterspeech for Online Harm Mitigationcited by 17
  9. 2020Quarantined! Examining the Effects of a Community-Wide Moderation Intervention on Redditcited by 16
  10. 2024Contextualized Counterspeech: Strategies for Adaptation, Personalization, and Evaluationcited by 15
  11. 2023DisCGen: A Framework for Discourse-Informed Counterspeech Generationcited by 14
  12. 2024Zero-shot Persuasive Chatbots with LLM-Generated Strategies and Information Retrievalcited by 14
  13. 2022Make Reddit Great Again: Assessing Community Effects of Moderation Interventions on r/The_Donaldcited by 13
  14. 2023ReZG: Retrieval-Augmented Zero-Shot Counter Narrative Generation for Hate Speechcited by 12
  15. 2023Can Language Model Moderators Improve the Health of Online Discourse?cited by 12
  16. 2024Outcome-Constrained Large Language Models for Countering Hate Speechcited by 12
  17. 2020Impact and dynamics of hate and counter speech onlinecited by 11
  18. 2023Hate Cannot Drive out Hate: Forecasting Conversation Incivility following Replies to Hate Speechcited by 10
  19. 2023The DSA Transparency Database: Auditing Self-reported Moderation Actions by Social Mediacited by 10
  20. 2025Persuasion at Play: Understanding Misinformation Dynamics in Demographic-Aware Human-LLM Interactionscited by 10
  21. 2024A LLM-Based Ranking Method for the Evaluation of Automatic Counter-Narrative Generationcited by 6
  22. 2024Assessing the Human Likeness of AI-Generated Counterspeechcited by 5
  23. 2025A Year of the DSA Transparency Database: What it (Does Not) Reveal About Platform Moderation During the 2024 European Parliament Electioncited by 5
  24. 2022One of Many: Assessing User-level Effects of Moderation Interventions on r/The_Donaldcited by 4
  25. 2024Beyond Trial-and-Error: Predicting User Abandonment After a Moderation Interventioncited by 4
  26. 2024Generative AI may backfire for counterspeechcited by 4
  27. 2025CSEval: Towards Automated, Multi-Dimensional, and Reference-Free Counterspeech Evaluation using Auto-Calibrated LLMscited by 4
  28. 2023Content Moderation and the Formation of Online Communities: A Theoretical Frameworkcited by 3
  29. 2024Investigating the heterogenous effects of a massive content moderation intervention via Difference-in-Differencescited by 3
  30. 2025Multi-Agent Retrieval-Augmented Framework for Evidence-Based Counterspeech Against Health Misinformationcited by 3
  31. 2024Assessing How Hate, Counterspeech, and Toxicity Affect Hate Group Newcomerscited by 2
  32. 2025Counterspeech the ultimate shield! Multi-Conditioned Counterspeech Generation through Attributed Prefix Learningcited by 2
  33. 2025Dark Personality Traits and Online Toxicity: Linking Self-Reports to Reddit Activitycited by 2
  34. 2026A Geometric Analysis of Small-sized Language Model Hallucinationscited by 2
  35. 2025Think Like a Person Before Responding: A Multi-Faceted Evaluation of Persona-Guided LLMs for Countering Hatecited by 1
  36. 2026The Big Ban Theory: A Pre- and Post-Intervention Dataset of Online Content Moderation Actionscited by 1

Built on by

Not cited yet.