mlsanityData to 13 Oct 2026

Evaluating Online Moderation Via LLM-Powered Counterfactual Simulations

arXiv 2511.07204 ↗First posted 10 Nov 2025cs.AI cs.CY cs.MAcited by 0

Not on the map. Why?

Abstract (arXiv)

Online Social Networks (OSNs) widely adopt content moderation to mitigate the spread of abusive and toxic discourse. Nonetheless, the real effectiveness of moderation interventions remains unclear due to the high cost of data collection and limited experimental control. The latest developments in Natural Language Processing pave the way for a new evaluation approach. Large Language Models (LLMs) can be successfully leveraged to enhance Agent-Based Modeling and simulate human-like social behavior with unprecedented degree of believability. Yet, existing tools do not support simulation-based evaluation of moderation strategies. We fill this gap by designing a LLM-powered simulator of OSN conversations enabling a parallel, counterfactual simulation where toxic behavior is influenced by moderation interventions, keeping all else equal. We conduct extensive experiments, unveiling the psychological realism of OSN agents, the emergence of social contagion phenomena and the superior effectiveness of personalized moderation strategies.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 27 of its 58 references that are in the map. First posted on arXiv 10 Nov 2025.

Builds on

27 of 58 references.

References · 27

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
  2. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,218
  3. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,433
  4. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 664
  5. 2023Character-LLM: A Trainable Agent for Role-Playingcited by 336
  6. 2022Social Simulacra: Creating Populated Prototypes for Social Computing Systemscited by 301
  7. 2024Self-Preference Bias in LLM-as-a-Judgecited by 253
  8. 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traitscited by 231
  9. 2023S3: Social-network Simulation System with Large Language Model-Empowered Agentscited by 230
  10. 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 208
  11. 2022A New Generation of Perspective API: Efficient Multilingual Character-level Transformerscited by 185
  12. 2023SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scalingcited by 172
15 more
  1. 2023Simulating Opinion Dynamics with Networks of LLM-based Agentscited by 154
  2. 2023User Behavior Simulation with Large Language Model based Agentscited by 138
  3. 2024Cooperate or Collapse: Emergence of Sustainable Cooperation in a Society of LLM Agentscited by 122
  4. 2024Cognitive Bias in Decision-Making with LLMscited by 105
  5. 2024Unveiling the Truth and Facilitating Change: Towards Agent-based Large-scale Social Movement Simulationcited by 70
  6. 2023Simulating Social Media Using Large Language Models to Evaluate Alternative News Feed Algorithmscited by 64
  7. 2023Do LLM Agents Exhibit Social Behavior?cited by 53
  8. 2023Lyfe Agents: Generative agents for low-cost real-time social interactionscited by 49
  9. 2024Y Social: an LLM-powered Social Media Digital Twincited by 43
  10. 2020PANDORA Talks: Personality and Demographics on Redditcited by 40
  11. 2024Do LLMs "know" internally when they follow instructions?cited by 26
  12. 2020Affective Polarization in Online Climate Change Discourse on Twittercited by 8
  13. 2017An agent-based model for emotion contagion and competition in online social mediacited by 2
  14. 2020Modelling Human Mobility considering Spatial,Temporal and Social Dimensionscited by 2
  15. 2024The Toxicity Phenomenon Across Social Mediacited by 1

Built on by

Not cited yet.