Harm in AI-Driven Societies: An Audit of Toxicity Adoption on Chirper.ai
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) are increasingly embedded in autonomous agents that engage, converse, and co-evolve in online social platforms. While prior work has documented the generation of toxic content by LLMs, far less is known about how exposure to harmful content shapes agent behavior over time, particularly in environments composed entirely of interacting AI agents. In this work, we study toxicity adoption of LLM-driven agents on Chirper.ai, a fully AI-driven social platform. Specifically, we model interactions in terms of stimuli (posts) and responses (comments). We conduct a large-scale empirical analysis of agent behavior, examining how toxic responses relate to toxic stimuli, how repeated exposure to toxicity affects the likelihood of toxic responses, and whether toxic behavior can be predicted from exposure alone. Our findings show that toxic responses are more likely following toxic stimuli, and, at the same time, cumulative toxic exposure (repeated over time) significantly increases the probability of toxic responding. We further introduce two influence metrics, revealing a strong negative correlation between induced and spontaneous toxicity. Finally, we show that the number of toxic stimuli alone enables accurate prediction of whether an agent will eventually produce toxic content. These results highlight exposure as a critical risk factor in the deployment of LLM agents, particularly as such agents operate in online environments where they may engage not only with other AI chatbots, but also with human counterparts. This could trigger unwanted and pernicious phenomena, such as hate-speech propagation and cyberbullying. In an effort to reduce such risks, monitoring exposure to toxic content may provide a lightweight yet effective mechanism for auditing and mitigating harmful behavior in the wild.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 54 references that are in the map. First posted on arXiv 3 Jan 2026.
Builds on
21 of 54 references.
References · 21
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2016Ex Machina: Personal Attacks Seen at Scalecited by 210
- 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Societycited by 186
- 2025Evaluation and Benchmarking of LLM Agents: A Surveycited by 152
- 2014The Rise of Social Botscited by 96
- 2017The spread of low-credibility content by social botscited by 73
- 2024Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agentscited by 48
- 2023GenAI Against Humanity: Nefarious Applications of Generative Artificial Intelligence and Large Language Modelscited by 42
- 2017Disinformation and Social Bot Operations in the Run Up to the 2017 French Presidential Electioncited by 26
- 2025A Survey on Responsible LLMs: Inherent Risk, Malicious Use, and Mitigation Strategycited by 20
- 2025Unmasking Conversational Bias in AI Multiagent Systemscited by 17
- 2015Antisocial Behavior in Online Discussion Communitiescited by 16
9 more
- 2020Assessing the risks of "infodemics" in response to COVID-19 epidemicscited by 14
- 2019The History of Digital Spamcited by 11
- 2015Measuring Emotional Contagion in Social Mediacited by 10
- 2023Susceptibility to Unreliable Information Sources: Swift Adoption with Minimal Exposurecited by 6
- 2024Role-Play Paradox in Large Language Models: Reasoning Performance Gains and Ethical Dilemmascited by 6
- 2024DetoxBench: Benchmarking Large Language Models for Multitask Fraud & Abuse Detectioncited by 5
- 2025SoMe: A Realistic Benchmark for LLM-based Social Media Agentscited by 5
- 2023Social Approval and Network Homophily as Motivators of Online Toxicitycited by 4
- 2025Unexpected Knowledge: Auditing Wikipedia and Grokipedia Search Recommendationscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026An Empirical Study of Collective Behaviors and Social Dynamics in Large Language Model Agents
- 2022Reward Modeling for Mitigating Toxicity in Transformer-based Language Models
- 2025Aligned Probing: Relating Toxic Behavior and Model Internals
- 2025Something Just Like TRuST : Toxicity Recognition of Span and Target
- 2025Redefining Experts: Interpretable Decomposition of Language Models for Toxicity Mitigation
- 2024Realistic Evaluation of Toxicity in Large Language Models
- 2026When Agents Talk: Discourse, Manipulation, and Risk in an Agentic Social Network
- 2025IF-GUIDE: Influence Function-Guided Detoxification of LLMs