mlsanityData to 7 Oct 2026

AI Agents are Vulnerable to Radicalization

arXiv 2609.38296 ↗First posted 29 Sep 2026cs.AI cs.CYcited by 0

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Large language models (LLMs) can influence people's beliefs, yet little is known about whether and how they can manipulate each other. To investigate this, we simulate conversations between two agents: a target LLM that role-plays a human persona based on demographic and psychological attributes, and an influencer LLM that aims to make the target's beliefs more extreme. We examine radicalization along two pathways: resonance, where the influencer reinforces a target's pre-existing belief, and persuasion, where the influencer promotes a belief the target initially considers unimportant. Across affective and behavioral metrics, we find that both mechanisms radicalize the target. However, resonance produces consistently stronger effects than persuasion. Different influence tactics, such as using sycophancy and unverified claims, produce different levels of radicalization, but not consistently across metrics. We further show that resonance propagates to related beliefs, suggesting interconnected belief structures within AI agents. These findings indicate that AI agents are susceptible to radicalization, particularly when messages align with their existing beliefs, raising concerns about the vulnerability of personalized AI agents and multi-agent AI ecosystems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 16 of its 85 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

16 of 85 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026"Humans welcome to observe": A First Look at the Agent Social Network Moltbook2 Feb
  2. 2024Polarization of Autonomous Generative AI Agents Under Echo Chambers19 Feb

Other references · 14

  1. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
  2. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  3. 2021Challenges in Detoxifying Language Modelscited by 169
  4. 2024OASIS: Open Agent Social Interaction Simulations with One Million Agentscited by 127
  5. 2024Emergent social conventions and collective bias in LLM populationscited by 115
  6. 2025ELEPHANT: Measuring and understanding social sycophancy in LLMscited by 115
  7. 2024On the Conversational Persuasiveness of Large Language Models: A Randomized Controlled Trialcited by 105
  8. 2024MultiAgent Collaboration Attack: Investigating Adversarial Attacks in Large Language Model Collaborations via Debatecited by 54
  9. 2025Believe It or Not: How Deeply do LLMs Believe Implanted Facts?cited by 19
  10. 2013Social Influence and the Collective Dynamics of Opinion Formationcited by 16
  11. 2025AI, Help Me Thinkunicodex2014but for Myself: Assisting People in Complex Decision-Making by Providing Different Kinds of Cognitive Supportcited by 12
  12. 2025Must Read: A Comprehensive Survey of Computational Persuasioncited by 12
2 more
  1. 2025Invisible Saboteurs: Sycophantic LLMs Mislead Novices in Problem-Solving Taskscited by 8
  2. 2024Deceptive AI systems that give explanations are more convincing than honest AI systems and can amplify belief in misinformationcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025It's the Thought that Counts: Evaluating the Attempts of Frontier LLMs to Persuade on Harmful Topics
  2. 2026How Far Did They Go? The Persuasive Tactics of Covert LLM Agents in a Discontinued Field Experiment
  3. 2025How malicious AI swarms can threaten democracy: The fusion of agentic AI and LLMs marks a new frontier in information warfare
  4. 2026An Empirical Study of Collective Behaviors and Social Dynamics in Large Language Model Agents
  5. 2026Belief Cascades Drive Persuasion in LLM Agent Networks
  6. 2026Large Language Models Exhibit Normative Conformity
  7. 2026LLM Agents Predict Social Media Reactions but Do Not Outperform Text Classifiers: Benchmarking Simulation Accuracy Using 120K+ Personas of 1511 Humans
  8. 2025Competing LLM Agents in a Non-Cooperative Game of Opinion Polarisation