mlsanityData to 13 Oct 2026

How malicious AI swarms can threaten democracy: The fusion of agentic AI and LLMs marks a new frontier in information warfare

arXiv 2506.06299 ↗First posted 18 May 2025cs.CY cs.AI cs.CLcited by 20

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Advances in AI offer the prospect of manipulating beliefs and behaviors on a population-wide level. Large language models and autonomous agents now let influence campaigns reach unprecedented scale and precision. Generative tools can expand propaganda output without sacrificing credibility and inexpensively create falsehoods that are rated as more human-like than those written by humans. Techniques meant to refine AI reasoning, such as chain-of-thought prompting, can just as effectively be used to generate more convincing falsehoods. Enabled by these capabilities, a disruptive threat is emerging: swarms of collaborative, malicious AI agents. Fusing LLM reasoning with multi-agent architectures, these systems are capable of coordinating autonomously, infiltrating communities, and fabricating consensus efficiently. By adaptively mimicking human social dynamics, they threaten democracy. Because the resulting harms stem from design, commercial incentives, and governance, we prioritize interventions at multiple leverage points, focusing on pragmatic mechanisms over voluntary compliance.

Key facts. Cited by 20 papers in the map (data through 13 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 26 of its 92 references that are in the map. First posted on arXiv 18 May 2025.

Builds on

26 of 92 references.

References · 26

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,376
  2. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,541
  3. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,218
  4. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,777
  5. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,433
  6. 2025s1: Simple test-time scalingcited by 1,322
  7. 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 387
  8. 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 313
  9. 2023S3: Social-network Simulation System with Large Language Model-Empowered Agentscited by 230
  10. 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 185
  11. 2025Multi-Agent Risks from Advanced AIcited by 155
  12. 2024Emergent social conventions and collective bias in LLM populationscited by 118
14 more
  1. 2023The science of fake newscited by 96
  2. 2023Machine Culturecited by 55
  3. 2020Uncovering Coordinated Networks on Social Media: Methods and Case Studiescited by 49
  4. 2023Anatomy of an AI-powered malicious social botnetcited by 36
  5. 2023Engagement, User Satisfaction, and the Amplification of Divisive Content on Social Mediacited by 30
  6. 2024Personhood credentials: Artificial intelligence and the value of privacy-preserving tools to distinguish who is real onlinecited by 16
  7. 2024Characteristics and prevalence of fake social media profiles with AI-generated facescited by 14
  8. 2024Large language models can consistently generate high-quality content for election disinformation operationscited by 14
  9. 2024Evolving AI Collectives to Enhance Human Diversity and Enable Self-Regulationcited by 13
  10. 2022From alternative conceptions of honesty to alternative facts in communications by U.S. politicianscited by 7
  11. 2023Shaping New Norms for AIcited by 7
  12. 2019Quantifying the Vulnerabilities of the Online Public Square to Adversarial Manipulation Tacticscited by 6
  13. 2024How will advanced AI systems impact democracy?cited by 5
  14. 2025Crisis, Country, and Party Lines: Politicians' Misinformation Behavior and Public Engagementcited by 1

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 7; 2026: 13.

20 papers.

Sort:

By area:

  1. 2025Group size effects and collective misalignment in LLM multi-agent systemscited by 16
  2. 2026Shaping capabilities with token-level data filteringcited by 13
  3. 2026Collective Behavior of AI Agents: the Case of Moltbookcited by 12
  4. 2025Emergent Coordinated Behaviors in Networked LLM Agents: Modeling the Strategic Dynamics of Information Operationscited by 6
  5. 2025AI Propaganda factories with language modelscited by 4
  6. 2025Machines in the Crowd? Measuring the Footprint of Machine-Generated Text on Redditcited by 4
  7. 2025Reply to "Emergent LLM behaviors are observationally equivalent to data leakage"cited by 2
  8. 2025The Collective Turing Test: Large Language Models Can Generate Realistic Multi-User Discussionscited by 2
  9. 2026The Language You Ask In: Language-Conditioned Ideological Divergence in LLM Analysis of Contested Political Documentscited by 1
  10. 2026Copying explains the collective behavior of AI agents in the wildcited by 1
  11. 2026Indirect tipping: a social attack surface in AI agent populationscited by 1
  12. 2025Artificially intelligent agents in the social and behavioral sciences: A history and outlookcited by 0
8 more
  1. 2026How Far Will They Go? Red-Teaming Online Influence with Large Language Modelscited by 0
  2. 2026A Model of Multi-turn Human Persuadability Using Probabilistic Belief Tracingcited by 0
  3. 2026Adversarial Creation and Detection of AI-Generated Social Bot Contentcited by 0
  4. 2026Cross-National Information Attacks: A Two-Decade Analysis of Troll Behavior in Koreacited by 0
  5. 2026IO Factory: Simulating AI-Enabled Influence Campaigns at Scalecited by 0
  6. 2026The AI Accountability Ecosystem in the Era of Language Modelscited by 0
  7. 2026Belief Cascades Drive Persuasion in LLM Agent Networkscited by 0
  8. 2026AI agents reshape consensus formation in human groupscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Conformity and Social Impact on AI Agents
  2. 2026A Case Study on Emergent Cheating and Whistleblowing in Autonomous Research Swarms
  3. 2026Large Language Models and Augmented Democracy
  4. 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges
  5. 2026Don't Trust Stubborn Neighbors: A Security Framework for Agentic Networks
  6. 2026LLM Agents Make Collective Belief Dynamics Programmable: Challenges and Research Directions
  7. 2026AI Agents are Vulnerable to Radicalization
  8. 2023The Wisdom of Partisan Crowds: Comparing Collective Intelligence in Humans and LLM-based Agents