Population Physics, Population Problems: Safety and Emergence in LLM Societies
Not on the map. Why?
Abstract (arXiv)
The collective behaviour of large language model (LLM) societies is not the sum of their individual outputs. It yields statistically distinct, sometimes-unpredictable phenomena, for which the tools we use to study single agents may not scale. Due to recent incidents involving autonomous agentic systems, however, understanding these systems is paramount. For that we introduce a framework for measuring self-organisation in LLM social systems and apply it to three such systems: a Schelling grid, a social network (Moltbook), and a Twitter-like misinformation simulation ('Rogue'). All three exhibit statistically significant self-organisation. Moreover, their relaxation dynamics vary with the environmental information available to the agents, with open-ended systems (Moltbook, Rogue) exhibiting sharp, phase-transition-like dynamics. Further results show that population-level pathologies can emerge even when the LLMs are safety-tuned or monitored, being primarily driven by the coordinated activity of a population subset. We also show when self-organisation does textitnot emerge under two additional scenarios (a commons dilemma, GovSim, and a LLM-as-a-judge deliberation scheme, ChatEval). We argue that measuring signatures of this kind offers a lightweight, agent-agnostic diagnostic layer for detecting coordinated collective behaviour in deployed multi-agent systems without relying on natural language or model versioning.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 30 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
18 of 30 references.
References · 18
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
- 2023Are Emergent Abilities of Large Language Models a Mirage?cited by 515
- 2024RewardBench: Evaluating Reward Models for Language Modelingcited by 480
- 2023AI Control: Improving Safety Despite Intentional Subversioncited by 207
- 2024Cooperate or Collapse: Emergence of Sustainable Cooperation in a Society of LLM Agentscited by 120
- 2024Secret Collusion among AI Agents: Multi-Agent Deception via Steganographycited by 107
- 2023Cooperation, Competition, and Maliciousness: LLM-Stakeholders Interactive Negotiationcited by 94
- 2014Epidemic processes in complex networkscited by 57
- 2024Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agentscited by 48
6 more
- 2025When Autonomy Goes Rogue: Preparing for Risks of Multi-Agent Collusion in Social Systemscited by 9
- 2025Large Language Models and Emergence: A Complex Systems Perspectivecited by 7
- 2025The Subtle Art of Defection: Understanding Uncooperative Behaviors in LLM based Multi-Agent Systemscited by 3
- 2026What Do AI Agents Talk About? Discourse and Architectural Constraints in the First AI-Only Social Networkcited by 3
- 2026If LLMs Have Human-Like Attributes, Then So Does Age of Empires IIcited by 2
- 2026Form Without Function: Agent Social Behavior in the Moltbook Networkcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Group size effects and collective misalignment in LLM multi-agent systems
- 2025Will Systems of LLM Agents Cooperate: An Investigation into a Social Dilemma
- 2026Poor Man's Agentic Modeling: Simulating Large LLM-Agent Societies on a Laptop
- 2026Collective cooperation without individual fidelity in LLM agents
- 2024Large Language Models can Achieve Social Balance
- 2024Network Formation and Dynamics Among Multi-LLMs
- 2025Emergence of polarization in networks of large language model agents
- 2026Predicting the scale limits of social mechanisms in agent societies