When Is Collective Intelligence a Lottery? Multi-Agent Scaling Laws for Memetic Drift in LLMs
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
Multi-agent systems powered by large language models (LLMs) are increasingly deployed in settings that shape consequential decisions, both directly and indirectly. Yet it remains unclear whether their outcomes reflect collective reasoning, systematic bias, or mere chance. Recent work has sharpened this question with naming games, showing that even when no individual agent favors any label a priori, populations rapidly break symmetry and reach consensus. Here, we reveal the mechanism by introducing a minimal model, Quantized Simplex Gossip (QSG), and trace the microscopic origin of this agreement to mutual in-context learning. In QSG, agents maintain internal belief states but learn from one another's sampled outputs, so one agent's arbitrary choice becomes the next agent's evidence and can compound toward agreement. By analogy with neutral evolution, we call this sampling-driven regime memetic drift. QSG predicts a crossover from a drift-dominated regime, where consensus is effectively a lottery, to a selection regime, where weak biases are amplified and shape the outcome. We derive scaling laws for drift-induced polarization as a function of population size, communication bandwidth, in-context adaptation rate, and agents' internal uncertainty, and we validate them in both QSG simulations and naming-game experiments with LLM populations. Together, these results provide a framework for studying the collective mechanisms of social representation formation in multi-agent systems.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 20 of its 40 references that are in the map. First posted on arXiv 25 Mar 2026.
Builds on
20 of 40 references.
Closest ancestors · 8
Same direction, newest first
- 2025Group size effects and collective misalignment in LLM multi-agent systems25 Oct
- 2025MALLM: Multi-Agent Large Language Models Framework15 Sep
- 2025Voting or Consensus? Decision-Making in Multi-Agent Debate26 Feb
- 2025Simulating Cooperative Prosocial Behavior with Multi-Agent LLMs: Evidence and Mechanisms for AI Agents to Inform Policy Decisions18 Feb
- 2024LAW: Legal Agentic Workflows for Custody and Fund Services Contracts15 Dec
- 2024An Electoral Approach to Diversify LLM-based Multi-Agent Collective Decision-Making19 Oct
- 2023Simulating Opinion Dynamics with Networks of LLM-based Agents16 Nov
- 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View3 Oct
Other references · 12
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2022Transformers learn in-context by gradient descentcited by 732
- 2022What learning algorithm is in-context learning? Investigations with linear modelscited by 684
- 2025Accelerating scientific discovery with Co-Scientistcited by 401
- 2024TradingAgents: Multi-Agents LLM Financial Trading Frameworkcited by 188
- 2024MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Makingcited by 163
- 2024Emergent social conventions and collective bias in LLM populationscited by 123
- 2024Competition Dynamics Shape Algorithmic Phases of In-Context Learningcited by 54
- 2024ICLR: In-Context Learning of Representationscited by 50
- 2025Belief Dynamics Reveal the Dual Nature of In-Context Learning and Activation Steeringcited by 29
- 2025In-Context Learning Strategies Emerge Rationallycited by 16
- 2025Disentangling Interaction and Bias Effects in Opinion Dynamics of Large Language Modelscited by 2
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Physics of Agents: Statistical Mechanics Predicts Collective Behavior of AI Agentscited by 6
- 2026Flag Game: A Toy Model for Mechanistic Swarm Interpretabilitycited by 2
- 2026Candidate supply and answer selection shape the value of LLM judging in multi-agent systemscited by 1
- 2026A latent dimension of Condorcet's jury theorem for multiple AI adviserscited by 0
- 2026Xeno-Interpretability: Investigating the Alien Minds of LLMscited by 0
- 2026Ecology of AI Agents: Collaboration Creates a Population Threshold for Takeoffcited by 0
- 2026Ecology of AI Agents: Collaboration Creates a Population Threshold for Takeoff8 Oct 2026
- 2026Xeno-Interpretability: Investigating the Alien Minds of LLMs17 Sep 2026
- 2026Flag Game: A Toy Model for Mechanistic Swarm Interpretability16 Sep 2026
- 2026A latent dimension of Condorcet's jury theorem for multiple AI advisers13 Sep 2026
- 2026Candidate supply and answer selection shape the value of LLM judging in multi-agent systems26 Aug 2026
- 2026Physics of Agents: Statistical Mechanics Predicts Collective Behavior of AI Agents17 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Microscopic dynamics of consensus formation in multi-agent LLM Naming Games
- 2026Emergence of Biased Consensus in Multi-Agent LLM Debates
- 2026Breaking the Martingale Curse: Multi-Agent Debate via Asymmetric Cognitive Potential Energy
- 2025Systematic Failures in Collective Reasoning under Distributed Information in Multi-Agent LLMs
- 2026Conformity Dynamics in LLM Multi-Agent Systems: The Roles of Topology and Self-Social Weighting
- 2025Emergent Coordination in Multi-Agent Language Models
- 2026LLM Agents Make Collective Belief Dynamics Programmable: Challenges and Research Directions
- 2026Exploring the Topology and Memory of Consensus: How LLM Agents Agree, Fragment, or Settle When Forming Conventions