The Ringelmann Effect in Multi-Agent LLM Systems: A Scaling Law for Effective Team Size
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Inference-time multi-agent LLM scaling lacks a shared unit: counting nominal agents conflates cost with independent evidence. We derive a two-parameter scaling law R(N) = Neff/N = 1/(1+c(N-1)N-β) where the regime exponent β classifies any configuration into one of three asymptotic regimes -- hard-ceiling at 1/c (β = 0), sublinear at Nβ/c (0 < β < 1), or linear (β ≥ 1), and a mean-field theorem predicts that peer count k and rounds τ during agent debate enter the dynamics only through their product kτ. The law applies at two levels: answer diversity and correctness redundancy. Across 44 (model × task × condition) cells spanning peer debate, self-correction, random-noise placebo, self-consistency, three open-weight families (Qwen, Llama, Ministral) at scales from 7B to 32B with a frontier API check (Gemini), thinking models, heterogeneous teams, and sparse communication, the functional form fits every condition at R2 > 0.99; only (c, β) shifts. On free-form math, dense peer influence collapses the answer-level regime from sublinear into hard-ceiling; correctness-level fits remain hard-ceiling throughout. Three findings have practical implications. (i)~Thirty dense debating agents produce no more answer diversity than one on MMLU-Hard. (ii)~A noise placebo tracks self-correction on free-form math and at 4× scale, so within homogeneous teams the gain commonly attributed to ``debate'' comes from re-evaluation, not peer content. (iii)~A single N ≤ 5 pilot predicts the N=30 structural ceiling, and within the configurations tested only architectural diversity (heterogeneous teams) lowers c and escapes the hard-ceiling regime, communication-mode interventions do not.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 32 of its 50 references that are in the map. First posted on arXiv 31 May 2026.
Builds on
32 of 50 references.
Closest ancestors · 7
Same direction, newest first
- 2026Understanding Agent Scaling in LLM-Based Multi-Agent Systems via Diversity3 Feb
- 2025Towards a Science of Scaling Agent Systems9 Dec
- 2024Scaling Large Language Model-based Multi-Agent Collaboration11 Jun
- 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
- 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?28 Feb
- 2024More Agents Is All You Need3 Feb
- 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate14 Aug
Other references · 25
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
13 more
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2018AI safety via debatecited by 384
- 2024Debating with More Persuasive LLMs Leads to More Truthful Answerscited by 255
- 2023Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMscited by 103
- 2025Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models?cited by 74
- 2025Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debatecited by 63
- 2025Voting or Consensus? Decision-Making in Multi-Agent Debatecited by 55
- 2024Conformity in Large Language Modelscited by 30
- 2025Peacemaker or Troublemaker: How Sycophancy Shapes Multi-Agent Debatecited by 29
- 2025Can LLM Agents Really Debate? A Controlled Study of Multi-Agent Debate in Logical Reasoningcited by 27
- 2025When Identity Skews Debate: Anonymization for Bias-Reduced Multi-Agent Reasoningcited by 20
- 2026Conformity and Social Impact on AI Agentscited by 11
- 2026Consensus is Not Verification: Why Crowd Wisdom Strategies Fail for LLM Truthfulnesscited by 8
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Scaling Behavior of Single LLM-Driven Multi-Agent Systems
- 2025Group size effects and collective misalignment in LLM multi-agent systems
- 2026When Agents Disagree: The Selection Bottleneck in Multi-Agent LLM Pipelines
- 2026Prompted Identity Degrades Cooperation in Multi-Agent LLM Systems
- 2026Emergence of Biased Consensus in Multi-Agent LLM Debates
- 2026Representational Collapse in Multi-Agent LLM Committees: Measurement and Diversity-Aware Consensus
- 2026Towards a Science of Collective AI: LLM-based Multi-Agent Systems Need a Transition from Blind Trial-and-Error to Rigorous Science
- 2026Attributing Emergence in Million-Agent Systems