Drop the Hierarchy and Roles: How Self-Organizing LLM Agents Outperform Designed Structures
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
How much autonomy can multi-agent LLM systems sustain -- and what enables it? We present a 25,000-task computational experiment spanning 8 models, 4--256 agents, and 8 coordination protocols ranging from externally imposed hierarchy to emergent self-organization. We observe that autonomous behavior already emerges in current LLM agents: given minimal structural scaffolding (fixed ordering), agents spontaneously invent specialized roles, voluntarily abstain from tasks outside their competence, and form shallow hierarchies -- without any pre-assigned roles or external design. A hybrid protocol (Sequential) that enables this autonomy outperforms centralized coordination by 14% (p<0.001), with a 44% quality spread between protocols (Cohen's d=1.86, p<0.0001). The degree of emergent autonomy scales with model capability: strong models self-organize effectively, while models below a capability threshold still benefit from rigid structure -- suggesting that as foundation models improve, the scope for autonomous coordination will expand. The system scales sub-linearly to 256 agents without quality degradation (p=0.61), producing 5,006 unique roles from just 8 agents. Results replicate across closed- and open-source models, with open-source achieving 95% of closed-source quality at 24x lower cost. The practical implication: give agents a mission, a protocol, and a capable model -- not a pre-assigned role.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 9 of its 23 references that are in the map. First posted on arXiv 30 Mar 2026.
Builds on
9 of 23 references.
Closest ancestors · 7
Same direction, newest first
- 2024Scaling Large Language Model-based Multi-Agent Collaboration11 Jun
- 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges21 Jan
- 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
- 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents5 Jun
Other references · 2
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems
- 2026Architectural Design, Not Only Model Intelligence, Governs Multi-Agent LLM Performance
- 2026Scaling LLM-Driven Multi-Agent Systems: Design Principles and Architectural Scalability Analysis
- 2025What Do LLM Agents Do When Left Alone? Evidence of Spontaneous Meta-Cognitive Patterns
- 2026Scaling Behavior of Single LLM-Driven Multi-Agent Systems
- 2025Building LLM Agents by Incorporating Insights from Computer Systems
- 2026Multi-Agent Teams Hold Experts Back
- 2025Emergent Coordination in Multi-Agent Language Models