mlsanityData to 7 Oct 2026

Drop the Hierarchy and Roles: How Self-Organizing LLM Agents Outperform Designed Structures

arXiv 2603.28990 ↗First posted 30 Mar 2026cs.AIcited by 3

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

How much autonomy can multi-agent LLM systems sustain -- and what enables it? We present a 25,000-task computational experiment spanning 8 models, 4--256 agents, and 8 coordination protocols ranging from externally imposed hierarchy to emergent self-organization. We observe that autonomous behavior already emerges in current LLM agents: given minimal structural scaffolding (fixed ordering), agents spontaneously invent specialized roles, voluntarily abstain from tasks outside their competence, and form shallow hierarchies -- without any pre-assigned roles or external design. A hybrid protocol (Sequential) that enables this autonomy outperforms centralized coordination by 14% (p<0.001), with a 44% quality spread between protocols (Cohen's d=1.86, p<0.0001). The degree of emergent autonomy scales with model capability: strong models self-organize effectively, while models below a capability threshold still benefit from rigid structure -- suggesting that as foundation models improve, the scope for autonomous coordination will expand. The system scales sub-linearly to 256 agents without quality degradation (p=0.61), producing 5,006 unique roles from just 8 agents. Results replicate across closed- and open-source models, with open-source achieving 95% of closed-source quality at 24x lower cost. The practical implication: give agents a mission, a protocol, and a capable model -- not a pre-assigned role.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 9 of its 23 references that are in the map. First posted on arXiv 30 Mar 2026.

Builds on

9 of 23 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024Scaling Large Language Model-based Multi-Agent Collaboration11 Jun
  2. 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
  3. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges21 Jan
  4. 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep
  5. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
  6. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
  7. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents5 Jun

Other references · 2

  1. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  2. 2023ChatDev: Communicative Agents for Software Developmentcited by 893

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems
  2. 2026Architectural Design, Not Only Model Intelligence, Governs Multi-Agent LLM Performance
  3. 2026Scaling LLM-Driven Multi-Agent Systems: Design Principles and Architectural Scalability Analysis
  4. 2025What Do LLM Agents Do When Left Alone? Evidence of Spontaneous Meta-Cognitive Patterns
  5. 2026Scaling Behavior of Single LLM-Driven Multi-Agent Systems
  6. 2025Building LLM Agents by Incorporating Insights from Computer Systems
  7. 2026Multi-Agent Teams Hold Experts Back
  8. 2025Emergent Coordination in Multi-Agent Language Models