Width, Memory, and Delay: A Resource Accounting for the Limits of Flat Multi-Agent Systems
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
A recurring question in the design of scalable multi-agent systems -- from robot swarms to collectives of large-language-model (LLM) agents -- is whether adding more agents can, on its own, overcome performance limits, or whether a qualitatively deeper organization is required. A recent preprint argues that flat, homogeneous multi-agent systems face an irreducible, population-independent ``causal floor'' on achievable error, removable only by hierarchical (nested-loop) organization. Using a controlled disturbance-rejection testbed with an exactly computable optimum, we show this conclusion is too strong and replace it with a quantitative resource model built on three resources: population width N, per-agent internal-model memory d, and prediction across the observation delay τ. We establish three claims. (i) The achievable floor is governed not by architectural hierarchy but by per-agent internal-model content: a flat, homogeneous swarm whose agents carry a matched internal model of the disturbance matches or beats a designed two-loop hierarchy at equal per-agent memory -- so temporal depth can be dynamical (recurrent memory), not architectural (nesting). (ii) The three resources are not mutually interchangeable; we chart the exchange rates and the hard non-exchange boundaries on an explicit width×memory map, including a strict equal-total-state-budget comparison. (iii) A residual floor is set by the observation delay and the environment's unpredictability over that horizon, which we verify against the optimal controller. We quantify the price of replacing oracle knowledge of the disturbance spectrum with online learning, provide a preliminary robustness check against a mild bounded nonlinearity and a spatially-extended plant, and distill four design rules for practitioners.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 5 of its 25 references that are in the map. First posted on arXiv 14 Jul 2026.
Builds on
5 of 25 references.
Closest ancestors · 2
Same direction, newest first
- 2026Single-Agent LLMs Outperform Multi-Agent Systems on Multi-Hop Reasoning Under Equal Thinking Token Budgets2 Apr
- 2024Scaling Large Language Model-based Multi-Agent Collaboration11 Jun
Other references · 3
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 573
- 2017Evolution Strategies as a Scalable Alternative to Reinforcement Learningcited by 562
- 2026Rethinking the Value of Multi-Agent Workflow: A Strong Single Agent Baselinecited by 21
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Scaling LLM-Driven Multi-Agent Systems: Design Principles and Architectural Scalability Analysis
- 2026Understanding Agent Scaling in LLM-Based Multi-Agent Systems via Diversity
- 2025Towards a Science of Scaling Agent Systems
- 2026Multi-Agent Memory from a Computer Architecture Perspective: Visions and Challenges Ahead
- 2026Scaling Behavior of Single LLM-Driven Multi-Agent Systems
- 2025Benchmarking LLMs' Swarm intelligence
- 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systems
- 2026StackPlanner: A Centralized Hierarchical Multi-Agent System with Task-Experience Memory Management