Coordination as an Architectural Layer for LLM-Based Multi-Agent Systems
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Multi-agent LLM systems fail in production at rates between 41% and 87%, mostly due to coordination defects rather than base-model capability. Existing responses split between cataloguing failure modes empirically and shipping declarative orchestration frameworks as engineering tools; neither delivers a principled mapping from coordination configuration to predictable failure-mode signature. We argue that coordination should be treated as a configurable architectural layer, separable from agent logic and from information access, enabling architectural reasoning rather than only engineering productivity. We instantiate this with an information-controlled design on prediction markets: a single LLM, fixed tools, fixed per-call output cap, and fixed prompt template across five reference coordination configurations, with total compute per question treated as an endogenous architectural output. The Murphy decomposition of the Brier score separates calibration from discriminative power, so configurations leave distinguishable signatures even when aggregate scores coincide. On 100 Polymarket binary markets resolved after the model's training cutoff (claude-opus-4-6) we report Murphy signatures, a cost-quality Pareto frontier, category-conditioned analysis, and a bootstrap power-projection. Three of five pre-specified predictions are upheld in direction; two configurations dominate the Pareto frontier within this regime; exploratory bootstrap intervals separate consensus alignment from others, though pairwise tests do not survive Bonferroni correction at n=100. We also deploy the same configurations as live agents on Foresight Arena under web-search-enabled conditions, as an on-chain replication channel accumulating in parallel. Harness, trace dataset, and production agents are released. We position this as a methodology-validating first instantiation, not a general cross-model claim.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 14 of its 35 references that are in the map. First posted on arXiv 5 May 2026.
Builds on
14 of 35 references.
Closest ancestors · 3
Same direction, newest first
- 2026On the Reliability Limits of LLM-Based Multi-Agent Planning27 Mar
- 2026Semantic Consensus: Process-Aware Conflict Detection and Resolution for Enterprise Multi-Agent LLM Systems13 Mar
- 2023LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language Models5 Oct
Other references · 11
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2018Datasheets for Datasetscited by 1,386
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 604
- 2024ForecastBench: A Dynamic Benchmark of AI Forecasting Capabilitiescited by 110
- 2024Approaching Human-Level Forecasting with Language Modelscited by 107
- 2024Wisdom of the Silicon Crowd: LLM Ensemble Prediction Capabilities Rival Human Crowd Accuracycited by 67
- 2025Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debatecited by 66
- 2026Rethinking the Value of Multi-Agent Workflow: A Strong Single Agent Baselinecited by 22
- 2026Prediction Arena: Benchmarking AI Models on Real-World Prediction Marketscited by 10
- 2026Foresight Arena: An On-Chain Benchmark for Evaluating AI Forecasting Agentscited by 4
- 2025A Declarative Language for Building And Orchestrating LLM-Powered Agent Workflowscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025From Competition to Coordination: Market Making as a Scalable Framework for Safe and Aligned Multi-Agent LLM Systems
- 2026Architectural Design, Not Only Model Intelligence, Governs Multi-Agent LLM Performance
- 2026Organizational Control Layer: Governance Infrastructure at the Execution Boundary of LLM Agent Systems
- 2026Provable Coordination for LLM Agents via Message Sequence Charts
- 2026Markets, Not Planners: Decentralized Orchestration of LLM Agents with Private Information
- 2025Know the Ropes: A Heuristic Strategy for LLM-based Multi-Agent System Design
- 2025Multi-Agent LLM Orchestration Achieves Deterministic, High-Quality Decision Support for Incident Response
- 2026Beyond Static Leaderboards: Predictive Validity for the Evaluation of LLM Agents