Can AI Models Direct Each Other? Organizational Structure as a Probe into Training Limitations
Not on the map. Why?
Abstract (arXiv)
Can an expensive AI model effectively direct a cheap one to solve software engineering tasks? We study this question by introducing ManagerWorker, a two-agent pipeline where an expensive "manager" model (text-only, no code execution) analyzes issues, dispatches exploration tasks, and reviews implementations, while a cheap "worker" model (with full repo access) executes code changes. We evaluate on 200 instances from SWE-bench Lite across five configurations that vary the manager-worker relationship, pipeline complexity, and model pairing. Our findings reveal both the promise and the limits of multi-agent direction: (1) a strong manager directing a weak worker (62%) matches a strong single agent (60%) at a fraction of the strong-model token usage, showing that expensive reasoning can substitute for expensive execution; (2) a weak manager directing a weak worker (42%) performs worse than the weak agent alone (44%), demonstrating that the directing relationship requires a genuine capability gap--structure without substance is pure overhead; (3) the manager's value lies in directing, not merely reviewing--a minimal review-only loop adds just 2pp over the baseline, while structured exploration and planning add 11pp, showing that active direction is what makes the capability gap productive; and (4) these behaviors trace to a single root cause: current models are trained as monolithic agents, and splitting them into director/worker roles fights their training distribution. The pipeline succeeds by designing around this mismatch--keeping each model close to its trained mode (text generation for the manager, tool use for the worker) and externalizing organizational structure to code. This diagnosis points to concrete training gaps: delegation, scoped execution, and mode switching are skills absent from current training data.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 17 references that are in the map. First posted on arXiv 27 Mar 2026.
Builds on
16 of 17 references.
References · 16
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
- 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 400
- 2024AutoCodeRover: Autonomous Program Improvementcited by 272
- 2025Towards a Science of Scaling Agent Systemscited by 125
- 2024SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinementcited by 124
- 2023Self-planning Code Generation with Large Language Modelscited by 121
4 more
- 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?cited by 91
- 2024HyperAgent: Generalist Software Engineering Agents to Solve Coding Tasks at Scalecited by 61
- 2024BudgetMLAgent: A Cost-Effective LLM Multi-Agent system for Automating Machine Learning Taskscited by 19
- 2025Orchestrating Human-AI Teams: The Manager Agent as a Unifying Research Challengecited by 8
Built on by
Citing papers per year: 2026: 1.
1 paper.