Orchestrating Human-AI Teams: The Manager Agent as a Unifying Research Challenge
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
While agentic AI has advanced in automating individual tasks, managing complex multi-agent workflows remains a challenging problem. This paper presents a research vision for autonomous agentic systems that orchestrate collaboration within dynamic human-AI teams. We propose the Autonomous Manager Agent as a core challenge: an agent that decomposes complex goals into task graphs, allocates tasks to human and AI workers, monitors progress, adapts to changing conditions, and maintains transparent stakeholder communication. We formalize workflow management as a Partially Observable Stochastic Game and identify four foundational challenges: (1) compositional reasoning for hierarchical decomposition, (2) multi-objective optimization under shifting preferences, (3) coordination and planning in ad hoc teams, and (4) governance and compliance by design. To advance this agenda, we release MA-Gym, an open-source simulation and evaluation framework for multi-agent workflow orchestration. Evaluating GPT-5-based Manager Agents across 20 workflows, we find they struggle to jointly optimize for goal completion, constraint adherence, and workflow runtime - underscoring workflow management as a difficult open problem. We conclude with organizational and ethical implications of autonomous management systems.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 43 of its 99 references that are in the map. First posted on arXiv 2 Oct 2025.
Builds on
43 of 99 references.
Closest ancestors · 1
Same direction, newest first
- 2025Why Do Multi-Agent LLM Systems Fail?17 Mar
Other references · 42
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
- 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 672
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
30 more
- 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 503
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
- 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 367
- 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 336
- 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 326
- 2017StarCraft II: A New Challenge for Reinforcement Learningcited by 274
- 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Reviewcited by 236
- 2025ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoningcited by 201
- 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agentscited by 178
- 2025Measuring AI Ability to Complete Long Software Taskscited by 156
- 2017Autonomous Agents Modelling Other Agents: A Comprehensive Survey and Open Problemscited by 131
- 2024A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directionscited by 121
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communicationcited by 104
- 2024PARTNR: A Benchmark for Planning and Reasoning in Embodied Multi-agent Taskscited by 82
- 2021On the Expressivity of Markov Rewardcited by 71
- 2024GenARM: Reward Guided Generation with Autoregressive Reward Model for Test-time Alignmentcited by 54
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 53
- 2024TDAG: A Multi-Agent Framework based on Dynamic Task Decomposition and Agent Generationcited by 51
- 2024MegaAgent: A Large-Scale Autonomous LLM-based Multi-Agent System Without Predefined SOPscited by 47
- 2025Multi-Attribute Steering of Language Models via Targeted Interventioncited by 46
- 2025Play Favorites: A Statistical Method to Measure Self-Bias in LLM-as-a-Judgecited by 36
- 2024LLM-based Multi-Agent Systems: Techniques and Business Perspectivescited by 22
- 2015Belief and Truth in Hypothesised Behaviourscited by 21
- 2025A Survey on Large Language Models for Automated Planningcited by 17
- 2024Right Now, Wrong Then: Non-Stationary Direct Preference Optimization under Preference Driftcited by 13
- 2022A General Learning Framework for Open Ad Hoc Teamwork Using Graph-based Policy Learningcited by 12
- 2023A Framework for Neurosymbolic Robot Action Planning using Large Language Modelscited by 12
- 2024Leveraging Large Language Model for Heterogeneous Ad Hoc Teamwork Collaborationcited by 7
- 2025CREW-WILDFIRE: Benchmarking Agentic Multi-Agent Collaborations at Scalecited by 7
Built on by
Citing papers per year: 2025: 4; 2026: 4.
8 papers.
- 2025How Do AI Agents Do Human Work? Comparing AI and Human Workflows Across Diverse Occupationscited by 19
- 2025ARCANE: A Multi-Agent Framework for Interpretable and Configurable Alignmentcited by 3
- 2026Engineering Reliable Coding Agents: Evaluating and Operating the System Around the Modelcited by 3
- 2026Can AI Models Direct Each Other? Organizational Structure as a Probe into Training Limitationscited by 2
- 2025Towards Ethical Multi-Agent Systems of Large Language Models: A Mechanistic Interpretability Perspectivecited by 1
- 2026ClawArena-Team: Benchmarking Subagent Orchestration and Dynamic Workflows in Language-Model Agentscited by 1
- 2025Operon: Incremental Construction of Ragged Data via Named Dimensionscited by 0
- 2026Searching for Synergy in Shared Workspace Human-AI Collaborationcited by 0
- 2026Engineering Reliable Coding Agents: Evaluating and Operating the System Around the Model14 Aug 2026
- 2026ClawArena-Team: Benchmarking Subagent Orchestration and Dynamic Workflows in Language-Model Agents30 Jun 2026
- 2026Searching for Synergy in Shared Workspace Human-AI Collaboration16 Jun 2026
- 2026Can AI Models Direct Each Other? Organizational Structure as a Probe into Training Limitations27 Mar 2026
- 2025ARCANE: A Multi-Agent Framework for Interpretable and Configurable Alignment5 Dec 2025
- 2025Towards Ethical Multi-Agent Systems of Large Language Models: A Mechanistic Interpretability Perspective4 Dec 2025
- 2025Operon: Incremental Construction of Ragged Data via Named Dimensions20 Nov 2025
- 2025How Do AI Agents Do Human Work? Comparing AI and Human Workflows Across Diverse Occupations26 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025A Survey on Agent Workflow -- Status and Future
- 2025Understanding and Optimizing Agentic Workflows via Shapley value
- 2025A Practical Guide for Designing, Developing, and Deploying Production-Grade Agentic AI Workflows
- 2026The Organizational Behavior of Agentic AI: Collective Intelligence in Human-Agent Workflows
- 2025Communication to Completion: Modeling Collaborative Workflows with Intelligent Multi-Agent Communication
- 2025Adaptive Human-Agent Teaming: A Review of Empirical Studies from the Process Dynamics Perspective
- 2025HAWK: A Hierarchical Workflow Framework for Multi-Agent Collaboration
- 2026Workflow-GYM: Towards Long-Horizon Evaluation of Computer-use Agentic tasks in Real-World Professional Fields