Utility-Guided Agent Orchestration for Efficient LLM Tool Use
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Tool-using large language model (LLM) agents often face a fundamental tension between answer quality and execution cost. Fixed workflows are stable but inflexible, while free-form multi-step reasoning methods such as ReAct may improve task performance at the expense of excessive tool calls, longer trajectories, higher token consumption, and increased latency. In this paper, we study agent orchestration as an explicit decision problem rather than leaving it entirely to prompt-level behavior. We propose a utility-guided orchestration policy that selects among actions such as respond, retrieve, tool call, verify, and stop by balancing estimated gain, step cost, uncertainty, and redundancy. Our goal is not to claim universally best task performance, but to provide a controllable and analyzable policy framework for studying quality-cost trade-offs in tool-using LLM agents. Experiments across direct answering, threshold control, fixed workflows, ReAct, and several policy variants show that explicit orchestration signals substantially affect agent behavior. Additional analyses on cost definitions, workflow fairness, and redundancy control further demonstrate that lightweight utility design can provide a defensible and practical mechanism for agent control.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 28 of its 31 references that are in the map. First posted on arXiv 20 Mar 2026.
Builds on
28 of 31 references.
Closest ancestors · 1
Same direction, newest first
Other references · 27
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
15 more
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2020Efficient Transformers: A Surveycited by 784
- 2022PAL: Program-aided Language Modelscited by 635
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
- 2016Adaptive Computation Time for Recurrent Neural Networkscited by 479
- 2020DeeBERT: Dynamic Early Exiting for Accelerating BERT Inferencecited by 322
- 2022Confident Adaptive Language Modelingcited by 297
- 2019Depth-Adaptive Transformercited by 227
- 2023ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Modelscited by 174
- 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoningcited by 153
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026From Question Answering to Task Completion: A Survey on Agent System and Harness Designcited by 9
- 2026AllocBench: Measuring Online Tool Allocation Capability in LLM Agentscited by 2
- 2026Scores Are Not Decisions: Cost-Aware Stopping for Tool Acquisition in LLM Agentscited by 2
- 2026Harness-MU: A Safe, Governed, and Effective Harness for Multi-User LLM Agentscited by 1
- 2026Scores Are Not Decisions: Cost-Aware Stopping for Tool Acquisition in LLM Agents29 Jul 2026
- 2026AllocBench: Measuring Online Tool Allocation Capability in LLM Agents25 Jul 2026
- 2026Harness-MU: A Safe, Governed, and Effective Harness for Multi-User LLM Agents20 Jun 2026
- 2026From Question Answering to Task Completion: A Survey on Agent System and Harness Design14 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026The Evolution of Tool Use in LLM Agents: From Single-Tool Call to Multi-Tool Orchestration
- 2026Sutradhara: An Intelligent Orchestrator-Engine Co-design for Tool-based Agentic Inference
- 2026Are Tools All We Need? Unveiling the Tool-Use Tax in LLM Agents
- 2024A Review of Prominent Paradigms for LLM-Based Agents: Tool Use (Including RAG), Planning, and Feedback Learning
- 2026Empirical Comparison of Agent Communication Protocols for Task Orchestration
- 2026From Atomic Actions to Standard Operating Procedures: Iterative Tool Optimization for Self-Evolving LLM Agents
- 2025Multi-Mission Tool Bench: Assessing the Robustness of LLM based Agents through Related and Dynamic Missions
- 2026ClawArena-Team: Benchmarking Subagent Orchestration and Dynamic Workflows in Language-Model Agents