ZEBRA: Zero-shot Budgeted Resource Allocation for LLM Orchestration
Not on the map. Why?
Abstract (arXiv)
As autonomous agents increasingly execute end-to-end tasks under fixed monetary budgets, the pressing open question shifts from whether the budget is respected, to how to spend it effectively. Existing budget-aware methods typically control reasoning step-by-step within a single agent, or learn resource allocation policies via RL. None address how to split a budget across the composing phases of a multi-agent pipeline at inference time. We propose ZEBRA, a zero-shot framework that reduces multi-phase budget allocation to a continuous nonlinear knapsack problem: an LLM controller estimates per-phase utility curves, and a water-filling search on the Lagrange multiplier returns the per-phase split. Additive and multiplicative aggregations are unified under the same solver. On a 150-task APPS coding benchmark, both ZEBRA variants outperform LLM-direct (budget allocation directly by an LLM) on every aggregate metric. At a budget of α = 0.5 of the unconstrained spend, ZEBRA recovers 94.4% of unconstrained quality, versus 88.1% for LLM-direct. The advantage is statistically significant and transfers beyond coding: on a 3-phase HotpotQA pipeline, ZEBRA beats LLM-direct by 14.3pp, with allocations empirically robust to curve-estimation noise. On HotpotQA, ZEBRA arrives at a different budget split (near-balanced) compared to the APPS one (skewed towards a refinement phase), showing adaptation to the pipeline structure. More broadly, we show that lightweight algorithmic guidance at inference time can improve the economic behavior of autonomous multi-agent systems.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 24 of its 33 references that are in the map. First posted on arXiv 19 May 2026.
Builds on
24 of 33 references.
References · 24
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2021Convex optimizationcited by 2,515
- 2022Competition-Level Code Generation with AlphaCodecited by 1,462
- 2021Measuring Coding Challenge Competence With APPScited by 902
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMscited by 570
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Modelscited by 464
- 2024Token-Budget-Aware LLM Reasoningcited by 247
- 2025Budget-Aware Tool Use Enables Effective Agent Scalingcited by 44
- 2025Difficulty-Aware Agentic Orchestration for Query-Specific Multi-Agent Workflowscited by 27
12 more
- 2025Self-Resource Allocation in Multi-Agent LLM Systemscited by 15
- 2025Controlling Performance and Budget of a Centralized Multi-agent LLM System with Reinforcement Learningcited by 13
- 2025Shapley-Coop: Credit Assignment for Emergent Cooperation in Self-Interested LLM Agentscited by 12
- 2023SEER : A Knapsack approach to Exemplar Selection for In-Context HybridQAcited by 9
- 2025Orchestrating Agents and Data for Enterprise: A Blueprint Architecture for Compound AIcited by 9
- 2025Hierarchical Budget Policy Optimization for Adaptive Reasoningcited by 8
- 2026ROI-Reasoning: Rational Optimization for Inference via Pre-Computation Meta-Cognitioncited by 8
- 2026Budget-Constrained Agentic Large Language Models: Intention-Based Planning for Costly Tool Usecited by 8
- 2025BAMAS: Structuring Budget-Aware Multi-Agent Systemscited by 6
- 2025A Knapsack by Any Other Name: Presentation impacts LLM performance on NP-hard problemscited by 5
- 2026Predictive Scheduling for Efficient Inference-Time Reasoning in Large Language Modelscited by 3
- 2023Cardinality-Constrained Continuous Knapsack Problem with Concave Piecewise-Linear Utilitiescited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Spend Less, Reason Better: Budget-Aware Value Tree Search for LLM Agents
- 2026EcoAgent-Bench: Evaluating Economic Decision-Making in Budget-Constrained LLM Agents
- 2026Credit-Budgeted ICPC-Style Coding: When Agents Must Pay for Every Decision
- 2025Know the Ropes: A Heuristic Strategy for LLM-based Multi-Agent System Design
- 2026Compute Allocation for Self-Evolving LLMs: From Depth-Breadth to Multi-Armed Bandits
- 2026When Independent Sampling Outperforms Agentic Reasoning
- 2026Attention Tax, Handoff Tax: A Stylised Model of When Multi-Agent LLM Systems Help
- 2026One Policy, Any Budget: Internalizing Budget-Aware Search via Reinforcement Learning