On Time, Within Budget: Constraint-Driven Online Resource Allocation for Agentic Workflows
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Agentic systems increasingly solve complex user requests by executing orchestrated workflows, where subtasks are assigned to specialized models or tools and coordinated according to their dependencies. While recent work improves agent efficiency by optimizing the performance--cost--latency frontier, real deployments often impose concrete requirements: a workflow must be completed within a specified budget and before a specified deadline. This shifts the goal from average efficiency optimization to maximizing the probability that the entire workflow completes successfully under explicit budget and deadline constraints. We study constraint-driven online resource allocation for agentic workflows. Given a dependency-structured workflow and estimates of success rates and generation lengths for each subtask--model pair, the executor dynamically allocates models and parallel samples across simultaneously executable subtasks while managing the remaining budget and time. We formulate this setting as a finite-horizon stochastic online allocation problem and propose Monte Carlo Portfolio Planning (MCPP), a lightweight closed-loop planner that directly estimates constrained completion probability through simulated workflow executions and replans after observed outcomes. Experiments on CodeFlow and ProofFlow demonstrate that MCPP consistently improves constrained completion probability over strong baselines across a wide range of budget--deadline constraints.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 34 of its 45 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
34 of 45 references.
Closest ancestors · 3
Same direction, newest first
- 2026MegaFlow: Large-Scale Distributed Orchestration System for the Agentic Era12 Jan
- 2025EvoAgentX: An Automated Framework for Evolving Agentic Workflows4 Jul
- 2025ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimization6 Feb
Other references · 31
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 633
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
- 2024Hybrid LLM: Cost-Efficient and Quality-Aware Query Routingcited by 354
- 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Taskscited by 190
19 more
- 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learningcited by 173
- 2025Multi-agent Architecture Search via Agentic Supernetcited by 164
- 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 140
- 2025BEST-Route: Adaptive LLM Routing with Test-Time Optimal Computecited by 63
- 2025Budget-Aware Tool Use Enables Effective Agent Scalingcited by 42
- 2026ClawBench: Can AI Agents Complete Everyday Online Tasks?cited by 28
- 2024100 instances is all you need: predicting the success of a new LLM on unseen data by testing on a few instancescited by 24
- 2025Route to Reason: Adaptive Routing for LLM and Reasoning Strategy Selectioncited by 23
- 2025ProofFlow: A Dependency Graph Approach to Faithful Proof Autoformalizationcited by 18
- 2025CodeFlowBench: A Multi-turn, Iterative Benchmark for Complex Code Generationcited by 16
- 2025AgentTTS: Large Language Model Agent for Test-time Compute-optimal Scaling Strategy in Complex Taskscited by 16
- 2026EvoRoute: Experience-Driven Self-Routing LLM Agent Systemscited by 13
- 2025Faster and Better LLMs via Latency-Aware Test-Time Scalingcited by 9
- 2025Latency and Token-Aware Test-Time Computecited by 8
- 2026Budget-Constrained Agentic Large Language Models: Intention-Based Planning for Costly Tool Usecited by 8
- 2026Budget-Aware Agentic Routing via Boundary-Guided Trainingcited by 8
- 2025SATER: A Self-Aware and Token-Efficient Approach to Routing and Cascadingcited by 6
- 2026Timely Machine: Awareness of Time Makes Test-Time Scaling Agenticcited by 5
- 2026Not All Turns Are Equally Hard: Adaptive Thinking Budgets For Efficient Multi-Turn Reasoning in Agentscited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026From Pareto to Preference: Personalized Test-Time Scaling via Amortized Agentic Policy Discovery7 Oct 2026
- 2026AllocBench: Measuring Online Tool Allocation Capability in LLM Agents25 Jul 2026
- 2026Small RL Controller, Large Language Model: RL-Guided Adaptive Sampling for Test-Time Scaling2 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Designing Agentic AI Workflow Portfolios under Imperfect Selection and Compute Cost
- 2026Do We Always Need Query-Level Workflows? Rethinking Agentic Workflow Generation for Multi-Agent Systems
- 2025Murakkab: Resource-Efficient Agentic Workflow Orchestration in Cloud Platforms
- 2025Orchestrating Human-AI Teams: The Manager Agent as a Unifying Research Challenge
- 2026Pythia: Exploiting Workflow Predictability for Efficient Agent-Native LLM Serving
- 2026FlowBank: Query-Adaptive Agentic Workflows Optimization through Precompute-and-Reuse
- 2026AgentFloor: How Far Up the tool use Ladder Can Small Open-Weight Models Go?
- 2026Agent-UCT: Upper Confidence Bounds Applied to Trees for Agentic Workflow Optimization with Cost-Awareness