Budget-Aware Tool Use Enables Effective Agent Scaling
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Scaling test-time computation has been extended from language model reasoning to tool-augmented agents, where scaling involves not only thinking in tokens but also acting via tool calls that directly constrain environmental interaction. However, we found that simply increasing the tool-call budget fails to improve performance, as agents lack "budget awareness" and quickly hit a performance ceiling. We study how to scale such agents effectively under explicit tool-call budgets, focusing on web search agents. We first introduce the Budget Tracker, a lightweight plug-in that provides the agent with continuous budget awareness, enabling simple yet effective scaling. We further develop BATS (Budget-Aware Test-time Scaling), an advanced framework that leverages this awareness to dynamically adapt its planning and verification strategy. To analyze cost-performance scaling in a controlled manner, we formalize a unified cost metric that jointly accounts for token and tool consumption. We provide the first systematic study on budget-constrained agents, showing that budget-aware methods produce more favorable scaling curves and push the cost-performance Pareto frontier. Our work offers empirical insights toward a more transparent and principled understanding of scaling in tool-augmented agents. Our code is available at https://github.com/google-research/budget-aware-agent.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 48 of its 62 references that are in the map. First posted on arXiv 21 Nov 2025.
Builds on
48 of 62 references.
Closest ancestors · 5
Same direction, newest first
- 2025MiroThinker: Pushing the Performance Boundaries of Open-Source Research Agents via Model, Context, and Interactive Scaling14 Nov
- 2025Chain-of-Agents: End-to-End Agent Foundation Models via Multi-Agent Distillation and Agentic RL6 Aug
- 2025AgentTTS: Large Language Model Agent for Test-time Compute-optimal Scaling Strategy in Complex Tasks26 Jul
- 2025WebSailor: Navigating Super-human Reasoning for Web Agent3 Jul
- 2025Thinking vs. Doing: Agents that Reason by Scaling Test-Time Interaction9 Jun
Other references · 43
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2024GPT-4o System Cardcited by 4,467
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2025s1: Simple test-time scalingcited by 1,311
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
31 more
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
- 2025Kimi K2: Open Agentic Intelligencecited by 523
- 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 423
- 2024Inference Scaling Laws: An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language Modelscited by 282
- 2024Token-Budget-Aware LLM Reasoningcited by 242
- 2023ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddingscited by 238
- 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agentcited by 183
- 2025WebDancer: Towards Autonomous Information Seeking Agencycited by 180
- 2025Beyond Ten Turns: Unlocking Long-Horizon Agentic Search with Large-Scale Asynchronous RLcited by 144
- 2025BrowseComp-ZH: Benchmarking Web Browsing Ability of Large Language Models in Chinesecited by 139
- 2024From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Modelscited by 136
- 2025WebShaper: Agentically Data Synthesizing via Information-Seeking Formalizationcited by 118
- 2024Concise Thoughts: Impact of Output Length on LLM Reasoning and Costcited by 108
- 2024Escape Sky-high Cost: Early-stopping Self-Consistency for Multi-step Reasoningcited by 105
- 2025AgentFold: Long-Horizon Web Agents with Proactive Context Managementcited by 95
- 2023Cumulative Reasoning with Large Language Modelscited by 94
- 2025WebExplorer: Explore and Evolve for Training Long-Horizon Web Agentscited by 86
- 2024Learning How Hard to Think: Input-Adaptive Allocation of LM Computationcited by 67
- 2025WideSearch: Benchmarking Agentic Broad Info-Seekingcited by 66
- 2025WebResearcher: Unleashing unbounded reasoning capability in Long-Horizon Agentscited by 66
- 2024Reasoning Aware Self-Consistency: Leveraging Reasoning Paths for Efficient LLM Samplingcited by 63
- 2025Scaling Test-time Compute for LLM Agentscited by 59
- 2025SETS: Leveraging Self-Verification and Self-Correction for Improved Test-Time Scalingcited by 54
- 2025THOUGHTTERMINATOR: Benchmarking, Calibrating, and Mitigating Overthinking in Reasoning Modelscited by 34
- 2025Efficient Agents: Building Effective Agents While Reducing Costcited by 32
- 2025OAgents: An Empirical Study of Building Effective Agentscited by 28
- 2025Flash-Searcher: Fast and Effective Web Agents via DAG-Based Parallel Executioncited by 27
- 2025Do We Truly Need So Many Samples? Multi-LLM Repeated Sampling Efficiently Scales Test-Time Computecited by 20
- 2025BrowseMaster: Towards Scalable Web Browsing via Tool-Augmented Programmatic Agent Paircited by 16
- 2025A Simple "Try Again" Can Elicit Multi-Turn LLM Reasoningcited by 11
- 2025Lost in the Maze: Overcoming Context Limitations in Long-Horizon Agentic Searchcited by 11
Built on by
Citing papers per year: 2026: 42.
42 papers.
Sort:
By area:
- 2026How Do AI Agents Spend Your Money? Analyzing and Predicting Token Consumption in Agentic Coding Taskscited by 28
- 2026MARS: Modular Agent with Reflective Search for Automated AI Researchcited by 22
- 2026SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Trainingcited by 18
- 2026Calibrate-Then-Act: Cost-Aware Exploration in LLM Agentscited by 16
- 2026Toward Efficient Agents: Memory, Tool learning, and Planningcited by 11
- 2026Spend Less, Reason Better: Budget-Aware Value Tree Search for LLM Agentscited by 10
- 2026Thinking with Map: Reinforced Parallel Map-Augmented Agent for Geolocalizationcited by 8
- 2026Budget-Constrained Agentic Large Language Models: Intention-Based Planning for Costly Tool Usecited by 8
- 2026To Call or Not to Call: A Framework to Assess and Optimize LLM Tool Callingcited by 7
- 2026Timely Machine: Awareness of Time Makes Test-Time Scaling Agenticcited by 5
- 2026Table-as-Search: Formulate Long-Horizon Agentic Information Seeking as Table Completioncited by 5
- 2026What If We Allocate Test-Time Compute Adaptively?cited by 4
30 more
- 2026TAPE: Tool-Guided Adaptive Planning and Constrained Execution in Language Model Agentscited by 4
- 2026Aligning Tree-Search Policies with Fixed Token Budgets in Test-Time Scaling of LLMscited by 3
- 2026On Time, Within Budget: Constraint-Driven Online Resource Allocation for Agentic Workflowscited by 3
- 2026Why Retrying Fails: Context Contamination in LLM Agent Pipelinescited by 3
- 2026AllocBench: Measuring Online Tool Allocation Capability in LLM Agentscited by 2
- 2026Scores Are Not Decisions: Cost-Aware Stopping for Tool Acquisition in LLM Agentscited by 2
- 2026Quantifying Overclaiming Propensity in Frontier LLM Agentscited by 2
- 2026AdaTIR: Adaptive Tool-Integrated Reasoning via Difficulty-Aware Policy Optimizationcited by 1
- 2026The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Projectcited by 1
- 2026ZEBRA: Zero-shot Budgeted Resource Allocation for LLM Orchestrationcited by 1
- 2026Scaling Laws for Agent Harnesses via Effective Feedback Computecited by 1
- 2026Cache-Aware Prompt Compression:A Two-Tier Cost Model for LLM API Cachingcited by 1
- 2026SpatialCLI: Learning to Reason With Spatial Tools, Then Without Themcited by 1
- 2026Cost-Utility Alignment in LLM Agent Trajectories:Profiling,Attribution,Diagnosis,Adaptation,and Evaluationcited by 1
- 2026One Policy, Any Budget: Internalizing Budget-Aware Search via Reinforcement Learningcited by 1
- 2026Lookahead-R: Budget-Aware Tool Retrieval via Execution-Centric Planningcited by 1
- 2026Agents Learn Their Runtime: Interpreter Persistence as Training-Time Semanticscited by 0
- 2026MEMOA: Massive Mixtures of Online Agents via Mean-Field Decentralized Nash Equilibriacited by 0
- 2026When Does Restricting a Coding Agent to executecode Help? A Regime × Agent-Design Ablationcited by 0
- 2026NELSSA: A GPU-PNM Heterogeneous System for Mixed-Length LLM Serving via Length-based Request Placementcited by 0
- 2026Budget-Aware LLM Discovery via Cost-Calibrated Frontier Utilitycited by 0
- 2026R3-Bench: LLMs Struggle with Resource-Rational Reasoning under Shared Budgetscited by 0
- 2026Elastic Horizon: Discovering the Effective Interaction Frontier in Agentic Reinforcement Learningcited by 0
- 2026PrimeScientist: Strategic Allocation of Research Effort in Autonomous Researchcited by 0
- 2026Toolcompass: Guiding Tool Trialing, Not Suppressing Itcited by 0
- 2026RECLAIM: Can Agents Reproduce the Claims of Machine Learning Papers?cited by 0
- 2026Coding Agents Aren't Enough! Evaluating an Enterprise Security Brain for Agentic Cloud Investigationscited by 0
- 2026Analyzing and Mitigating Cost-Inefficient Behaviors in Coding Agentscited by 0
- 2026When Should Agents Check External State? Budgeting Observations for Stored Intentionscited by 0
- 2026AgentTime: Can Agents Estimate and Control Their Own Runtime?cited by 0
- 2026AgentTime: Can Agents Estimate and Control Their Own Runtime?7 Oct 2026
- 2026When Should Agents Check External State? Budgeting Observations for Stored Intentions29 Sep 2026
- 2026Analyzing and Mitigating Cost-Inefficient Behaviors in Coding Agents25 Sep 2026
- 2026Coding Agents Aren't Enough! Evaluating an Enterprise Security Brain for Agentic Cloud Investigations24 Sep 2026
- 2026RECLAIM: Can Agents Reproduce the Claims of Machine Learning Papers?23 Sep 2026
- 2026Toolcompass: Guiding Tool Trialing, Not Suppressing It22 Sep 2026
- 2026Lookahead-R: Budget-Aware Tool Retrieval via Execution-Centric Planning20 Sep 2026
- 2026Quantifying Overclaiming Propensity in Frontier LLM Agents17 Sep 2026
- 2026PrimeScientist: Strategic Allocation of Research Effort in Autonomous Research15 Sep 2026
- 2026Elastic Horizon: Discovering the Effective Interaction Frontier in Agentic Reinforcement Learning7 Sep 2026
- 2026One Policy, Any Budget: Internalizing Budget-Aware Search via Reinforcement Learning1 Sep 2026
- 2026Cost-Utility Alignment in LLM Agent Trajectories:Profiling,Attribution,Diagnosis,Adaptation,and Evaluation25 Aug 2026
30 more
- 2026R3-Bench: LLMs Struggle with Resource-Rational Reasoning under Shared Budgets17 Aug 2026
- 2026SpatialCLI: Learning to Reason With Spatial Tools, Then Without Them30 Jul 2026
- 2026Scores Are Not Decisions: Cost-Aware Stopping for Tool Acquisition in LLM Agents29 Jul 2026
- 2026Budget-Aware LLM Discovery via Cost-Calibrated Frontier Utility29 Jul 2026
- 2026NELSSA: A GPU-PNM Heterogeneous System for Mixed-Length LLM Serving via Length-based Request Placement29 Jul 2026
- 2026AllocBench: Measuring Online Tool Allocation Capability in LLM Agents25 Jul 2026
- 2026Cache-Aware Prompt Compression:A Two-Tier Cost Model for LLM API Caching17 Jul 2026
- 2026When Does Restricting a Coding Agent to executecode Help? A Regime × Agent-Design Ablation12 Jul 2026
- 2026Scaling Laws for Agent Harnesses via Effective Feedback Compute28 May 2026
- 2026ZEBRA: Zero-shot Budgeted Resource Allocation for LLM Orchestration19 May 2026
- 2026Why Retrying Fails: Context Contamination in LLM Agent Pipelines8 May 2026
- 2026On Time, Within Budget: Constraint-Driven Online Resource Allocation for Agentic Workflows7 May 2026
- 2026MEMOA: Massive Mixtures of Online Agents via Mean-Field Decentralized Nash Equilibria6 May 2026
- 2026To Call or Not to Call: A Framework to Assess and Optimize LLM Tool Calling1 May 2026
- 2026How Do AI Agents Spend Your Money? Analyzing and Predicting Token Consumption in Agentic Coding Tasks24 Apr 2026
- 2026The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Project22 Mar 2026
- 2026Spend Less, Reason Better: Budget-Aware Value Tree Search for LLM Agents13 Mar 2026
- 2026Agents Learn Their Runtime: Interpreter Persistence as Training-Time Semantics1 Mar 2026
- 2026TAPE: Tool-Guided Adaptive Planning and Constrained Execution in Language Model Agents23 Feb 2026
- 2026Calibrate-Then-Act: Cost-Aware Exploration in LLM Agents18 Feb 2026
- 2026Budget-Constrained Agentic Large Language Models: Intention-Based Planning for Costly Tool Use12 Feb 2026
- 2026Aligning Tree-Search Policies with Fixed Token Budgets in Test-Time Scaling of LLMs10 Feb 2026
- 2026Table-as-Search: Formulate Long-Horizon Agentic Information Seeking as Table Completion6 Feb 2026
- 2026SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Training3 Feb 2026
- 2026MARS: Modular Agent with Reflective Search for Automated AI Research2 Feb 2026
- 2026What If We Allocate Test-Time Compute Adaptively?1 Feb 2026
- 2026Timely Machine: Awareness of Time Makes Test-Time Scaling Agentic23 Jan 2026
- 2026AdaTIR: Adaptive Tool-Integrated Reasoning via Difficulty-Aware Policy Optimization21 Jan 2026
- 2026Toward Efficient Agents: Memory, Tool learning, and Planning20 Jan 2026
- 2026Thinking with Map: Reinforced Parallel Map-Augmented Agent for Geolocalization8 Jan 2026
- 2026How Do AI Agents Spend Your Money? Analyzing and Predicting Token Consumption in Agentic Coding Taskscited by 28
- 2026MARS: Modular Agent with Reflective Search for Automated AI Researchcited by 22
- 2026SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Trainingcited by 18
- 2026Calibrate-Then-Act: Cost-Aware Exploration in LLM Agentscited by 16
- 2026Toward Efficient Agents: Memory, Tool learning, and Planningcited by 11
- 2026Budget-Constrained Agentic Large Language Models: Intention-Based Planning for Costly Tool Usecited by 8
- 2026To Call or Not to Call: A Framework to Assess and Optimize LLM Tool Callingcited by 7
- 2026Table-as-Search: Formulate Long-Horizon Agentic Information Seeking as Table Completioncited by 5
- 2026TAPE: Tool-Guided Adaptive Planning and Constrained Execution in Language Model Agentscited by 4
- 2026On Time, Within Budget: Constraint-Driven Online Resource Allocation for Agentic Workflowscited by 3
- 2026Why Retrying Fails: Context Contamination in LLM Agent Pipelinescited by 3
- 2026AllocBench: Measuring Online Tool Allocation Capability in LLM Agentscited by 2
12 most cited of 25 All 25 (JSON)
- 2026AgentTime: Can Agents Estimate and Control Their Own Runtime?7 Oct 2026
- 2026Analyzing and Mitigating Cost-Inefficient Behaviors in Coding Agents25 Sep 2026
- 2026Coding Agents Aren't Enough! Evaluating an Enterprise Security Brain for Agentic Cloud Investigations24 Sep 2026
- 2026RECLAIM: Can Agents Reproduce the Claims of Machine Learning Papers?23 Sep 2026
- 2026Lookahead-R: Budget-Aware Tool Retrieval via Execution-Centric Planning20 Sep 2026
- 2026Quantifying Overclaiming Propensity in Frontier LLM Agents17 Sep 2026
- 2026PrimeScientist: Strategic Allocation of Research Effort in Autonomous Research15 Sep 2026
- 2026Elastic Horizon: Discovering the Effective Interaction Frontier in Agentic Reinforcement Learning7 Sep 2026
- 2026Cost-Utility Alignment in LLM Agent Trajectories:Profiling,Attribution,Diagnosis,Adaptation,and Evaluation25 Aug 2026
- 2026Scores Are Not Decisions: Cost-Aware Stopping for Tool Acquisition in LLM Agents29 Jul 2026
- 2026AllocBench: Measuring Online Tool Allocation Capability in LLM Agents25 Jul 2026
- 2026When Does Restricting a Coding Agent to executecode Help? A Regime × Agent-Design Ablation12 Jul 2026
12 newest of 25 All 25 (JSON)
- 2026Spend Less, Reason Better: Budget-Aware Value Tree Search for LLM Agentscited by 10
- 2026Thinking with Map: Reinforced Parallel Map-Augmented Agent for Geolocalizationcited by 8
- 2026Timely Machine: Awareness of Time Makes Test-Time Scaling Agenticcited by 5
- 2026What If We Allocate Test-Time Compute Adaptively?cited by 4
- 2026Aligning Tree-Search Policies with Fixed Token Budgets in Test-Time Scaling of LLMscited by 3
- 2026AdaTIR: Adaptive Tool-Integrated Reasoning via Difficulty-Aware Policy Optimizationcited by 1
- 2026SpatialCLI: Learning to Reason With Spatial Tools, Then Without Themcited by 1
- 2026R3-Bench: LLMs Struggle with Resource-Rational Reasoning under Shared Budgetscited by 0
- 2026R3-Bench: LLMs Struggle with Resource-Rational Reasoning under Shared Budgets17 Aug 2026
- 2026SpatialCLI: Learning to Reason With Spatial Tools, Then Without Them30 Jul 2026
- 2026Spend Less, Reason Better: Budget-Aware Value Tree Search for LLM Agents13 Mar 2026
- 2026Aligning Tree-Search Policies with Fixed Token Budgets in Test-Time Scaling of LLMs10 Feb 2026
- 2026What If We Allocate Test-Time Compute Adaptively?1 Feb 2026
- 2026Timely Machine: Awareness of Time Makes Test-Time Scaling Agentic23 Jan 2026
- 2026AdaTIR: Adaptive Tool-Integrated Reasoning via Difficulty-Aware Policy Optimization21 Jan 2026
- 2026Thinking with Map: Reinforced Parallel Map-Augmented Agent for Geolocalization8 Jan 2026
- 2026ZEBRA: Zero-shot Budgeted Resource Allocation for LLM Orchestrationcited by 1
- 2026Scaling Laws for Agent Harnesses via Effective Feedback Computecited by 1
- 2026One Policy, Any Budget: Internalizing Budget-Aware Search via Reinforcement Learningcited by 1
- 2026MEMOA: Massive Mixtures of Online Agents via Mean-Field Decentralized Nash Equilibriacited by 0
- 2026Budget-Aware LLM Discovery via Cost-Calibrated Frontier Utilitycited by 0
- 2026Toolcompass: Guiding Tool Trialing, Not Suppressing Itcited by 0
- 2026When Should Agents Check External State? Budgeting Observations for Stored Intentionscited by 0
- 2026When Should Agents Check External State? Budgeting Observations for Stored Intentions29 Sep 2026
- 2026Toolcompass: Guiding Tool Trialing, Not Suppressing It22 Sep 2026
- 2026One Policy, Any Budget: Internalizing Budget-Aware Search via Reinforcement Learning1 Sep 2026
- 2026Budget-Aware LLM Discovery via Cost-Calibrated Frontier Utility29 Jul 2026
- 2026Scaling Laws for Agent Harnesses via Effective Feedback Compute28 May 2026
- 2026ZEBRA: Zero-shot Budgeted Resource Allocation for LLM Orchestration19 May 2026
- 2026MEMOA: Massive Mixtures of Online Agents via Mean-Field Decentralized Nash Equilibria6 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025Towards a Science of Scaling Agent Systems
- 2025CostBench: Evaluating Multi-Turn Cost-Optimal Planning and Adaptation in Dynamic Environments for LLM Tool-Use Agents
- 2024Reasoning in Token Economies: Budget-Aware Evaluation of LLM Reasoning Strategies
- 2025The Cost of Dynamic Reasoning: Demystifying AI Agents and Test-Time Scaling from an AI Infrastructure Perspective
- 2026E-Bench: Benchmarking Multi-Step Tool-Use Agents in Real-World Product Scenarios
- 2026From Model Scaling to System Scaling: Scaling the Harness in Agentic AI
- 2025FutureWeaver: Planning Test-Time Compute for Multi-Agent Systems with Modularized Collaboration
- 2026Benchmark Test-Time Scaling of General LLM Agents