mlsanityData to 7 Oct 2026

Budget-Aware Tool Use Enables Effective Agent Scaling

arXiv 2511.17006 ↗First posted 21 Nov 2025cs.AIcited by 42

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Scaling test-time computation has been extended from language model reasoning to tool-augmented agents, where scaling involves not only thinking in tokens but also acting via tool calls that directly constrain environmental interaction. However, we found that simply increasing the tool-call budget fails to improve performance, as agents lack "budget awareness" and quickly hit a performance ceiling. We study how to scale such agents effectively under explicit tool-call budgets, focusing on web search agents. We first introduce the Budget Tracker, a lightweight plug-in that provides the agent with continuous budget awareness, enabling simple yet effective scaling. We further develop BATS (Budget-Aware Test-time Scaling), an advanced framework that leverages this awareness to dynamically adapt its planning and verification strategy. To analyze cost-performance scaling in a controlled manner, we formalize a unified cost metric that jointly accounts for token and tool consumption. We provide the first systematic study on budget-constrained agents, showing that budget-aware methods produce more favorable scaling curves and push the cost-performance Pareto frontier. Our work offers empirical insights toward a more transparent and principled understanding of scaling in tool-augmented agents. Our code is available at https://github.com/google-research/budget-aware-agent.

Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 48 of its 62 references that are in the map. First posted on arXiv 21 Nov 2025.

Builds on

48 of 62 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025MiroThinker: Pushing the Performance Boundaries of Open-Source Research Agents via Model, Context, and Interactive Scaling14 Nov
  2. 2025Chain-of-Agents: End-to-End Agent Foundation Models via Multi-Agent Distillation and Agentic RL6 Aug
  3. 2025AgentTTS: Large Language Model Agent for Test-time Compute-optimal Scaling Strategy in Complex Tasks26 Jul
  4. 2025WebSailor: Navigating Super-human Reasoning for Web Agent3 Jul
  5. 2025Thinking vs. Doing: Agents that Reason by Scaling Test-Time Interaction9 Jun

Other references · 43

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  3. 2024GPT-4o System Cardcited by 4,467
  4. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  5. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  6. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  7. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  8. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
  9. 2025s1: Simple test-time scalingcited by 1,311
  10. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
  11. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
  12. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
31 more
  1. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  2. 2025Kimi K2: Open Agentic Intelligencecited by 523
  3. 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 423
  4. 2024Inference Scaling Laws: An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language Modelscited by 282
  5. 2024Token-Budget-Aware LLM Reasoningcited by 242
  6. 2023ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddingscited by 238
  7. 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agentcited by 183
  8. 2025WebDancer: Towards Autonomous Information Seeking Agencycited by 180
  9. 2025Beyond Ten Turns: Unlocking Long-Horizon Agentic Search with Large-Scale Asynchronous RLcited by 144
  10. 2025BrowseComp-ZH: Benchmarking Web Browsing Ability of Large Language Models in Chinesecited by 139
  11. 2024From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Modelscited by 136
  12. 2025WebShaper: Agentically Data Synthesizing via Information-Seeking Formalizationcited by 118
  13. 2024Concise Thoughts: Impact of Output Length on LLM Reasoning and Costcited by 108
  14. 2024Escape Sky-high Cost: Early-stopping Self-Consistency for Multi-step Reasoningcited by 105
  15. 2025AgentFold: Long-Horizon Web Agents with Proactive Context Managementcited by 95
  16. 2023Cumulative Reasoning with Large Language Modelscited by 94
  17. 2025WebExplorer: Explore and Evolve for Training Long-Horizon Web Agentscited by 86
  18. 2024Learning How Hard to Think: Input-Adaptive Allocation of LM Computationcited by 67
  19. 2025WideSearch: Benchmarking Agentic Broad Info-Seekingcited by 66
  20. 2025WebResearcher: Unleashing unbounded reasoning capability in Long-Horizon Agentscited by 66
  21. 2024Reasoning Aware Self-Consistency: Leveraging Reasoning Paths for Efficient LLM Samplingcited by 63
  22. 2025Scaling Test-time Compute for LLM Agentscited by 59
  23. 2025SETS: Leveraging Self-Verification and Self-Correction for Improved Test-Time Scalingcited by 54
  24. 2025THOUGHTTERMINATOR: Benchmarking, Calibrating, and Mitigating Overthinking in Reasoning Modelscited by 34
  25. 2025Efficient Agents: Building Effective Agents While Reducing Costcited by 32
  26. 2025OAgents: An Empirical Study of Building Effective Agentscited by 28
  27. 2025Flash-Searcher: Fast and Effective Web Agents via DAG-Based Parallel Executioncited by 27
  28. 2025Do We Truly Need So Many Samples? Multi-LLM Repeated Sampling Efficiently Scales Test-Time Computecited by 20
  29. 2025BrowseMaster: Towards Scalable Web Browsing via Tool-Augmented Programmatic Agent Paircited by 16
  30. 2025A Simple "Try Again" Can Elicit Multi-Turn LLM Reasoningcited by 11
  31. 2025Lost in the Maze: Overcoming Context Limitations in Long-Horizon Agentic Searchcited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 42.

42 papers.

Sort:

By area:

  1. 2026How Do AI Agents Spend Your Money? Analyzing and Predicting Token Consumption in Agentic Coding Taskscited by 28
  2. 2026MARS: Modular Agent with Reflective Search for Automated AI Researchcited by 22
  3. 2026SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Trainingcited by 18
  4. 2026Calibrate-Then-Act: Cost-Aware Exploration in LLM Agentscited by 16
  5. 2026Toward Efficient Agents: Memory, Tool learning, and Planningcited by 11
  6. 2026Spend Less, Reason Better: Budget-Aware Value Tree Search for LLM Agentscited by 10
  7. 2026Thinking with Map: Reinforced Parallel Map-Augmented Agent for Geolocalizationcited by 8
  8. 2026Budget-Constrained Agentic Large Language Models: Intention-Based Planning for Costly Tool Usecited by 8
  9. 2026To Call or Not to Call: A Framework to Assess and Optimize LLM Tool Callingcited by 7
  10. 2026Timely Machine: Awareness of Time Makes Test-Time Scaling Agenticcited by 5
  11. 2026Table-as-Search: Formulate Long-Horizon Agentic Information Seeking as Table Completioncited by 5
  12. 2026What If We Allocate Test-Time Compute Adaptively?cited by 4
30 more
  1. 2026TAPE: Tool-Guided Adaptive Planning and Constrained Execution in Language Model Agentscited by 4
  2. 2026Aligning Tree-Search Policies with Fixed Token Budgets in Test-Time Scaling of LLMscited by 3
  3. 2026On Time, Within Budget: Constraint-Driven Online Resource Allocation for Agentic Workflowscited by 3
  4. 2026Why Retrying Fails: Context Contamination in LLM Agent Pipelinescited by 3
  5. 2026AllocBench: Measuring Online Tool Allocation Capability in LLM Agentscited by 2
  6. 2026Scores Are Not Decisions: Cost-Aware Stopping for Tool Acquisition in LLM Agentscited by 2
  7. 2026Quantifying Overclaiming Propensity in Frontier LLM Agentscited by 2
  8. 2026AdaTIR: Adaptive Tool-Integrated Reasoning via Difficulty-Aware Policy Optimizationcited by 1
  9. 2026The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Projectcited by 1
  10. 2026ZEBRA: Zero-shot Budgeted Resource Allocation for LLM Orchestrationcited by 1
  11. 2026Scaling Laws for Agent Harnesses via Effective Feedback Computecited by 1
  12. 2026Cache-Aware Prompt Compression:A Two-Tier Cost Model for LLM API Cachingcited by 1
  13. 2026SpatialCLI: Learning to Reason With Spatial Tools, Then Without Themcited by 1
  14. 2026Cost-Utility Alignment in LLM Agent Trajectories:Profiling,Attribution,Diagnosis,Adaptation,and Evaluationcited by 1
  15. 2026One Policy, Any Budget: Internalizing Budget-Aware Search via Reinforcement Learningcited by 1
  16. 2026Lookahead-R: Budget-Aware Tool Retrieval via Execution-Centric Planningcited by 1
  17. 2026Agents Learn Their Runtime: Interpreter Persistence as Training-Time Semanticscited by 0
  18. 2026MEMOA: Massive Mixtures of Online Agents via Mean-Field Decentralized Nash Equilibriacited by 0
  19. 2026When Does Restricting a Coding Agent to executecode Help? A Regime × Agent-Design Ablationcited by 0
  20. 2026NELSSA: A GPU-PNM Heterogeneous System for Mixed-Length LLM Serving via Length-based Request Placementcited by 0
  21. 2026Budget-Aware LLM Discovery via Cost-Calibrated Frontier Utilitycited by 0
  22. 2026R3-Bench: LLMs Struggle with Resource-Rational Reasoning under Shared Budgetscited by 0
  23. 2026Elastic Horizon: Discovering the Effective Interaction Frontier in Agentic Reinforcement Learningcited by 0
  24. 2026PrimeScientist: Strategic Allocation of Research Effort in Autonomous Researchcited by 0
  25. 2026Toolcompass: Guiding Tool Trialing, Not Suppressing Itcited by 0
  26. 2026RECLAIM: Can Agents Reproduce the Claims of Machine Learning Papers?cited by 0
  27. 2026Coding Agents Aren't Enough! Evaluating an Enterprise Security Brain for Agentic Cloud Investigationscited by 0
  28. 2026Analyzing and Mitigating Cost-Inefficient Behaviors in Coding Agentscited by 0
  29. 2026When Should Agents Check External State? Budgeting Observations for Stored Intentionscited by 0
  30. 2026AgentTime: Can Agents Estimate and Control Their Own Runtime?cited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards a Science of Scaling Agent Systems
  2. 2025CostBench: Evaluating Multi-Turn Cost-Optimal Planning and Adaptation in Dynamic Environments for LLM Tool-Use Agents
  3. 2024Reasoning in Token Economies: Budget-Aware Evaluation of LLM Reasoning Strategies
  4. 2025The Cost of Dynamic Reasoning: Demystifying AI Agents and Test-Time Scaling from an AI Infrastructure Perspective
  5. 2026E-Bench: Benchmarking Multi-Step Tool-Use Agents in Real-World Product Scenarios
  6. 2026From Model Scaling to System Scaling: Scaling the Harness in Agentic AI
  7. 2025FutureWeaver: Planning Test-Time Compute for Multi-Agent Systems with Modularized Collaboration
  8. 2026Benchmark Test-Time Scaling of General LLM Agents