mlsanityData to 14 Oct 2026

Tunable Tool-Call Rates in LLM Agents via Representation Steering

arXiv 2608.25198 ↗First posted 25 Aug 2026cs.AIcited by 1

On the map: LLM agents and tool use → Tool learning and function calling

also in 1 more
Abstract (arXiv)

Deciding whether to call a tool is a core competence of an LLM agent, and a costly one to get wrong: needless calls add latency, accrue cost, and may trigger irreversible side effects, while missing calls leave the model confidently wrong on questions it could only answer through tool-calls. Models manage this balance poorly, both over-using and under-using tools. Existing methods such as post-training and prompt engineering are expensive and difficult to modify at inference time. We show that whether an instruction-tuned model calls a tool can be controlled by a single linear direction in its residual stream, extracted without any training from the model's own tool-use preference signal and turned into an inference-time intervention with no prompt change. Adding the direction with strength α moves the call rate monotonically from near 0% to over 90% while keeping calls well-formed. The steering works in both directions: dialing it down suppresses calls, and dialing it up induces new calls that land precisely on the questions the model cannot answer from its own knowledge. We also show that the direction generalizes to unseen tools with strength comparable to each tool's own direction and without favoring any specific tool choice. With live tool execution, a single sweep of the steering traces a cost/accuracy Pareto frontier and nearly doubles open-domain QA accuracy (0.29 ! rightarrow ! 0.56); the same recipe transfers across a diverse range of models spanning dense, MoE, and multimodal architectures, without any training. Our code is publicly available at https://github.com/YuqiChen4188/Steering-Tool-Use-Propensity.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 19 of its 31 references that are in the map. First posted on arXiv 25 Aug 2026.

Builds on

19 of 31 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Tool Calling is Linearly Readable and Steerable in Language Models8 May
  2. 2025SMART: Self-Aware Agent for Tool Overuse Mitigation17 Feb
  3. 2023MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use4 Oct
  4. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs31 Jul
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Tools9 Feb

Other references · 14

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  5. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  6. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  7. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
  8. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  9. 2023Steering Language Models With Activation Engineeringcited by 922
  10. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
  11. 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 455
  12. 2024Programming Refusal with Conditional Activation Steeringcited by 206
2 more
  1. 2023CREATOR: Tool Creation for Disentangling Abstract and Concrete Reasoning of Large Language Modelscited by 93
  2. 2023Toolink: Linking Toolkit Creation and Using through Chain-of-Solving on Open-Source Modelcited by 29

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026ASA: Backbone-Training-Free Representation Engineering for Tool-Calling Agents
  2. 2026LLM Agents Already Know When to Call Tools -- Even Without Reasoning
  3. 2026Tool-Call Dependency Structure is Linearly Decodable in LLM Agent Residual Streams
  4. 2026Are Tools All We Need? Unveiling the Tool-Use Tax in LLM Agents
  5. 2026How Do Agentic LLMs Decide to Call Tools? A Tool-Call Vector Shaped by Suppression
  6. 2026On Effectiveness and Efficiency of Agentic Tool-calling and RL Training
  7. 2026Looking Is Not Picking: An Attention-Segment Account of Tool-Selection Failures in LLM Agents
  8. 2026Toolcompass: Guiding Tool Trialing, Not Suppressing It