How Do Agentic LLMs Decide to Call Tools? A Tool-Call Vector Shaped by Suppression
On the map: LLM agents and tool use → Tool learning and function calling
Abstract (arXiv)
Tool calling, invoking external tools on demand, is central to agentic LLMs, yet the mechanism that decides whether a model calls a tool or responds directly remains poorly understood. Agentic prompts are long and heavily scaffolded, combining role instructions, tool schemas, format templates, and the user's request across hundreds of tokens, creating a noisy, highly entangled context in which no single controllable variable for mechanistic analysis is obvious. To obtain such a variable, we propose a method that converts complex agentic prompts into minimal contrastive pairs in which a single request verb determines the tool-call decision: replacing an execution-verb (e.g., textitwrite) with an analysis-verb (e.g., textitdiscuss) reliably flips the decision, suggesting it is mediated by a compact internal state. We construct 500 such paired prompts across Python, Java, and C++ (300 for mechanistic analysis, 200 held out for evaluation). We trace the decision to a vector, μ_Delta, that is both causally necessary and sufficient and generalizes beyond the discovery prompts to native multi-turn τ2-Bench trajectories and verb-free requests. Behavioral ablations show that the scaffold establishes a tool-call prior; Transcoder decomposition then reveals that analysis verbs suppress this prior through features signaling that tool use is unnecessary, whereas execution verbs largely leave it intact. Downstream scaffold-reading attention heads and MLP features read out the resulting state, and the same mechanism recurs across seven models from the Qwen, Mistral, and Granite families. Our code is available at https://github.com/XijieGo/MI4ToolCalling.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 29 of its 57 references that are in the map. First posted on arXiv 7 Oct 2026.
Builds on
29 of 57 references.
Closest ancestors · 4
Same direction, newest first
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs31 Jul
- 2023Gorilla: Large Language Model Connected with Massive APIs24 May
- 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMs14 Apr
- 2023Toolformer: Language Models Can Teach Themselves to Use Tools9 Feb
Other references · 25
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,130
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
- 2023Steering Language Models With Activation Engineeringcited by 824
13 more
- 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 579
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
- 2024Scaling and evaluating sparse autoencoderscited by 530
- 2023Dissecting Recall of Factual Associations in Auto-Regressive Language Modelscited by 512
- 2024Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Modelscited by 412
- 2023Attribution Patching Outperforms Automated Circuit Discoverycited by 196
- 2024How to use and interpret activation patchingcited by 191
- 2024Transcoders Find Interpretable LLM Feature Circuitscited by 186
- 2024Have Faith in Faithfulness: Going Beyond Circuit Overlap When Finding Model Mechanismscited by 144
- 2025AGENTIF: Benchmarking Instruction Following of Large Language Models in Agentic Scenarioscited by 44
- 2025Understanding and Mitigating Cross-lingual Privacy Leakage via Language-specific and Universal Privacy Neuronscited by 13
- 2026Latent Planning Emerges with Scalecited by 5
- 2026Global Evolutionary Steering: Refining Activation Steering Control via Cross-Layer Consistencycited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LLM Agents Already Know When to Call Tools -- Even Without Reasoning
- 2026Tunable Tool-Call Rates in LLM Agents via Representation Steering
- 2025Tool Preferences in Agentic LLMs are Unreliable
- 2026Toward SLM-based agentic task-tool intent matching
- 2026Closed-World Resolution Against Tool Hallucination in LLM Agents
- 2026ToolRobustBench: Stage-Wise Perturbation Evaluation and Failure Diagnosis for Tool-Calling Agents
- 2026Action-Space Shaping for LLM Agents: Measuring and Mitigating Tool-Schema Bias
- 2026On Effectiveness and Efficiency of Agentic Tool-calling and RL Training