ASA: Backbone-Training-Free Representation Engineering for Tool-Calling Agents
On the map: LLM agents and tool use → Tool learning and function calling
also in 1 more
Abstract (arXiv)
Adapting LLM agents to domain-specific tool calling remains notably brittle under evolving interfaces. Prompt and schema engineering is easy to deploy but often fragile under distribution shift and strict parsers, while continual parameter-efficient fine-tuning improves reliability at the cost of training, maintenance, and potential forgetting. We identify a critical Lazy Agent failure mode where tool necessity is nearly perfectly decodable from mid-layer activations, yet the model remains conservative in entering tool mode, revealing a representation-behavior gap. We propose Activation Steering Adapter (ASA), a training-free, inference-time controller that performs a single-shot mid-layer intervention and targets tool domains via a router-conditioned mixture of steering vectors with a probe-guided signed gate to amplify true intent while suppressing spurious triggers. On MTU-Bench with Qwen2.5-1.5B, ASA improves strict tool-use F1 from 0.18 to 0.50 while reducing the false positive rate from 0.15 to 0.05, using only about 20KB of portable assets and no weight updates.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 14 of its 27 references that are in the map. First posted on arXiv 4 Feb 2026.
Builds on
14 of 27 references.
Closest ancestors · 6
Same direction, newest first
- 2025Improving Large Language Models Function Calling and Interpretability via Guided-Structured Templates22 Sep
- 2024NESTFUL: A Benchmark for Evaluating LLMs on Nested Sequences of API Calls4 Sep
- 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Cases8 Jun
- 2023Gorilla: Large Language Model Connected with Massive APIs24 May
- 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMs14 Apr
- 2023Toolformer: Language Models Can Teach Themselves to Use Tools9 Feb
Other references · 8
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2023Steering Language Models With Activation Engineeringcited by 922
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 392
- 2025ToolRL: Reward is All Tool Learning Needscited by 362
- 2024Programming Refusal with Conditional Activation Steeringcited by 206
- 2024Fine-tuning large language models for domain adaptation: Exploration of training strategies, scaling, model merging and synergistic capabilitiescited by 69
- 2024Controlling Large Language Model Agents with Entropic Activation Steeringcited by 29
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Tool Calling is Linearly Readable and Steerable in Language Modelscited by 10
- 2026Model-Adaptive Tool Necessity Reveals the Knowing-Doing Gap in LLM Tool Usecited by 7
- 2026A Few Neurons Reveal When LLMs Misuse Tools: Sparse Detection and Selective Steering for Reliable Tool Usecited by 3
- 2026Decodable but Not Corrected by Fixed Residual-Stream Linear Steering: Evidence from Medical LLM Failure Regimescited by 2
- 2026When Does Correction Become Repair? Mechanistic Auditing of Internal Interventions in Tool-Using LLMscited by 0
- 2026What Can Component-Replacement Evidence Establish? A Critical Scoping Review of Local Decisions in LLM Agentscited by 0
- 2026What Can Component-Replacement Evidence Establish? A Critical Scoping Review of Local Decisions in LLM Agents30 Sep 2026
- 2026When Does Correction Become Repair? Mechanistic Auditing of Internal Interventions in Tool-Using LLMs28 Sep 2026
- 2026A Few Neurons Reveal When LLMs Misuse Tools: Sparse Detection and Selective Steering for Reliable Tool Use31 Jul 2026
- 2026Model-Adaptive Tool Necessity Reveals the Knowing-Doing Gap in LLM Tool Use13 May 2026
- 2026Tool Calling is Linearly Readable and Steerable in Language Models8 May 2026
- 2026Decodable but Not Corrected by Fixed Residual-Stream Linear Steering: Evidence from Medical LLM Failure Regimes7 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Tunable Tool-Call Rates in LLM Agents via Representation Steering
- 2026Are Tools All We Need? Unveiling the Tool-Use Tax in LLM Agents
- 2025Dynamic System Instructions and Tool Exposure for Efficient Agentic LLMs
- 2026LLM Agents Already Know When to Call Tools -- Even Without Reasoning
- 2026Reinforced Agent: Inference-Time Feedback for Tool-Calling Agents
- 2026ToolAtlas: Learning Once, Reusing Everywhere with Tool-Side Memory
- 2025AgentFlux: Decoupled Fine-Tuning & Inference for On-Device Agentic Systems
- 2026Beyond Prompts: Measuring and Optimizing LLM Tool-Agent Harnesses