mlsanityData to 14 Oct 2026

Test-time reasoning effort and unauthorized tool use in language-model agents: a prespecified equivalence study

arXiv 2608.03169 ↗First posted 4 Aug 2026cs.CR cs.SEcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Language-model agents that execute multi-step workflows through tool calls operate under access-control policies that restrict which operations each role may perform. The APIs serving these agents expose a reasoning-effort parameter that operators adjust for cost and latency. Whether this parameter also changes the rate of unauthorized tool use has not been tested by direct manipulation within a single model. We vary reasoning effort (low, max) inside GPT-5.6 across the 14 confirmatory scenarios of TRIO-20, a suite of 20 matched workplace triads in which a policy-prohibited tool call is effective and its effect on the target metric is stated in the environment, effective but discoverable only through rule inspection, or ineffective. The three conditions derive from one code base and differ in two configuration fields, with identical prompts and tool sets. All analyses were prespecified in a frozen plan before confirmatory collection. Across 840 trajectories and two model tiers, no unauthorized tool call occurred. Exact one-sided 95% limits place each arm's violation rate below 3.50% (Terra, n = 84) and 5.21% (Sol, n = 56). The interaction estimand, with a simultaneous exact 95% interval of ± 4.34 percentage points on Terra, lies inside the ± 7.01-point equivalence margin. Raising effort did change behaviour, but only in inspection: rule-probe rates rose in all conditions, most where probing carried no instrumental payoff, a pattern inconsistent with the hypothesis of targeted search (-14.3 points, 95% CI -27.4 to +1.2). Raw trajectories are released at https://github.com/WenJing95/trio-20.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 3 of its 10 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

3 of 10 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Benchmark Test-Time Scaling of General LLM Agents22 Feb

Other references · 2

  1. 2025The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Taskscited by 152
  2. 2025Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Modelscited by 36

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Loud Failures, Quiet Failures: Fault Detection and Recovery in Tool-Using Language Model Agents
  2. 2026ChromaFlow: A Negative Ablation Study of Orchestration Overhead in Tool-Augmented Agent Evaluation
  3. 2026LLM Agents Already Know When to Call Tools -- Even Without Reasoning
  4. 2026AgentBoundary: Counterfactual Evaluation of Safety in Tool-Using LLM Agents
  5. 2026Model-Adaptive Tool Necessity Reveals the Knowing-Doing Gap in LLM Tool Use
  6. 2026AgentProcessBench: Diagnosing Step-Level Process Quality in Tool-Using Agents
  7. 2025Tool Preferences in Agentic LLMs are Unreliable
  8. 2026Beyond the Leaderboard: A Synthesis of Tool-Use, Planning, and Reasoning Failures in Large Language Model Agents