mlsanityData to 14 Oct 2026

Constraint Tax in Open-Weight LLMs: An Empirical Study of Tool Calling Suppression Under Structured Output Constraints

arXiv 2606.25605 ↗First posted 24 Jun 2026cs.CLcited by 3

On the map: LLM agents and tool use → Tool learning and function calling

Abstract (arXiv)

Tool Calling and Structured Output are two core capabilities of modern Agent systems, yet their interaction under joint deployment conditions remains insufficiently understood. This paper reports a reproducible phenomenon observed in a production Agent system: when Tool Calling and JSON Schema constraints are simultaneously enabled, multiple open-weight models cease invoking tools despite maintaining high schema compliance. We refer to this behavior as Tool Suppression. Through controlled experiments across multiple model families and deployment settings, we consistently reproduce Tool Suppression under joint constraints, while tool execution and schema compliance remain functional when evaluated independently. Further analysis reveals that JSON Schema constraints are compiled into grammar-based token masks, causing tool-call tokens to become unreachable during decoding. This provides an implementation-level explanation for the observed behavior. To interpret the phenomenon, we formulate the Constraint Priority Inversion (CPI) hypothesis, which suggests that schema satisfaction may dominate action-selection behavior under multiple simultaneous constraints. We present CPI as a behavioral hypothesis consistent with the observed evidence rather than a verified internal mechanism. To mitigate the problem, we propose Transparent Two-Pass Execution, an inference-time strategy that decouples tool execution from schema-constrained response generation. Experimental results show that this approach restores tool invocation while preserving structured output guarantees without requiring model retraining. These findings suggest that evaluating tool use and structured output separately may overlook important reliability issues in production Agent systems. Code, data, and docs will be released at https://github.com/Fzsama/Constrain-Tax-26-06.git.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 12 of its 14 references that are in the map. First posted on arXiv 24 Jun 2026.

Builds on

12 of 14 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Tool Learning with Foundation Models17 Apr
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Tools9 Feb

Other references · 10

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  3. 2024Small LLMs Are Weak Tool Learners: A Multi-LLM Agentcited by 93
  4. 2024Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language Models as Agentscited by 50
  5. 2024"We Need Structured Output": Towards User-centered Constraints on Large Language Model Outputcited by 46
  6. 2022Why is constrained neural language generation particularly challenging?cited by 19
  7. 2025DINGO: Constrained Inference for Diffusion LLMscited by 16
  8. 2025Decoupling Task-Solving and Output Formatting in LLM Generationcited by 9
  9. 2026W&D:Scaling Parallel Tool Calling for Efficient Deep Research Agentscited by 5
  10. 2026The Constraint Tax: Measuring Validity-Correctness Tradeoffs in Structured Outputs for Small Language Modelscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026How Consistent Are LLM Agents? Measuring Behavioral Reproducibility in Multi-Step Tool-Calling Pipelines
  2. 2026Callability Is Not Operability: Controlled Interface Interventions for LLM Agents
  3. 2026Action-Space Shaping for LLM Agents: Measuring and Mitigating Tool-Schema Bias
  4. 2026The Evolution of Tool Use in LLM Agents: From Single-Tool Call to Multi-Tool Orchestration
  5. 2026Robust and Efficient Tool Orchestration via Layered Execution Structures with Reflective Correction
  6. 2026Schema First Tool APIs for LLM Agents: A Controlled Study of Tool Misuse, Recovery, and Budgeted Performance
  7. 2026LLM Agents Already Know When to Call Tools -- Even Without Reasoning
  8. 2026PeakBench: Benchmarking Resource-Aware Tool Invocation in LLM Agents