The Causal Impact of Tool Affordance on Safety Alignment in LLM Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
also in 2 more
Abstract (arXiv)
Large language models (LLMs) are increasingly deployed as agents with access to executable tools, enabling direct interaction with external systems. However, most safety evaluations remain text-centric and assume that compliant language implies safe behavior, an assumption that becomes unreliable once models are allowed to act. In this work, we empirically examine how executable tool affordance alters safety alignment in LLM agents using a paired evaluation framework that compares text-only chatbot behavior with tool-enabled agent behavior under identical prompts and policies. Experiments are conducted in a deterministic financial transaction environment with binary safety constraints across 1,500 procedurally generated scenarios. To separate intent from outcome, we distinguish between attempted and realized violations using dual enforcement regimes that either block or permit unsafe actions. Both evaluated models maintain perfect compliance in text-only settings, yet exhibit sharp increases in violations after tool access is introduced, reaching rates up to 85% despite unchanged rules. We observe substantial gaps between attempted and executed violations, indicating that external guardrails can suppress visible harm while masking persistent misalignment. Agents also develop spontaneous constraint circumvention strategies without adversarial prompting. These results demonstrate that tool affordance acts as a primary driver of safety misalignment and that text-based evaluation alone is insufficient for assessing agentic systems.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 17 of its 22 references that are in the map. First posted on arXiv 19 Mar 2026.
Builds on
17 of 22 references.
References · 17
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2024GPT-4o System Cardcited by 4,467
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2016Concrete Problems in AI Safetycited by 1,582
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
5 more
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2022Red Teaming Language Models with Language Modelscited by 983
- 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 702
- 2022The Alignment Problem from a Deep Learning Perspectivecited by 246
- 2022Defining and Characterizing Reward Hackingcited by 184
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026The Capability Paradox: How Smarter Auditors Make Multi-Agent Systems Less Securecited by 2
- 2026RAIL Guard: Closing the Evaluation-to-Remediation Gap in Responsible AI for LLM Agentscited by 0
- 2026Operational Hallucination and Safety Drift in AI Agentscited by 0
- 2026When Tools Get in the Way: The Effect of Unnecessary Tool Availability on LLM Answeringcited by 0
- 2026Tool Mediation Alters Refusal Mechanisms in Large Language Modelscited by 0
- 2026A Competing-Hazards Systematization of Loss of Control in Autonomous Agentscited by 0
- 2026A Competing-Hazards Systematization of Loss of Control in Autonomous Agents29 Sep 2026
- 2026Tool Mediation Alters Refusal Mechanisms in Large Language Models28 Sep 2026
- 2026When Tools Get in the Way: The Effect of Unnecessary Tool Availability on LLM Answering12 Sep 2026
- 2026Operational Hallucination and Safety Drift in AI Agents20 Jul 2026
- 2026RAIL Guard: Closing the Evaluation-to-Remediation Gap in Responsible AI for LLM Agents28 May 2026
- 2026The Capability Paradox: How Smarter Auditors Make Multi-Agent Systems Less Secure17 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Mind the GAP: Text Safety Does Not Transfer to Tool-Call Safety in LLM Agents
- 2025AgentAlign: Navigating Safety Alignment in the Shift from Informative to Agentic Large Language Models
- 2026AgentBoundary: Counterfactual Evaluation of Safety in Tool-Using LLM Agents
- 2025Agent Safety Alignment via Reinforcement Learning
- 2025ManagerBench: Evaluating the Safety-Pragmatism Trade-off in Autonomous LLMs
- 2026Delegated Misalignment: How Multi-Agent Structures Amplify LLM Safety Risks
- 2026The Cold-Start Safety Gap in LLM Agents
- 2025Beyond Reactive Safety: Risk-Aware LLM Alignment via Long-Horizon Simulation