mlsanityData to 7 Oct 2026

The Causal Impact of Tool Affordance on Safety Alignment in LLM Agents

arXiv 2603.20320 ↗First posted 19 Mar 2026cs.SE cs.AI cs.LGcited by 6

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 2 more
Abstract (arXiv)

Large language models (LLMs) are increasingly deployed as agents with access to executable tools, enabling direct interaction with external systems. However, most safety evaluations remain text-centric and assume that compliant language implies safe behavior, an assumption that becomes unreliable once models are allowed to act. In this work, we empirically examine how executable tool affordance alters safety alignment in LLM agents using a paired evaluation framework that compares text-only chatbot behavior with tool-enabled agent behavior under identical prompts and policies. Experiments are conducted in a deterministic financial transaction environment with binary safety constraints across 1,500 procedurally generated scenarios. To separate intent from outcome, we distinguish between attempted and realized violations using dual enforcement regimes that either block or permit unsafe actions. Both evaluated models maintain perfect compliance in text-only settings, yet exhibit sharp increases in violations after tool access is introduced, reaching rates up to 85% despite unchanged rules. We observe substantial gaps between attempted and executed violations, indicating that external guardrails can suppress visible harm while masking persistent misalignment. Agents also develop spontaneous constraint circumvention strategies without adversarial prompting. These results demonstrate that tool affordance acts as a primary driver of safety misalignment and that text-based evaluation alone is insufficient for assessing agentic systems.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 17 of its 22 references that are in the map. First posted on arXiv 19 Mar 2026.

Builds on

17 of 22 references.

References · 17

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  5. 2024GPT-4o System Cardcited by 4,467
  6. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  7. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  8. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  9. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  10. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  11. 2016Concrete Problems in AI Safetycited by 1,582
  12. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
5 more
  1. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  2. 2022Red Teaming Language Models with Language Modelscited by 983
  3. 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 702
  4. 2022The Alignment Problem from a Deep Learning Perspectivecited by 246
  5. 2022Defining and Characterizing Reward Hackingcited by 184

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Mind the GAP: Text Safety Does Not Transfer to Tool-Call Safety in LLM Agents
  2. 2025AgentAlign: Navigating Safety Alignment in the Shift from Informative to Agentic Large Language Models
  3. 2026AgentBoundary: Counterfactual Evaluation of Safety in Tool-Using LLM Agents
  4. 2025Agent Safety Alignment via Reinforcement Learning
  5. 2025ManagerBench: Evaluating the Safety-Pragmatism Trade-off in Autonomous LLMs
  6. 2026Delegated Misalignment: How Multi-Agent Structures Amplify LLM Safety Risks
  7. 2026The Cold-Start Safety Gap in LLM Agents
  8. 2025Beyond Reactive Safety: Risk-Aware LLM Alignment via Long-Horizon Simulation