mlsanityData to 7 Oct 2026

SafeHarness: Lifecycle-Integrated Security Architecture for LLM-based Agent Deployment

arXiv 2604.13630 ↗First posted 15 Apr 2026cs.CR cs.AIcited by 14

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

The performance of large language model (LLM) agents depends critically on the execution harness, the system layer that orchestrates tool use, context management, and state persistence. Yet this same architectural centrality makes the harness a high-value attack surface: a single compromise at the harness level can cascade through the entire execution pipeline. We observe that existing security approaches suffer from structural mismatch, leaving them blind to harness-internal state and unable to coordinate across the different phases of agent operation. In this paper, we introduce safeharness, a security architecture in which four proposed defense layers are woven directly into the agent lifecycle to address above significant limitations: adversarial context filtering at input processing, tiered causal verification at decision making, privilege-separated tool control at action execution, and safe rollback with adaptive degradation at state update. The proposed cross-layer mechanisms tie these layers together, escalating verification rigor, triggering rollbacks, and tightening tool privileges whenever sustained anomalies are detected. We evaluate safeharness on benchmark datasets across diverse harness configurations, comparing against four security baselines under five attack scenarios spanning six threat categories. Compared to the unprotected baseline, safeharness achieves an average reduction of approximately 38% in UBR and 42% in ASR, substantially lowering both the unsafe behavior rate and the attack success rate while preserving core task utility.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 31 of its 47 references that are in the map. First posted on arXiv 15 Apr 2026.

Builds on

31 of 47 references.

Closest ancestors · 14

Same direction, newest first

  1. 2026AgentSentry: Mitigating Indirect Prompt Injection in LLM Agents via Temporal Causal Diagnostics and Context Purification26 Feb
  2. 2026Spider-Sense: Intrinsic Risk Sensing for Efficient Agent Defense with Hierarchical Adaptive Screening5 Feb
  3. 2026AgentDoG: A Diagnostic Guardrail Framework for AI Agent Safety and Security26 Jan
  4. 2025A-MemGuard: A Proactive Defense Framework for LLM-Based Agent Memory29 Sep
  5. 2025Attractive Metadata Attack: Inducing LLM Agents to Invoke Malicious Tools4 Aug
  6. 2025Manipulating LLM Web Agents with Indirect Prompt Injection Attack via HTML Accessibility Tree20 Jul
  7. 2025Design Patterns for Securing LLM Agents against Prompt Injections10 Jun
  8. 2025Think Twice Before You Act: Enhancing Agent Behavioral Safety with Thought Correction16 May
  9. 2025LlamaFirewall: An open source guardrail system for building secure AI agents6 May
  10. 2025AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agents24 Mar
  11. 2025Unveiling Privacy Risks in LLM Agent Memory17 Feb
  12. 2024Agent-SafetyBench: Evaluating the Safety of LLM Agents19 Dec
2 more
  1. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
  2. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandbox25 Sep

Other references · 17

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  4. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  5. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
  6. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
  7. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
  8. 2024Executable Code Actions Elicit Better LLM Agentscited by 537
  9. 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 347
  10. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
  11. 2023Igniting Language Intelligence: The Hitchhiker's Guide From Chain-of-Thought Reasoning to Language Agentscited by 72
  12. 2026AutoHarness: improving LLM agents by automatically synthesizing a code harnesscited by 63
5 more
  1. 2026Natural-Language Agent Harnessescited by 54
  2. 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directionscited by 49
  3. 2024ShieldLM: Empowering LLMs as Aligned, Customizable and Explainable Safety Detectorscited by 48
  4. 2025General Modular Harness for LLM Agents in Multi-Turn Gaming Environmentscited by 9
  5. 2026SWE-Bench Mobile: Can Large Language Model Agents Develop Industry-Level Mobile Applications?cited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 14.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026HarnessRisk: A Lifecycle-Oriented Benchmark for Agent Harness Safety
  2. 2026SafeHarbor: Defining Precise Decision Boundaries via Hierarchical Memory-Augmented Guardrail for LLM Agent Safety
  3. 2026SafeAgent: A Runtime Protection Architecture for Agentic Systems
  4. 2026SecureClaw: Clawing Back Control of LLM Agents
  5. 2026SafeClawBench: Separating Semantic, Audit-Evidence, and Sandbox Harm in Tool-Using LLM Agents
  6. 2025Breaking Agent Backbones: Evaluating the Security of Backbone LLMs in AI Agents
  7. 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation
  8. 2026Taming OpenClaw: Security Analysis and Mitigation of Autonomous LLM Agent Threats