AgentDoG 1.5: A Lightweight and Scalable Alignment Framework for AI Agent Safety and Security
On the map: LLM agents and tool use → Agent threats, guardrails and governance
also in 1 more
Abstract (arXiv)
Modern open-world agents such as OpenClaw exhibit powerful cross-environment execution capabilities yet introduce broad new safety risk sources. Meanwhile, advanced frontier AI models drastically lower attack barriers, rendering current agent alignment frameworks inadequate for real-world deployment. To tackle these emerging threats, we propose a lightweight and scalable agent safety alignment framework. Specifically, we update the agent safety taxonomy to accommodate emergent risks from Codex and OpenClaw execution scenarios. We further build a taxonomy-guided data engine with influence-function purification to train lightweight AgentDoG 1.5 variants (0.8B, 2B, 4B, and 8B parameters) using only around 1k samples, achieving comparable performance with leading closed-source models (e.g., GPT-5.4). Based on AgentDoG 1.5, we construct a highly efficient agentic safety SFT and RL training environment, which reduces deployment overhead in Docker-level environments by two orders of magnitude. Finally, we deploy AgentDoG 1.5 as a training-free online guardrail for real-time safety moderation. Extensive experimental results indicate that AgentDoG 1.5 achieves state-of-the-art performance in diverse and complex interactive agentic scenarios. All models and datasets are openly released.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 61 of its 90 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
61 of 90 references.
Closest ancestors · 23
Same direction, newest first
- 2026AgentHazard: A Benchmark for Evaluating Harmful Behavior in Computer-Use Agents3 Apr
- 2026ATBench: A Diverse and Realistic Agent Trajectory Benchmark for Safety Evaluation and Diagnosis2 Apr
- 2026ClawSafety: "Safe" LLMs, Unsafe Agents1 Apr
- 2026Taming OpenClaw: Security Analysis and Mitigation of Autonomous LLM Agent Threats12 Mar
- 2026The Attack and Defense Landscape of Agentic AI: A Comprehensive Survey11 Mar
- 2026AgentDoG: A Diagnostic Guardrail Framework for AI Agent Safety and Security26 Jan
- 2026ToolSafe: Enhancing Tool Invocation Safety of LLM-based agents via Proactive Step-level Guardrail and Feedback15 Jan
- 2025A Safety and Security Framework for Real-World Agentic Systems27 Nov
- 2025Building a Foundational Guardrail for General Agentic Systems via Synthetic Data10 Oct
- 2025AgenticEval: Toward Agentic and Self-Evolving Safety Evaluation of Large Language Models30 Sep
- 2025OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents17 Jun
- 2025RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agents31 May
11 more
- 2025AgentAlign: Navigating Safety Alignment in the Shift from Informative to Agentic Large Language Models29 May
- 2025Securing Agentic AI: A Comprehensive Threat Model and Mitigation Framework for Generative AI Agents28 Apr
- 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deployment22 Apr
- 2025SafeArena: Evaluating the Safety of Autonomous Web Agents6 Mar
- 2025AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection17 Feb
- 2024Agent-SafetyBench: Evaluating the Safety of LLM Agents19 Dec
- 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents11 Oct
- 2024AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents19 Jun
- 2024Security of AI Agents12 Jun
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar
- 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agents18 Jan
Other references · 38
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2025Group Sequence Policy Optimizationcited by 835
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
- 2025Kimi K2: Open Agentic Intelligencecited by 567
- 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 393
- 2024Agent Workflow Memorycited by 383
- 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 286
26 more
- 2024ToolACE: Winning the Points of LLM Function Callingcited by 216
- 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 193
- 2025Qwen3Guard Technical Reportcited by 155
- 2024ToolSword: Unveiling Safety Issues of Large Language Models in Tool Learning Across Three Stagescited by 82
- 2026Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learningcited by 66
- 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 63
- 2026AgentDyn: Are Your Agent Security Defenses Deployable in Real-World Dynamic Environments?cited by 59
- 2025Simulating Environments with Reasoning Models for Agent Trainingcited by 57
- 2024Operationalizing a Threat Model for Red-Teaming Large Language Models (LLMs)cited by 46
- 2025Scaling Agent Learning via Experience Synthesiscited by 44
- 2025GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulatorscited by 42
- 2025SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMscited by 22
- 2026From Self-Evolving Synthetic Data to Verifiable-Reward RL: Post-Training Multi-turn Interactive Tool-Using Agentscited by 21
- 2026ClawKeeper: Comprehensive Safety Protection for OpenClaw Agents Through Skills, Plugins, and Watcherscited by 20
- 2024SciKnowEval: Evaluating Multi-level Scientific Knowledge of Large Language Modelscited by 19
- 2025AutoForge: Automated Environment Synthesis for Agentic Reinforcement Learningcited by 17
- 2025Are Your Agents Upward Deceivers?cited by 16
- 2025Domain-RAG: Retrieval-Guided Compositional Image Generation for Cross-Domain Few-Shot Object Detectioncited by 15
- 2025Poly-Guard: Massive Multi-Domain Safety Policy-Grounded Guardrail Datasetcited by 14
- 2026DecodingTrust-Agent Platform (DTap): A Controllable and Interactive Red-Teaming Platform for AI Agentscited by 13
- 2025Close the Loop: Synthesizing Infinite Tool-Use Data via Multi-Agent Role-Playingcited by 9
- 2025TURA: Tool-Augmented Unified Retrieval Agent for AI Searchcited by 6
- 2026Benchmarks for Trajectory Safety Evaluation and Diagnosis in OpenClaw and Codex: ATBench-Claw and ATBench-Codexcited by 6
- 2026AgentCE-Bench: Agent Configurable Evaluation with Scalable Horizons and Controllable Difficulty under Lightweight Environmentscited by 3
- 2026DeepSight: An All-in-One LM Safety Toolkitcited by 2
- 2026PRISM: Preference-Aware Influence Function Based Data Selection Method for Efficient Fine-Tuningcited by 1
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Safety Testing LLM Agents at Scale: From Risk Discovery to Evidence-Grounded Verificationcited by 7
- 2026StepGuard: Learning Step-Level Guardrails with Scalable Supervision and Safety-Utility Balancingcited by 6
- 2026SafeEvolve: Harness-Policy Co-Evolution from Agent Experience for Safety Alignmentcited by 6
- 2026SingGuard-NSFA: Extensible Guardrails for Agentic AI via Generative Reasoning and Real-Time Classificationcited by 2
- 2026SafeCoEvo: Co-Evolving Safety Harnesses and Guards for LLM Agents at Test-Timecited by 1
- 2026RePolicy: Reinforcement Learning for Safety-Policy Invocation in Agent Safeguardscited by 0
- 2026HazardAuditor: From Executable Threats to Safer Computer-Use Agentscited by 0
- 2026Safe Actions Alone Do Not Ensure Safe Agents: Identifying Unfulfilled Obligations with Guard Modelscited by 0
- 2026Safe Actions Alone Do Not Ensure Safe Agents: Identifying Unfulfilled Obligations with Guard Models8 Oct 2026
- 2026SafeCoEvo: Co-Evolving Safety Harnesses and Guards for LLM Agents at Test-Time29 Sep 2026
- 2026HazardAuditor: From Executable Threats to Safer Computer-Use Agents14 Sep 2026
- 2026SafeEvolve: Harness-Policy Co-Evolution from Agent Experience for Safety Alignment2 Sep 2026
- 2026StepGuard: Learning Step-Level Guardrails with Scalable Supervision and Safety-Utility Balancing25 Aug 2026
- 2026RePolicy: Reinforcement Learning for Safety-Policy Invocation in Agent Safeguards25 Aug 2026
- 2026SingGuard-NSFA: Extensible Guardrails for Agentic AI via Generative Reasoning and Real-Time Classification13 Jul 2026
- 2026Safety Testing LLM Agents at Scale: From Risk Discovery to Evidence-Grounded Verification2 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026AgentWall: A Runtime Safety Layer for Local AI Agents
- 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safety
- 2026SafeAgent: A Runtime Protection Architecture for Agentic Systems
- 2026A Security Analysis of the OpenClaw AI Agent Framework
- 2026Uncovering Security Threats and Architecting Defenses in Autonomous Agents: A Case Study of OpenClaw
- 2026Securing the AI Agent: A Unified Framework for Multi-Layer Agent Red Teaming
- 2026Security Attack and Defense Strategies for Autonomous Agent Frameworks: A Layered Review with OpenClaw as a Case Study
- 2026OpenAgentFlow: Enabling System-Wide Safety Boundaries for Heterogeneous AI Agent Fleets