QuadSentinel: Sequent Safety for Machine-Checkable Control in Multi-agent Systems
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Safety risks arise as large language model-based agents solve complex tasks with tools, multi-step plans, and inter-agent messages. However, deployer-written policies in natural language are ambiguous and context dependent, so they map poorly to machine-checkable rules, and runtime enforcement is unreliable. Expressing safety policies as sequents, we propose textscQuadSentinel, a four-agent guard (state tracker, policy verifier, threat watcher, and referee) that compiles these policies into machine-checkable rules built from predicates over observable state and enforces them online. Referee logic plus an efficient top-k predicate updater keeps costs low by prioritizing checks and resolving conflicts hierarchically. Measured on ST-WebAgentBench (ICML CUA~'25) and AgentHarm (ICLR~'25), textscQuadSentinel improves guardrail accuracy and rule recall while reducing false positives. Against single-agent baselines such as ShieldAgent (ICML~'25), it yields better overall safety control. Near-term deployments can adopt this pattern without modifying core agents by keeping policies separate and machine-checkable. Our code will be made publicly available at https://github.com/yyiliu/QuadSentinel.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 40 of its 54 references that are in the map. First posted on arXiv 18 Dec 2025.
Builds on
40 of 54 references.
Closest ancestors · 10
Same direction, newest first
- 2025ShieldAgent: Shielding Agents via Verifiable Safety Policy Reasoning26 Mar
- 2024RedCode: Risky Code Execution and Generation Benchmark for Code Agents12 Nov
- 2024Attacking Vision-Language Computer Agents via Pop-ups4 Nov
- 2024Imprompter: Tricking LLM Agents into Improper Tool Use19 Oct
- 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents11 Oct
- 2024ST-WebAgentBench: A Benchmark for Evaluating Safety and Trustworthiness in Web Agents9 Oct
- 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakage17 Sep
- 2024Breaking Agents: Compromising Autonomous LLM Agents Through Malfunction Amplification30 Jul
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
- 2024Dissecting Adversarial Robustness of Multimodal LM Agents18 Jun
Other references · 30
- 2017Attention Is All You Needcited by 60,361
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 563
- 2022Efficiently Scaling Transformer Inferencecited by 539
- 2024Agent Workflow Memorycited by 383
- 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 365
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 356
18 more
- 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 232
- 2022A New Generation of Perspective API: Efficient Multilingual Character-level Transformerscited by 185
- 2023MasterKey: Automated Jailbreak Across Multiple Large Language Model Chatbotscited by 183
- 2023A Language Agent for Autonomous Drivingcited by 164
- 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Designcited by 164
- 2024EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Recordscited by 78
- 2024RigorLLM: Resilient Guardrails for Large Language Models against Undesired Contentcited by 68
- 2024SelfDefend: LLMs Can Defend Themselves against Jailbreaking in a Practical Mannercited by 63
- 2023nl2spec: Interactively Translating Unstructured Natural Language to Temporal Logics with Large Language Modelscited by 60
- 2023Can Large Language Models Transform Natural Language Intent into Formal Method Postconditions?cited by 57
- 2023Scalable AI Safety via Doubly-Efficient Debatecited by 57
- 2025JBShield: Defending Large Language Models from Jailbreak Attacks through Activated Concept Analysis and Manipulationcited by 54
- 2023SurrealDriver: Designing LLM-powered Generative Driver Agent Framework based on Human Drivers' Driving-thinking Datacited by 24
- 2025Equilibrate RLHF: Towards Balancing Helpfulness-Safety Trade-off in Large Language Modelscited by 22
- 2024PAPILLON: Efficient and Stealthy Fuzz Testing-Powered Jailbreaks for LLMscited by 21
- 2024RapGuard: Safeguarding Multimodal Large Language Models via Rationale-aware Defensive Promptingcited by 19
- 2025TwinBreak: Jailbreaking LLM Security Alignments based on Twin Promptscited by 19
- 2025MSR-Align: Policy-Grounded Multimodal Alignment for Safety-Aware Reasoning in Vision-Language Modelscited by 7
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Inference-Time Scaling of Verification: Self-Evolving Deep Research Agents via Test-Time Rubric-Guided Verificationcited by 22
- 2026Options, Not Clicks: Lattice Refinement for Consent-Driven MCP Authorizationcited by 5
- 2026SingGuard-NSFA: Extensible Guardrails for Agentic AI via Generative Reasoning and Real-Time Classificationcited by 2
- 2026Neuro-Symbolic Agents for Regulated Process Automation: Challenges and Research Agendacited by 0
- 2026SingGuard-NSFA: Extensible Guardrails for Agentic AI via Generative Reasoning and Real-Time Classification13 Jul 2026
- 2026Neuro-Symbolic Agents for Regulated Process Automation: Challenges and Research Agenda11 Jun 2026
- 2026Options, Not Clicks: Lattice Refinement for Consent-Driven MCP Authorization12 May 2026
- 2026Inference-Time Scaling of Verification: Self-Evolving Deep Research Agents via Test-Time Rubric-Guided Verification22 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026SafeAgent: A Runtime Protection Architecture for Agentic Systems
- 2026What Can Be Enforced? A Theory of Certified Runtime Safety for Tool-Using Agents
- 2024GuardAgent: Safeguard LLM Agents by a Guard Agent via Knowledge-Enabled Reasoning
- 2026VEPA: Verified Evolving Formal Policy for Lifelong LLM Agent Guardrails
- 2026S3: Improving Agent Safety through Multi-Stage Defense
- 2026Autoformalization of Agent Instructions into Policy-as-Code
- 2026RePolicy: Reinforcement Learning for Safety-Policy Invocation in Agent Safeguards
- 2026AgentLens: Interpretable Safety Steering via Mechanistic Subspaces for Multi-Turn Coding Agent