mlsanityData to 7 Oct 2026

Visual Compliance via Executable Safety Rule Entailment

arXiv 2609.18328 ↗First posted 16 Sep 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in LLMs and VLMs have enabled safety systems to reason beyond simple risk patterns toward more contextual and semantic safety concerns. However, as risk patterns continue to evolve and safety rules become more complex, existing training-based end-to-end safeguards face persistent challenges in adaptability and explainable reasoning over complex safety rules. To address these challenges, we propose GuardEn (Guarding by Safety Rule Entailment), an executable safeguard framework that decomposes safety policies into atomic propositions through Safety-Rule Compilation, modeling their composition as executable code. At test time, Scene-Grounded Execution instantiates these atomic propositions with contextual visual information derived from scene graphs, enabling rule-grounded and interpretable safety reasoning. Experiments on SafetyVisionBench demonstrate the effectiveness of programmable safeguard for complex visual safety assessment, achieving an average improvement of 9.8 F1 points over the strongest baseline.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 59 references that are in the map. First posted on arXiv 16 Sep 2026.

Builds on

35 of 59 references.

References · 35

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  4. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
  5. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
  6. 2025SAM 3: Segment Anything with Conceptscited by 835
  7. 2023Large Language Models as Optimizerscited by 830
  8. 2022Large Language Models Can Self-Improvecited by 656
  9. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  10. 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 591
  11. 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 554
  12. 2022Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoningcited by 331
23 more
  1. 2024Llama Guard 3 Vision: Safeguarding Human-AI Image Understanding Conversationscited by 118
  2. 2024ETA: Evaluating Then Aligning Safety of Vision Language Models at Inference Timecited by 57
  3. 2024LlavaGuard: An Open VLM-based Framework for Safeguarding Vision Datasets and Modelscited by 49
  4. 2024R2-Guard: Robust Reasoning Enabled LLM Guardrail via Knowledge-Enhanced Logical Reasoningcited by 41
  5. 2024Unlocking Reasoning Potential in Large Langauge Models by Scaling Code-form Planningcited by 24
  6. 2024LabSafety Bench: Benchmarking LLMs on Safety Issues in Scientific Labscited by 24
  7. 2024MLLM-as-a-Judge for Image Safety without Human Labelingcited by 23
  8. 2023GENOME: GenerativE Neuro-symbOlic visual reasoning by growing and reusing ModulEscited by 18
  9. 2023LASER: A Neuro-Symbolic Framework for Learning Spatial-Temporal Scene Graphs with Weak Supervisioncited by 13
  10. 2025NAVER: A Neuro-Symbolic Compositional Automaton for Visual Grounding with Explicit Logic Reasoningcited by 12
  11. 2025GSPR: Aligning LLM Safeguards as Generalizable Safety Policy Reasonerscited by 10
  12. 2025Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoningcited by 9
  13. 2025Prompt Sentiment: The Catalyst for LLM Changecited by 9
  14. 2025Self-Critique and Refinement for Faithful Natural Language Explanationscited by 9
  15. 2025Better Safe Than Sorry? Overreaction Problem of Vision Language Models in Visual Emergency Recognitioncited by 7
  16. 2024PORT: Preference Optimization on Reasoning Tracescited by 6
  17. 2025Zero-Shot Defense Against Toxic Images via Inherent Multimodal Alignment in LVLMscited by 6
  18. 2025Are Large Pre-trained Vision Language Models Effective Construction Safety Inspectors?cited by 6
  19. 2026Towards Policy-Adaptive Image Guardrail: Benchmark and Methodcited by 6
  20. 2025Position: AI Safety Must Embrace an Antifragile Perspectivecited by 5
  21. 2025EVADE-Bench: Multimodal Benchmark for Evaluating and Enhancing Evasive Content Detectioncited by 3
  22. 2026LABSHIELD: A Multimodal Benchmark for Safety-Critical Reasoning and Planning in Scientific Laboratoriescited by 3
  23. 2025CompAgent: An Agentic Framework for Visual Compliance Verificationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Rethinking Bottlenecks in Safety Fine-Tuning of Vision Language Models
  2. 2026ConsisGuard: Aligning Safety Deliberation with Policy Enforcement in LLM Guardrails
  3. 2026SAVeS: Steering Safety Judgments in Vision-Language Models via Semantic Cues
  4. 2025Think-Reflect-Revise: A Policy-Guided Reflective Framework for Safety Alignment in Large Vision Language Models
  5. 2026TRACE: An Evidence-Grounded Benchmark for Safety Evaluation of Large Reasoning Models
  6. 2026MonitorVLM-v2: A Deployed Vision-Language Framework for Real-Time Safety Violation Detection
  7. 2026SaFeR-ToolKit: Structured Reasoning via Virtual Tool Calling for Multimodal Safety
  8. 2026SafeSceneReason: A Multimodal Reasoning Benchmark Connecting Industrial Hazards with Accident Knowledge