mlsanityData to 7 Oct 2026

MonitorVLM-v2: A Deployed Vision-Language Framework for Real-Time Safety Violation Detection

arXiv 2608.00975 ↗First posted 2 Aug 2026cs.CVcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Large vision--language models (VLMs) can reason step by step about complex visual scenes, but this open-ended, autoregressive chain-of-thought (CoT) approach is poorly suited to safety-critical, rule-governed settings such as industrial surveillance, where decisions must be bounded, deterministic, and low-latency. Because CoT inference cost scales jointly with reasoning length and the number of concurrent streams, it creates a throughput bottleneck that precludes the real-time, multistream monitoring required for industrial accountability. Here we present MonitorVLM-v2, a deployment-oriented framework that recasts VLM-based safety assessment as probabilistic inference over a finite regulatory decision space, compressing multimodal reasoning into single-step rule-ID predictions and reducing decoding from a variable-length sequence to a single token. We introduce symbolic policy optimization (SymPO), a novel contrastive policy optimization algorithm that sharpens decision boundaries within this finite symbolic space, together with an entropy-driven triage mechanism that routes uncertain predictions to human reviewers for expert confirmation. In a four-month prospective deployment across 10 concurrent camera feeds in an operational underground mining facility, MonitorVLM-v2 achieved a 19.45-fold increase in inference speed and identified 2.78 times as many confirmed violations as the site's routine manual inspection workflow, demonstrating the practical value of compressed symbolic decision-making for real-time, auditable industrial monitoring.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 22 of its 37 references that are in the map. First posted on arXiv 2 Aug 2026.

Builds on

22 of 37 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilities17 Feb

Other references · 21

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  6. 2023Visual Instruction Tuningcited by 7,792
  7. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  8. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  9. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  10. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  11. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  12. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
9 more
  1. 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 414
  2. 2023DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Modelscited by 239
  3. 2022Thinking Fast and Slow in Large Language Modelscited by 136
  4. 2023Learning from models beyond fine-tuningcited by 47
  5. 2023Visual cognition in multimodal large language modelscited by 38
  6. 2024Probing the limitations of multimodal language models for chemistry and materials researchcited by 31
  7. 2026STAPO: Stabilizing Reinforcement Learning for LLMs by Silencing Rare Spurious Tokenscited by 9
  8. 2024Multimodal Large Language Models for Bioimage Analysiscited by 6
  9. 2025MonitorVLM:A Vision Language Framework for Safety Violation Detection in Mining Operationscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Rethinking Bottlenecks in Safety Fine-Tuning of Vision Language Models
  2. 2026Automated Safety Benchmarking: A Multi-agent Pipeline for LVLMs
  3. 2025iSafetyBench: A video-language benchmark for safety in industrial environment
  4. 2026Visual Compliance via Executable Safety Rule Entailment
  5. 2025SafeCoT: Improving VLM Safety with Minimal Reasoning
  6. 2024LlavaGuard: An Open VLM-based Framework for Safeguarding Vision Datasets and Models
  7. 2025GuardTrace-VL: Detecting Unsafe Multimodel Reasoning via Iterative Safety Supervision
  8. 2025Think-Reflect-Revise: A Policy-Guided Reflective Framework for Safety Alignment in Large Vision Language Models