mlsanityData to 7 Oct 2026

ThinkingGuard: Decoding Implicit Hazards via Step-by-Step Risk Attribution in Multimodal Large Language Models

arXiv 2609.36562 ↗First posted 29 Sep 2026cs.CV cs.AI cs.LGcited by 0

On the map: LLM reasoning → Multimodal reasoning also fits: Reasoning benchmarks and evaluation

also in 1 more
Abstract (arXiv)

While Multimodal Large Language Models (MLLMs) are increasingly deployed in safety-critical domains, their reliability is threatened by multimodal implicit risks. Unlike explicit threats, these hazards emerge when individually benign text and neutral visual entities logically converge to induce unsafe outputs. Current detection methods fail to address this because they overlook the underlying risk activation mechanisms that govern cross-modal risk activation, leading to single-modality shortcut learning and hallucinated rationalizations. To bridge this gap, we first construct TriggerBench, the first dataset explicitly modeling risk compositionality (5,600 instances). By formally isolating Key Elements and Trigger Elements to build counterfactual contrastive pairs, TriggerBench eliminates risk residues and forces models to perform genuine logical deduction rather than superficial pattern matching, which provides a rigorous foundation for both large-scale training and fine-grained evaluation. Building on this, we propose a Step-Supervised Structured Reasoning training framework and employ it to train ThinkingGuard, a specialized guard model. Inspired by Situation Awareness theory, we decouple implicit risk identification into progressive cognitive stages, and utilize a step-reward Monte Carlo Tree Search algorithm to explore optimal reasoning trajectories, which are then distilled into the model through Dual-Constraint Preference Alignment. Extensive experiments across both standard and implicit safety benchmarks demonstrate that ThinkingGuard achieves strong performance. Project resources are available at https://github.com/FroggyChen/ThinkingGuard.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 17 of its 39 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

17 of 39 references.

References · 17

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  3. 2025Qwen3-VL Technical Reportcited by 2,534
  4. 2025OpenAI GPT-5 System Cardcited by 910
  5. 2024Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Modelscited by 160
  6. 2024Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fastcited by 149
  7. 2024Llama Guard 3 Vision: Safeguarding Human-AI Image Understanding Conversationscited by 118
  8. 2024Safety of Multimodal Large Language Models on Images and Textscited by 70
  9. 2024Multimodal Situational Safetycited by 54
  10. 2024LlavaGuard: An Open VLM-based Framework for Safeguarding Vision Datasets and Modelscited by 49
  11. 2025GuardReasoner-VL: Safeguarding VLMs via Reinforced Reasoningcited by 38
  12. 2024Open-FinLLMs: Open Multimodal Large Language Models for Financial Applicationscited by 36
5 more
  1. 2025JailDAM: Jailbreak Detection with Adaptive Memory for Vision-Language Modelcited by 10
  2. 2025USB: A Comprehensive and Unified Safety Evaluation Benchmark for Multimodal Large Language Modelscited by 10
  3. 2025SaFeR-VLM: Toward Safety-aware Fine-grained Reasoning in Multimodal Modelscited by 8
  4. 2025VLSU: Mapping the Limits of Joint Multimodal Understanding for AI Safetycited by 7
  5. 2025CrossGuard: Safeguarding MLLMs against Joint-Modal Implicit Malicious Attackscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024RapGuard: Safeguarding Multimodal Large Language Models via Rationale-aware Defensive Prompting
  2. 2025DREAM: Disentangling Risks to Enhance Safety Alignment in Multimodal Large Language Models
  3. 2026YuFeng-XGuard: A Reasoning-Centric, Interpretable, and Flexible Guardrail Model for Large Language Models
  4. 2025ThinkGuard: Deliberative Slow Thinking Leads to Cautious Guardrails
  5. 2026Evolving Contextual Safety in Multi-Modal Large Language Models via Inference-Time Self-Reflective Memory
  6. 2025GuardTrace-VL: Detecting Unsafe Multimodel Reasoning via Iterative Safety Supervision
  7. 2026MCBench: A Multicontext Safety Assessment Benchmark for Omni Large Language Models
  8. 2026Transfer Safety Awareness for Cross-Modal Safety Drift in Multimodal Large Language Models