GuardTrace-VL: Detecting Unsafe Multimodel Reasoning via Iterative Safety Supervision
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Multimodal large reasoning models (MLRMs) are increasingly deployed for vision-language tasks that produce explicit intermediate rationales. However, reasoning traces can contain unsafe content even when the final answer is non-harmful, creating deployment risks. Existing multimodal safety guards primarily evaluate only the input question and the final answer, neglecting the intermediate reasoning process. This oversight allows undetected harm, such as biased inferences or policy-violating use of visual context, to emerge during reasoning. We introduce GuardTrace-VL, a vision-aware safety auditor that monitors the full Question-Thinking-Answer (QTA) pipeline via joint image-text analysis, enabling detection of unsafe content as it emerges in the reasoning stage. To support training and evaluation, we construct the GuardTrace dataset, which is generated through diverse prompting strategies and refined via a MLRM- and human-based voting and verification pipeline. Furthermore, we propose a three-stage progressive training scheme combined with the data refinement process, enabling the model to learn nuanced and context-dependent safety preferences according to different risk levels. On our proposed test set covering both in-domain and out-of-domain scenarios, GuardTrace-VL model achieves an F1 score of 93.1% on unsafe reasoning detection tasks, representing a 13.5% improvement in F1 score compared to the previous strongest multimodal safety defense methods. The codes will be made publicly available.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 34 of its 43 references that are in the map. First posted on arXiv 26 Nov 2025.
Builds on
34 of 43 references.
Closest ancestors · 7
Same direction, newest first
- 2025Beyond Safe Answers: A Benchmark for Evaluating True Risk Awareness in Large Reasoning Models26 May
- 2025Implicit Jailbreak Attacks via Cross-Modal Information Concealment on Vision-Language Models22 May
- 2025GuardReasoner-VL: Safeguarding VLMs via Reinforced Reasoning16 May
- 2025Think in Safety: Unveiling and Mitigating Safety Alignment Collapse in Multimodal Large Reasoning Model10 May
- 2025SafeMLRM: Demystifying Safety in Multi-modal Large Reasoning Models9 Apr
- 2025Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonable1 Mar
- 2025H-CoT: Hijacking the Chain-of-Thought Safety Reasoning Mechanism to Jailbreak Large Reasoning Models, Including OpenAI o1/o3, DeepSeek-R1, and Gemini 2.0 Flash Thinking18 Feb
Other references · 27
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Visual Instruction Tuningcited by 7,869
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
- 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 496
15 more
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
- 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Promptscited by 398
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 356
- 2023Visual Adversarial Examples Jailbreak Aligned Large Language Modelscited by 328
- 2023MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Modelscited by 274
- 2023Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language Modelscited by 273
- 2022A New Generation of Perspective API: Efficient Multilingual Character-level Transformerscited by 185
- 2025Qwen3Guard Technical Reportcited by 155
- 2024Images are Achilles' Heel of Alignment: Exploiting Visual Vulnerabilities for Jailbreaking Multimodal Large Language Modelscited by 136
- 2024Llama Guard 3 Vision: Safeguarding Human-AI Image Understanding Conversationscited by 129
- 2024AIR-Bench 2024: A Safety Benchmark Based on Risk Categories from Regulations and Policiescited by 74
- 2024SafeBench: A Safety Evaluation Framework for Multimodal Large Language Modelscited by 69
- 2025Distraction is All You Need for Multimodal Large Language Model Jailbreakingcited by 36
- 2024Safety Alignment for Vision Language Modelscited by 28
- 2025BingoGuard: LLM Content Moderation Tools with Risk Levelscited by 21
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026BraveGuard: From Open-World Threats to Safer Computer-Use Agentscited by 4
- 2026Multi2AV-Safety: Benchmarking Safety in Multimodal-to-Audio-Video Generationcited by 0
- 2026Taming CoT Obfuscation in VLMs: From Mechanistic Evidence to Activation Enforcementcited by 0
- 2026PlanGuard: A Guardrail for Multi-Step Plan Safety in Embodied Agentscited by 0
- 2026PlanGuard: A Guardrail for Multi-Step Plan Safety in Embodied Agents26 Sep 2026
- 2026Taming CoT Obfuscation in VLMs: From Mechanistic Evidence to Activation Enforcement21 Sep 2026
- 2026Multi2AV-Safety: Benchmarking Safety in Multimodal-to-Audio-Video Generation27 Aug 2026
- 2026BraveGuard: From Open-World Threats to Safer Computer-Use Agents31 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025Think-Reflect-Revise: A Policy-Guided Reflective Framework for Safety Alignment in Large Vision Language Models
- 2026SingGuard: A Policy-Adaptive Multimodal LLM Guardrail with Dynamic Reasoning
- 2024RapGuard: Safeguarding Multimodal Large Language Models via Rationale-aware Defensive Prompting
- 2025ProGuard: Towards Proactive Multimodal Safeguard
- 2025Rethinking Bottlenecks in Safety Fine-Tuning of Vision Language Models
- 2026The Side Effects of Being Smart: Safety Risks in MLLMs' Multi-Image Reasoning
- 2025VLMGuard-R1: Proactive Safety Alignment for VLMs via Reasoning-Driven Prompt Optimization
- 2025SaFeR-VLM: Toward Safety-aware Fine-grained Reasoning in Multimodal Models