mlsanityData to 14 Oct 2026

GuardTrace-VL: Detecting Unsafe Multimodel Reasoning via Iterative Safety Supervision

arXiv 2511.20994 ↗First posted 26 Nov 2025cs.CV cs.AI cs.CRcited by 4

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Multimodal large reasoning models (MLRMs) are increasingly deployed for vision-language tasks that produce explicit intermediate rationales. However, reasoning traces can contain unsafe content even when the final answer is non-harmful, creating deployment risks. Existing multimodal safety guards primarily evaluate only the input question and the final answer, neglecting the intermediate reasoning process. This oversight allows undetected harm, such as biased inferences or policy-violating use of visual context, to emerge during reasoning. We introduce GuardTrace-VL, a vision-aware safety auditor that monitors the full Question-Thinking-Answer (QTA) pipeline via joint image-text analysis, enabling detection of unsafe content as it emerges in the reasoning stage. To support training and evaluation, we construct the GuardTrace dataset, which is generated through diverse prompting strategies and refined via a MLRM- and human-based voting and verification pipeline. Furthermore, we propose a three-stage progressive training scheme combined with the data refinement process, enabling the model to learn nuanced and context-dependent safety preferences according to different risk levels. On our proposed test set covering both in-domain and out-of-domain scenarios, GuardTrace-VL model achieves an F1 score of 93.1% on unsafe reasoning detection tasks, representing a 13.5% improvement in F1 score compared to the previous strongest multimodal safety defense methods. The codes will be made publicly available.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 34 of its 43 references that are in the map. First posted on arXiv 26 Nov 2025.

Builds on

34 of 43 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Beyond Safe Answers: A Benchmark for Evaluating True Risk Awareness in Large Reasoning Models26 May
  2. 2025Implicit Jailbreak Attacks via Cross-Modal Information Concealment on Vision-Language Models22 May
  3. 2025GuardReasoner-VL: Safeguarding VLMs via Reinforced Reasoning16 May
  4. 2025Think in Safety: Unveiling and Mitigating Safety Alignment Collapse in Multimodal Large Reasoning Model10 May
  5. 2025SafeMLRM: Demystifying Safety in Multi-modal Large Reasoning Models9 Apr
  6. 2025Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonable1 Mar
  7. 2025H-CoT: Hijacking the Chain-of-Thought Safety Reasoning Mechanism to Jailbreak Large Reasoning Models, Including OpenAI o1/o3, DeepSeek-R1, and Gemini 2.0 Flash Thinking18 Feb

Other references · 27

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2025Qwen3 Technical Reportcited by 8,820
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  6. 2023Visual Instruction Tuningcited by 7,869
  7. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  8. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  9. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  10. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  11. 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
  12. 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 496
15 more
  1. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
  2. 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Promptscited by 398
  3. 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 356
  4. 2023Visual Adversarial Examples Jailbreak Aligned Large Language Modelscited by 328
  5. 2023MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Modelscited by 274
  6. 2023Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language Modelscited by 273
  7. 2022A New Generation of Perspective API: Efficient Multilingual Character-level Transformerscited by 185
  8. 2025Qwen3Guard Technical Reportcited by 155
  9. 2024Images are Achilles' Heel of Alignment: Exploiting Visual Vulnerabilities for Jailbreaking Multimodal Large Language Modelscited by 136
  10. 2024Llama Guard 3 Vision: Safeguarding Human-AI Image Understanding Conversationscited by 129
  11. 2024AIR-Bench 2024: A Safety Benchmark Based on Risk Categories from Regulations and Policiescited by 74
  12. 2024SafeBench: A Safety Evaluation Framework for Multimodal Large Language Modelscited by 69
  13. 2025Distraction is All You Need for Multimodal Large Language Model Jailbreakingcited by 36
  14. 2024Safety Alignment for Vision Language Modelscited by 28
  15. 2025BingoGuard: LLM Content Moderation Tools with Risk Levelscited by 21

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Think-Reflect-Revise: A Policy-Guided Reflective Framework for Safety Alignment in Large Vision Language Models
  2. 2026SingGuard: A Policy-Adaptive Multimodal LLM Guardrail with Dynamic Reasoning
  3. 2024RapGuard: Safeguarding Multimodal Large Language Models via Rationale-aware Defensive Prompting
  4. 2025ProGuard: Towards Proactive Multimodal Safeguard
  5. 2025Rethinking Bottlenecks in Safety Fine-Tuning of Vision Language Models
  6. 2026The Side Effects of Being Smart: Safety Risks in MLLMs' Multi-Image Reasoning
  7. 2025VLMGuard-R1: Proactive Safety Alignment for VLMs via Reasoning-Driven Prompt Optimization
  8. 2025SaFeR-VLM: Toward Safety-aware Fine-grained Reasoning in Multimodal Models