Think in Safety: Unveiling and Mitigating Safety Alignment Collapse in Multimodal Large Reasoning Model
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 2 more
Abstract (arXiv)
The rapid development of Multimodal Large Reasoning Models (MLRMs) has demonstrated broad application potential, yet their safety and reliability remain critical concerns that require systematic exploration. To address this gap, we conduct a comprehensive and systematic safety evaluation of 11 MLRMs across 5 benchmarks and unveil prevalent safety degradation phenomena in most advanced models. Moreover, our analysis reveals distinct safety patterns across different benchmarks: significant safety degradation is observed across jailbreak robustness benchmarks, whereas safety-awareness benchmarks demonstrate less pronounced degradation. In particular, the long thought process in some scenarios even enhances safety performance. Therefore, it is a potential approach to address safety issues in MLRMs by leveraging the intrinsic reasoning capabilities of the model to detect unsafe intent. To operationalize this insight, we construct a multimodal tuning dataset that incorporates a safety-oriented thought process. Experimental results from fine-tuning existing MLRMs with this dataset effectively enhances the safety on both jailbreak robustness and safety-awareness benchmarks. This study provides a new perspective for developing safe MLRMs. Our dataset is available at https://github.com/xinyuelou/Think-in-Safety.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 33 of its 49 references that are in the map. First posted on arXiv 10 May 2025.
Builds on
33 of 49 references.
Closest ancestors · 7
Same direction, newest first
- 2025SafeMLRM: Demystifying Safety in Multi-modal Large Reasoning Models9 Apr
- 2025The Hidden Risks of Large Reasoning Models: A Safety Assessment of R118 Feb
- 2025SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilities17 Feb
- 2025Rethinking Bottlenecks in Safety Fine-Tuning of Vision Language Models30 Jan
- 2024OpenAI o1 System Card21 Dec
- 2024Deliberative Alignment: Reasoning Enables Safer Language Models20 Dec
- 2024Eyes Closed, Safety On: Protecting Multimodal LLMs via Image-to-Text Transformation14 Mar
Other references · 26
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 469
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
- 2025Kimi-VL Technical Reportcited by 388
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 370
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningcited by 303
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 248
14 more
- 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discoverycited by 235
- 2024JailBreakV: A Benchmark for Assessing the Robustness of MultiModal Large Language Models against Jailbreak Attackscited by 230
- 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 175
- 2024Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Modelscited by 167
- 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMscited by 147
- 2024Llama Guard 3 Vision: Safeguarding Human-AI Image Understanding Conversationscited by 129
- 2025Competitive Programming with Large Reasoning Modelscited by 119
- 2024SPA-VL: A Comprehensive Safety Preference Alignment Dataset for Vision Language Modelcited by 85
- 2024VLSBench: Unveiling Visual Leakage in Multimodal Safetycited by 63
- 2024Multimodal Situational Safetycited by 58
- 2025AStar: Boosting Multimodal Reasoning with Automated Structured Thinkingcited by 25
- 2025EmbodiedVSR: Dynamic Scene Graph-Guided Chain-of-Thought Reasoning for Visual Spatial Taskscited by 10
- 2024How Does Vision-Language Adaptation Impact the Safety of Vision Language Models?cited by 8
- 2024Don't Command, Cultivate: An Exploratory Study of System-2 Alignmentcited by 2
Built on by
Citing papers per year: 2025: 7; 2026: 12.
19 papers.
Sort:
By area:
- 2025A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Modelscited by 25
- 2025SafeGRPO: Self-Rewarded Multimodal Safety Alignment via Rule-Governed Policy Optimizationcited by 12
- 2026Imagination Helps Visual Reasoning, But Not Yet in Latent Spacecited by 12
- 2025SaFeR-VLM: Toward Safety-aware Fine-grained Reasoning in Multimodal Modelscited by 10
- 2026Phi-4-reasoning-vision-15B Technical Reportcited by 10
- 2025Beyond Reasoning Gains: Mitigating General-Capability Forgetting in Large Reasoning Modelscited by 5
- 2025GuardTrace-VL: Detecting Unsafe Multimodel Reasoning via Iterative Safety Supervisioncited by 4
- 2026MTMCS-Bench: Evaluating Contextual Safety of Multimodal Large Language Models in Multi-Turn Dialoguescited by 4
- 2026When Helpers Become Hazards: A Benchmark for Analyzing Multimodal LLM-Powered Safety in Daily Lifecited by 3
- 2026Safety Recovery in Reasoning Models Is Only a Few Early Steering Steps Awaycited by 3
- 2025From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Modelscited by 1
- 2025Think-Reflect-Revise: A Policy-Guided Reflective Framework for Safety Alignment in Large Vision Language Modelscited by 1
7 more
- 2026SaFeR-Steer: Evolving Multi-Turn MLLMs via Synthetic Bootstrapping and Feedback Dynamicscited by 1
- 2026SaFeR-ToolKit: Structured Reasoning via Virtual Tool Calling for Multimodal Safetycited by 0
- 2026Harnessing Textual Refusal Directions for Multimodal Safetycited by 0
- 2026ReFrame: Evidence-Guided Test-Time Safety Alignment in Multimodal Large Language Modelscited by 0
- 2026ContextBias: Controlled Evaluation of Bias Persistence Under Context Shift in Text-to-Image Modelscited by 0
- 2026A2Safe: Counterfactual Evidence-Aligned Adaptive Agent Collaboration for Safe and Effective Visual Question Answeringcited by 0
- 2026Visual Grounding Safety in Vision-Language Modelscited by 0
- 2026Visual Grounding Safety in Vision-Language Models5 Oct 2026
- 2026A2Safe: Counterfactual Evidence-Aligned Adaptive Agent Collaboration for Safe and Effective Visual Question Answering21 Sep 2026
- 2026ContextBias: Controlled Evaluation of Bias Persistence Under Context Shift in Text-to-Image Models30 Aug 2026
- 2026ReFrame: Evidence-Guided Test-Time Safety Alignment in Multimodal Large Language Models21 Aug 2026
- 2026Harnessing Textual Refusal Directions for Multimodal Safety30 Jun 2026
- 2026SaFeR-Steer: Evolving Multi-Turn MLLMs via Synthetic Bootstrapping and Feedback Dynamics18 Mar 2026
- 2026Phi-4-reasoning-vision-15B Technical Report4 Mar 2026
- 2026SaFeR-ToolKit: Structured Reasoning via Virtual Tool Calling for Multimodal Safety3 Mar 2026
- 2026Imagination Helps Visual Reasoning, But Not Yet in Latent Space26 Feb 2026
- 2026Safety Recovery in Reasoning Models Is Only a Few Early Steering Steps Away11 Feb 2026
- 2026MTMCS-Bench: Evaluating Contextual Safety of Multimodal Large Language Models in Multi-Turn Dialogues11 Jan 2026
- 2026When Helpers Become Hazards: A Benchmark for Analyzing Multimodal LLM-Powered Safety in Daily Life7 Jan 2026
7 more
- 2025Think-Reflect-Revise: A Policy-Guided Reflective Framework for Safety Alignment in Large Vision Language Models8 Dec 2025
- 2025GuardTrace-VL: Detecting Unsafe Multimodel Reasoning via Iterative Safety Supervision26 Nov 2025
- 2025SafeGRPO: Self-Rewarded Multimodal Safety Alignment via Rule-Governed Policy Optimization17 Nov 2025
- 2025From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Models17 Nov 2025
- 2025Beyond Reasoning Gains: Mitigating General-Capability Forgetting in Large Reasoning Models24 Oct 2025
- 2025SaFeR-VLM: Toward Safety-aware Fine-grained Reasoning in Multimodal Models8 Oct 2025
- 2025A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Models4 Sep 2025
- 2025A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Modelscited by 25
- 2025SafeGRPO: Self-Rewarded Multimodal Safety Alignment via Rule-Governed Policy Optimizationcited by 12
- 2026Imagination Helps Visual Reasoning, But Not Yet in Latent Spacecited by 12
- 2025SaFeR-VLM: Toward Safety-aware Fine-grained Reasoning in Multimodal Modelscited by 10
- 2026Phi-4-reasoning-vision-15B Technical Reportcited by 10
- 2025Beyond Reasoning Gains: Mitigating General-Capability Forgetting in Large Reasoning Modelscited by 5
- 2025GuardTrace-VL: Detecting Unsafe Multimodel Reasoning via Iterative Safety Supervisioncited by 4
- 2026Safety Recovery in Reasoning Models Is Only a Few Early Steering Steps Awaycited by 3
- 2025From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Modelscited by 1
- 2025Think-Reflect-Revise: A Policy-Guided Reflective Framework for Safety Alignment in Large Vision Language Modelscited by 1
- 2026SaFeR-ToolKit: Structured Reasoning via Virtual Tool Calling for Multimodal Safetycited by 0
- 2026Phi-4-reasoning-vision-15B Technical Report4 Mar 2026
- 2026SaFeR-ToolKit: Structured Reasoning via Virtual Tool Calling for Multimodal Safety3 Mar 2026
- 2026Imagination Helps Visual Reasoning, But Not Yet in Latent Space26 Feb 2026
- 2026Safety Recovery in Reasoning Models Is Only a Few Early Steering Steps Away11 Feb 2026
- 2025Think-Reflect-Revise: A Policy-Guided Reflective Framework for Safety Alignment in Large Vision Language Models8 Dec 2025
- 2025GuardTrace-VL: Detecting Unsafe Multimodel Reasoning via Iterative Safety Supervision26 Nov 2025
- 2025SafeGRPO: Self-Rewarded Multimodal Safety Alignment via Rule-Governed Policy Optimization17 Nov 2025
- 2025From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Models17 Nov 2025
- 2025Beyond Reasoning Gains: Mitigating General-Capability Forgetting in Large Reasoning Models24 Oct 2025
- 2025SaFeR-VLM: Toward Safety-aware Fine-grained Reasoning in Multimodal Models8 Oct 2025
- 2025A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Models4 Sep 2025
- 2026MTMCS-Bench: Evaluating Contextual Safety of Multimodal Large Language Models in Multi-Turn Dialoguescited by 4
- 2026When Helpers Become Hazards: A Benchmark for Analyzing Multimodal LLM-Powered Safety in Daily Lifecited by 3
- 2026ReFrame: Evidence-Guided Test-Time Safety Alignment in Multimodal Large Language Modelscited by 0
- 2026A2Safe: Counterfactual Evidence-Aligned Adaptive Agent Collaboration for Safe and Effective Visual Question Answeringcited by 0
- 2026Visual Grounding Safety in Vision-Language Modelscited by 0
- 2026Visual Grounding Safety in Vision-Language Models5 Oct 2026
- 2026A2Safe: Counterfactual Evidence-Aligned Adaptive Agent Collaboration for Safe and Effective Visual Question Answering21 Sep 2026
- 2026ReFrame: Evidence-Guided Test-Time Safety Alignment in Multimodal Large Language Models21 Aug 2026
- 2026MTMCS-Bench: Evaluating Contextual Safety of Multimodal Large Language Models in Multi-Turn Dialogues11 Jan 2026
- 2026When Helpers Become Hazards: A Benchmark for Analyzing Multimodal LLM-Powered Safety in Daily Life7 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025SafeRBench: Dissecting the Reasoning Safety of Large Language Models
- 2025When Models Outthink Their Safety: Unveiling and Mitigating Self-Jailbreak in Large Reasoning Models
- 2025When Safe Unimodal Inputs Collide: Optimizing Reasoning Chains for Cross-Modal Safety in Multimodal Large Language Models
- 2025Beyond Safe Answers: A Benchmark for Evaluating True Risk Awareness in Large Reasoning Models
- 2026MME-Safety: A Fine-grained Benchmark for Safety Evaluation of MLLMs
- 2026Towards Safer Large Reasoning Models by Promoting Safety Decision-Making before Chain-of-Thought Generation
- 2025Self-Guided Adaptive Safety Alignment: Synthesizing and Internalizing Guidelines in Reasoning Models
- 2026Adaptive and Explicit safe: Triggering Latent Safety Awareness in Large Reasoning Models