OOD-MMSafe: Advancing MLLM Safety from Harmful Intent to Hidden Consequences
On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness
also in 2 more
Abstract (arXiv)
While safety alignment for Multimodal Large Language Models (MLLMs) has gained significant attention, current paradigms primarily target malicious intent or situational violations. We propose shifting the safety frontier toward consequence-driven safety, a paradigm essential for the robust deployment of autonomous and embodied agents. To formalize this shift, we introduce OOD-MMSafe, a benchmark comprising 455 curated query-image pairs designed to evaluate a model's ability to identify latent hazards within context-dependent causal chains. Our analysis reveals a pervasive causal blindness among frontier models, with the highest 67.5% failure rate in high-capacity closed-source models, and identifies a preference ceiling where static alignment yields format-centric failures rather than improved safety reasoning as model capacity grows. To address these bottlenecks, we develop the Consequence-Aware Safety Policy Optimization (CASPO) framework, which integrates the model's intrinsic reasoning as a dynamic reference for token-level self-distillation rewards. Experimental results demonstrate that CASPO significantly enhances consequence projection, reducing the failure ratio of risk identification to 7.3% for Qwen2.5-VL-7B and 5.7% for Qwen3-VL-4B while maintaining overall effectiveness.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 20 of its 24 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
20 of 24 references.
Closest ancestors · 12
Same direction, newest first
- 2026A Safety Report on GPT-5.2, Gemini 3 Pro, Qwen3-VL, Grok 4.1 Fast, Nano Banana Pro, and Seedream 4.515 Jan
- 2025USB: A Comprehensive and Unified Safety Evaluation Benchmark for Multimodal Large Language Models26 May
- 2025VSCBench: Bridging the Gap in Vision-Language Model Safety Calibration26 May
- 2025Safe RLHF-V: Safe Reinforcement Learning from Multi-modal Human Feedback22 Mar
- 2025Towards Harmless Multimodal Assistants with Blind Preference Optimization18 Mar
- 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safety2 Feb
- 2025Rethinking Bottlenecks in Safety Fine-Tuning of Vision Language Models30 Jan
- 2024VLSBench: Unveiling Visual Leakage in Multimodal Safety29 Nov
- 2024Multimodal Situational Safety8 Oct
- 2024Safe Inputs but Unsafe Output: Benchmarking Cross-modality Safety Alignment of Large Vision-Language Model21 Jun
- 2024SPA-VL: A Comprehensive Safety Preference Alignment Dataset for Vision Language Model17 Jun
- 2023MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Models29 Nov
Other references · 8
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2023Visual Instruction Tuningcited by 7,792
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2015Policy Distillationcited by 414
- 2024Agent-SafetyBench: Evaluating the Safety of LLM Agentscited by 280
- 2025SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Constrained Learningcited by 69
- 2025Generative RLHF-V: Learning Principles from Multi-modal Human Preferencecited by 13
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MME-Safety: A Fine-grained Benchmark for Safety Evaluation of MLLMs
- 2026ReFrame: Evidence-Guided Test-Time Safety Alignment in Multimodal Large Language Models
- 2025SafeGRPO: Self-Rewarded Multimodal Safety Alignment via Rule-Governed Policy Optimization
- 2025Read the Scene, Not the Script: Outcome-Aware Safety for LLMs
- 2025DREAM: Disentangling Risks to Enhance Safety Alignment in Multimodal Large Language Models
- 2024Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirements
- 2025Do We Really Need Curated Malicious Data for Safety Alignment in Multi-modal Large Language Models?
- 2025Beyond Reactive Safety: Risk-Aware LLM Alignment via Long-Horizon Simulation