CrossGuard: Safeguarding MLLMs against Joint-Modal Implicit Malicious Attacks
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 2 more
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) achieve strong reasoning and perception capabilities but are increasingly vulnerable to jailbreak attacks. While existing work focuses on explicit attacks, where malicious content resides in a single modality, recent studies reveal implicit attacks, in which benign text and image inputs jointly express unsafe intent. Such joint-modal threats are difficult to detect and remain underexplored, largely due to the scarcity of high-quality implicit data. We propose ImpForge, an automated red-teaming pipeline that leverages reinforcement learning with tailored reward modules to generate diverse implicit samples across 14 domains. Building on this dataset, we further develop CrossGuard, an intent-aware safeguard providing robust and comprehensive defense against both explicit and implicit threats. Extensive experiments across safe and unsafe benchmarks, implicit and explicit attacks, and multiple out-of-domain settings demonstrate that CrossGuard significantly outperforms existing defenses, including advanced MLLMs and guardrails, achieving stronger security while maintaining high utility. This offers a balanced and practical solution for enhancing MLLM robustness against real-world multimodal threats. Our code is released: https://github.com/ZhangXu0963/CrossGuard.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 30 of its 50 references that are in the map. First posted on arXiv 20 Oct 2025.
Builds on
30 of 50 references.
References · 30
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2022Red Teaming Language Models with Language Modelscited by 1,026
- 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
- 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Promptscited by 398
- 2021WIT: Wikipedia-based Image Text Dataset for Multimodal Multilingual Machine Learningcited by 287
- 2023Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language Modelscited by 273
- 2024JailBreakV: A Benchmark for Assessing the Robustness of MultiModal Large Language Models against Jailbreak Attackscited by 230
18 more
- 2019Build it Break it Fix it for Dialogue Safety: Robustness from Adversarial Human Attackcited by 176
- 2024COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllabilitycited by 175
- 2023MART: Improving LLM Safety with Multi-round Automatic Red-Teamingcited by 163
- 2024Llama Guard 3 Vision: Safeguarding Human-AI Image Understanding Conversationscited by 129
- 2024AdaShield: Safeguarding Multimodal Large Language Models from Structure-based Attack via Adaptive Shield Promptingcited by 125
- 2024MLLM-Protector: Ensuring MLLM's Safety without Hurting Performancecited by 117
- 2023Explore, Establish, Exploit: Red Teaming Language Models from Scratchcited by 114
- 2024ALERT: A Comprehensive Benchmark for Assessing Large Language Models' Safety through Red Teamingcited by 98
- 2024ImgTrojan: Jailbreaking Vision-Language Models with ONE Imagecited by 57
- 2024Learning diverse attacks on large language models for robust red-teaming and safety tuningcited by 54
- 2024RedAgent: Red Teaming Large Language Models with Context-aware Autonomous Language Agentcited by 44
- 2024Arondight: Red Teaming Large Vision Language Models with Auto-generated Multi-modal Jailbreak Promptscited by 42
- 2025HiddenDetect: Detecting Jailbreak Attacks against Large Vision-Language Models via Monitoring Hidden Statescited by 33
- 2024BlueSuffix: Reinforced Blue Teaming for Vision-Language Models Against Jailbreak Attackscited by 28
- 2024Personalizing Multimodal Large Language Models for Image Captioning: An Experimental Analysiscited by 23
- 2025VLM-Guard: Safeguarding Vision-Language Models via Fulfilling Safety Alignment Gapcited by 17
- 2024Chain-of-Jailbreak Attack for Image Generation Models via Editing Step by Stepcited by 11
- 2023UniAR: A Unified model for predicting human Attention and Responses on visual contentcited by 7
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026A Systematic Investigation of RL-Jailbreaking in LLMscited by 0
- 2026ChainClaw: A Layered Agent Framework for Reliable On-Chain Executioncited by 0
- 2026ThinkingGuard: Decoding Implicit Hazards via Step-by-Step Risk Attribution in Multimodal Large Language Modelscited by 0
- 2026Can Vision-Language Models Stay Helpful When Facing Implicit Risks? Intent-Privilege OPSD for Efficient Safety-Helpfulness Alignmentcited by 0
- 2026Can Vision-Language Models Stay Helpful When Facing Implicit Risks? Intent-Privilege OPSD for Efficient Safety-Helpfulness Alignment29 Sep 2026
- 2026ThinkingGuard: Decoding Implicit Hazards via Step-by-Step Risk Attribution in Multimodal Large Language Models29 Sep 2026
- 2026ChainClaw: A Layered Agent Framework for Reliable On-Chain Execution6 Aug 2026
- 2026A Systematic Investigation of RL-Jailbreaking in LLMs7 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Cross-Modal Backdoors in Multimodal Large Language Models
- 2026Benign Inputs, Harmful Outputs: Cross-Modal Jailbreaking via Distributed Semantic Recomposition
- 2026SafeSteer: A Decoding-level Defense Mechanism for Multimodal Large Language Models
- 2026Securing Multimodal AI through Internal Information Decomposition
- 2025AprielGuard
- 2026Evolving Safety Landscape of Multi-modal Large Language Models: A Survey of Emerging Threats and Safeguards
- 2025PolyJailbreak: Cross-Modal Jailbreaking Attacks on Black-Box Multimodal LLMs
- 2024RapGuard: Safeguarding Multimodal Large Language Models via Rationale-aware Defensive Prompting