mlsanityData to 14 Oct 2026

CrossGuard: Safeguarding MLLMs against Joint-Modal Implicit Malicious Attacks

arXiv 2510.17687 ↗First posted 20 Oct 2025cs.CR cs.AIcited by 4

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 2 more
Abstract (arXiv)

Multimodal Large Language Models (MLLMs) achieve strong reasoning and perception capabilities but are increasingly vulnerable to jailbreak attacks. While existing work focuses on explicit attacks, where malicious content resides in a single modality, recent studies reveal implicit attacks, in which benign text and image inputs jointly express unsafe intent. Such joint-modal threats are difficult to detect and remain underexplored, largely due to the scarcity of high-quality implicit data. We propose ImpForge, an automated red-teaming pipeline that leverages reinforcement learning with tailored reward modules to generate diverse implicit samples across 14 domains. Building on this dataset, we further develop CrossGuard, an intent-aware safeguard providing robust and comprehensive defense against both explicit and implicit threats. Extensive experiments across safe and unsafe benchmarks, implicit and explicit attacks, and multiple out-of-domain settings demonstrate that CrossGuard significantly outperforms existing defenses, including advanced MLLMs and guardrails, achieving stronger security while maintaining high utility. This offers a balanced and practical solution for enhancing MLLM robustness against real-world multimodal threats. Our code is released: https://github.com/ZhangXu0963/CrossGuard.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 30 of its 50 references that are in the map. First posted on arXiv 20 Oct 2025.

Builds on

30 of 50 references.

References · 30

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2017Proximal Policy Optimization Algorithmscited by 15,215
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  6. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  7. 2022Red Teaming Language Models with Language Modelscited by 1,026
  8. 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
  9. 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Promptscited by 398
  10. 2021WIT: Wikipedia-based Image Text Dataset for Multimodal Multilingual Machine Learningcited by 287
  11. 2023Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language Modelscited by 273
  12. 2024JailBreakV: A Benchmark for Assessing the Robustness of MultiModal Large Language Models against Jailbreak Attackscited by 230
18 more
  1. 2019Build it Break it Fix it for Dialogue Safety: Robustness from Adversarial Human Attackcited by 176
  2. 2024COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllabilitycited by 175
  3. 2023MART: Improving LLM Safety with Multi-round Automatic Red-Teamingcited by 163
  4. 2024Llama Guard 3 Vision: Safeguarding Human-AI Image Understanding Conversationscited by 129
  5. 2024AdaShield: Safeguarding Multimodal Large Language Models from Structure-based Attack via Adaptive Shield Promptingcited by 125
  6. 2024MLLM-Protector: Ensuring MLLM's Safety without Hurting Performancecited by 117
  7. 2023Explore, Establish, Exploit: Red Teaming Language Models from Scratchcited by 114
  8. 2024ALERT: A Comprehensive Benchmark for Assessing Large Language Models' Safety through Red Teamingcited by 98
  9. 2024ImgTrojan: Jailbreaking Vision-Language Models with ONE Imagecited by 57
  10. 2024Learning diverse attacks on large language models for robust red-teaming and safety tuningcited by 54
  11. 2024RedAgent: Red Teaming Large Language Models with Context-aware Autonomous Language Agentcited by 44
  12. 2024Arondight: Red Teaming Large Vision Language Models with Auto-generated Multi-modal Jailbreak Promptscited by 42
  13. 2025HiddenDetect: Detecting Jailbreak Attacks against Large Vision-Language Models via Monitoring Hidden Statescited by 33
  14. 2024BlueSuffix: Reinforced Blue Teaming for Vision-Language Models Against Jailbreak Attackscited by 28
  15. 2024Personalizing Multimodal Large Language Models for Image Captioning: An Experimental Analysiscited by 23
  16. 2025VLM-Guard: Safeguarding Vision-Language Models via Fulfilling Safety Alignment Gapcited by 17
  17. 2024Chain-of-Jailbreak Attack for Image Generation Models via Editing Step by Stepcited by 11
  18. 2023UniAR: A Unified model for predicting human Attention and Responses on visual contentcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Cross-Modal Backdoors in Multimodal Large Language Models
  2. 2026Benign Inputs, Harmful Outputs: Cross-Modal Jailbreaking via Distributed Semantic Recomposition
  3. 2026SafeSteer: A Decoding-level Defense Mechanism for Multimodal Large Language Models
  4. 2026Securing Multimodal AI through Internal Information Decomposition
  5. 2025AprielGuard
  6. 2026Evolving Safety Landscape of Multi-modal Large Language Models: A Survey of Emerging Threats and Safeguards
  7. 2025PolyJailbreak: Cross-Modal Jailbreaking Attacks on Black-Box Multimodal LLMs
  8. 2024RapGuard: Safeguarding Multimodal Large Language Models via Rationale-aware Defensive Prompting