mlsanityData to 14 Oct 2026

Unsafe by Reciprocity: How Generation-Understanding Coupling Undermines Safety in Unified Multimodal Models

arXiv 2603.27332 ↗First posted 28 Mar 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Recent advances in Large Language Models (LLMs) and Text-to-Image (T2I) models have led to the emergence of Unified Multimodal Models (UMMs), where multimodal understanding and image generation are tightly integrated within a shared architecture. Prior studies suggest that such reciprocity enhances cross-functionality performance through shared representations and joint optimization. However, the safety implications of this tight coupling remain largely unexplored, as existing safety research predominantly analyzes understanding and generation functionalities in isolation. In this work, we investigate whether cross-functionality reciprocity itself constitutes a structural source of vulnerability in UMMs. We propose RICE: Reciprocal Interaction-based Cross-functionality Exploitation, a novel attack paradigm that explicitly exploits bidirectional interactions between understanding and generation. Using this framework, we systematically evaluate Generation-to-Understanding (G-U) and Understanding-to-Generation (U-G) attack pathways, demonstrating that unsafe intermediate signals can propagate across modalities and amplify safety risks. Extensive experiments show high Attack Success Rates (ASR) in both directions, revealing previously overlooked safety weaknesses inherent to UMMs.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 73 of its 81 references that are in the map. First posted on arXiv 28 Mar 2026.

Builds on

73 of 81 references.

References · 73

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2025Qwen3 Technical Reportcited by 8,820
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  7. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  8. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  9. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  10. 2025Qwen3-VL Technical Reportcited by 2,793
  11. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  12. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
38 more
  1. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
  2. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
  3. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  4. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  5. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  6. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 785
  7. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
  8. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  9. 2023Extracting Training Data from Diffusion Modelscited by 732
  10. 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automaticallycited by 672
  11. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 670
  12. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 536
  13. 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 513
  14. 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attackscited by 486
  15. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  16. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
  17. 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Promptscited by 398
  18. 2024OmniGen: Unified Image Generationcited by 394
  19. 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 295
  20. 2023MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Modelscited by 274
  21. 2023Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language Modelscited by 273
  22. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
  23. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
  24. 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 204
  25. 2023SneakyPrompt: Jailbreaking Text-to-image Generative Modelscited by 189
  26. 2024COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllabilitycited by 175
  27. 2024Images are Achilles' Heel of Alignment: Exploiting Visual Vulnerabilities for Jailbreaking Multimodal Large Language Modelscited by 136
  28. 2024Jailbreaking Attack against Multimodal Large Language Modelcited by 135
  29. 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Promptcited by 109
  30. 2024GradSafe: Detecting Jailbreak Prompts for LLMs via Safety-Critical Gradient Analysiscited by 96
  31. 2025Lumina-Image 2.0: A Unified and Efficient Image Generative Frameworkcited by 96
  32. 2023A Pilot Study of Query-Free Adversarial Attack against Stable Diffusioncited by 76
  33. 2024Jailbreaking Prompt Attack: A Controllable Adversarial Attack against Diffusion Modelscited by 72
  34. 2024Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defensescited by 70
  35. 2024SafeBench: A Safety Evaluation Framework for Multimodal Large Language Modelscited by 69
  36. 2025Parallel-R1: Towards Parallel Thinking via Reinforcement Learningcited by 61
  37. 2024White-box Multimodal Jailbreaks Against Large Vision-Language Modelscited by 59
  38. 2024Don't Say No: Jailbreaking LLM by Suppressing Refusalcited by 56

50 most cited of 73 All 73 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.