CollageAttack: Exploiting Cross-Modal Alignment Flaws in T2I Models through Spatial Text Composition
On the map: LLM safety and security → Vision-language and text-to-image safety
Abstract (arXiv)
Text-to-image (T2I) models have substantially improved in language understanding, in-image text rendering, and visual composition, while their safety mechanisms do not always keep pace with these capabilities. This creates a cross-modal attack surface in which harmful semantics can remain inconspicuous in a serialized prompt yet emerge through image-level composition. We propose CollageAttack, an automated single-prompt black-box jailbreak that shifts semantic assembly into the image plane by combining context-relevant scenes, scene-grounded textual carriers, and spatially distributed text fragments. Experiments across multiple open-weight and commercial T2I models show that CollageAttack achieves attack success rates of up to 86.0%, outperforming the strongest baseline on the same model by 18.5 percentage points, while consistently producing more harmful outputs and preserving the source intent. We further find that distributed textual fragments can reconstruct the intended semantics after generation, with visual composition producing stronger communicative impact than text alone. These results reveal a cross-modal safety gap in which harmful meaning emerges from the composition of individually less explicit elements.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Vision-language and text-to-image safety, one of 12 directions in LLM safety and security. Builds on 18 of its 22 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
18 of 22 references.
Closest ancestors · 5
Same direction, newest first
- 2025Jailbreaking Safeguarded Text-to-Image Models via Large Language Models3 Mar
- 2024Chain-of-Jailbreak Attack for Image Generation Models via Editing Step by Step4 Oct
- 2024Perception-guided Jailbreak against Text-to-Image Models20 Aug
- 2024Fuzz-Testing Meets LLM-Based Agents: An Automated and Efficient Framework for Jailbreaking Text-To-Image Generation Models1 Aug
- 2023SneakyPrompt: Jailbreaking Text-to-image Generative Models20 May
Other references · 13
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
- 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 221
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
- 2024MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?cited by 66
- 2026HiDream-O1-Image: A Natively Unified Image Generative Foundation Model with Pixel-level Unified Transformercited by 32
- 2023MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteriacited by 27
- 2025Multimodal RewardBench 2: Evaluating Omni Reward Models for Interleaved Text and Imagecited by 20
1 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Arena-T2I Hard: Benchmarking and Improving Faithfulness with Dependency-Aware Checklist
- 2025Easier Painting Than Thinking: Can Text-to-Image Models Set the Stage, but Not Direct the Play?
- 2025Text Speaks Louder than Vision: ASCII Art Reveals Textual Biases in Vision-Language Models
- 2025DeCoT: Decomposing Complex Instructions for Enhanced Text-to-Image Generation with Large Language Models
- 2025HCMA: Hierarchical Cross-model Alignment for Grounded Text-to-Image Generation
- 2025Security Tensors as a Cross-Modal Bridge: Extending Text-Aligned Safety to Vision in LVLM
- 2026One Perturbation, Two Failure Modes: Probing VLM Safety via Embedding-Guided Typographic Perturbations
- 2025REVEALER: Reinforcement-Guided Visual Reasoning for Element-Level Text-Image Alignment Evaluation