TYPO: Instruction-Dense Visual Jailbreaks against Commercial Closed-Source Image-Generation Models
On the map: LLM safety and security → Vision-language and text-to-image safety
Abstract (arXiv)
Recent commercial image-generation models can generate high-quality images with readable text (e.g., posters, infographics, and manuals), attracting considerable attention. Yet we first show that this same capability also introduces a previously unreported safety vulnerability: these systems may refuse to generate harmful text directly, yet permit the same content when rendered as text within generated images, i.e., safety alignment does not reliably transfer from textual outputs to text embedded in images. In this paper, unlike existing visual jailbreaks against image-generation models, which primarily induce models to generate harmful visual objects or scenes, we introduce the concept of instruction-dense visual jailbreaks, in which image-generation models produce detailed, readable, and actionable harmful instructions within images. Such outputs can amplify harm because the rendered instructions can be readily read and widely spread. To instantiate this threat, we propose TYPO, a black-box framework that exploits this safety gap by automatically generating adversarial TYPOgraphy prompts, which covertly steer image-generation models to express harmful intent as highly legible, typographically structured text. Specifically, TYPO decomposes prompt generation into two channels: a textual channel for reframing the target intent, and a visual channel for specifying its presentation form. We formulate these two channels as a dual-channel textual-visual strategy space and optimize candidate strategy combinations through an adaptive combinatorial search. Extensive experiments across four commercial models (i.e., GPT-Image-2, Nano Banana Pro, Qwen-Image-2, and Seedream 5.0 Lite) show that TYPO substantially outperforms nine representative jailbreak attacks by 50.2% in ASR on average, while incurring an average query cost of only 0.04.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Vision-language and text-to-image safety, one of 12 directions in LLM safety and security. Builds on 24 of its 42 references that are in the map. First posted on arXiv 27 Jul 2026.
Builds on
24 of 42 references.
Closest ancestors · 4
Same direction, newest first
- 2024Fuzz-Testing Meets LLM-Based Agents: An Automated and Efficient Framework for Jailbreaking Text-To-Image Generation Models1 Aug
- 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Prompts9 Nov
- 2023SneakyPrompt: Jailbreaking Text-to-image Generative Models20 May
- 2022Red-Teaming the Stable Diffusion Safety Filter3 Oct
Other references · 20
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
- 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automaticallycited by 672
- 2023GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Promptscited by 560
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 513
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 229
- 2021Design Guidelines for Prompt Engineering Text-to-Image Generative Modelscited by 218
- 2024AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to Jailbreak LLMscited by 199
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 170
8 more
- 2022Can Machines Help Us Answering Question 16 in Datasheets, and In Turn Reflecting on Inappropriate Content?cited by 155
- 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 53
- 2024BadRobot: Jailbreaking Embodied LLM Agents in the Physical Worldcited by 43
- 2026Qwen-Image-2.0 Technical Reportcited by 36
- 2025ADVEDM:Fine-grained Adversarial Attack against VLM-based Embodied Agentscited by 23
- 2024An Interpretable N-gram Perplexity Threat Model for Large Language Model Jailbreakscited by 11
- 2025Text to Image Generation and Editing: A Surveycited by 8
- 2026Defending Jailbreak Attacks on Large Language Models via Manifold Trajectory Kineticscited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Low-Effort Jailbreak Attacks Against Text-to-Image Safety Filters
- 2026Reading Between the Pixels: An Inscriptive Jailbreak Attack on Text-to-Image Models
- 2026VII: Visual Instruction Injection for Jailbreaking Image-to-Video Generation Models
- 2026When the Prompt Becomes Visual: Vision-Centric Jailbreak Attacks for Large Image Editing Models
- 2026Beyond Visual Safety: Jailbreaking Multimodal Large Language Models for Harmful Image Generation via Semantic-Agnostic Inputs
- 2026Open Models, Open Risks: Measuring Unsafe Generation in Text-to-Image Models In the Wild
- 2026Jailbreaking Vision-Language Models Through the Visual Modality
- 2025SCAM: A Real-World Typographic Robustness Evaluation for Multimodal Foundation Models