mlsanityData to 7 Oct 2026

When the Prompt Becomes Visual: Vision-Centric Jailbreak Attacks for Large Image Editing Models

arXiv 2602.10179 ↗First posted 10 Feb 2026cs.CV cs.AIcited by 2

On the map: LLM safety and security → Vision-language and text-to-image safety

Abstract (arXiv)

Recent advances in large image editing models have shifted the paradigm from text-driven instructions to vision-prompt editing, where user intent is inferred directly from visual inputs such as marks, arrows, and visual-text prompts. While this paradigm greatly expands usability, it also introduces a critical and underexplored safety risk: the attack surface itself becomes visual. In this work, we propose Vision-Centric Jailbreak Attack (VJA), the first visual-to-visual jailbreak attack that conveys malicious instructions purely through visual inputs. To systematically study this emerging threat, we introduce IESBench, a safety-oriented benchmark for image editing models. Extensive experiments on IESBench demonstrate that VJA effectively compromises state-of-the-art commercial models, achieving attack success rates of up to 80.9% on Nano Banana Pro and 70.1% on GPT-Image-1.5. To mitigate this vulnerability, we propose a training-free defense based on introspective multimodal reasoning, which substantially improves the safety of poorly aligned models to a level comparable with commercial systems, without auxiliary guard models and with negligible computational overhead. Our findings expose new vulnerabilities, provide both a benchmark and practical defense to advance safe and trustworthy modern image editing systems. Warning: This paper contains offensive images created by large image editing models.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Vision-language and text-to-image safety, one of 12 directions in LLM safety and security. Builds on 44 of its 50 references that are in the map. First posted on arXiv 10 Feb 2026.

Builds on

44 of 50 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Odysseus: Jailbreaking Commercial Multimodal LLM-integrated Systems via Dual Steganography23 Dec
  2. 2025Distraction is All You Need for Multimodal Large Language Model Jailbreaking15 Feb
  3. 2024Jailbreak Large Vision-Language Models Through Multi-Modal Linkage30 Nov
  4. 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Prompt6 Jun
  5. 2024White-box Multimodal Jailbreaks Against Large Vision-Language Models28 May
  6. 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Prompts9 Nov
  7. 2023On the Adversarial Robustness of Multi-Modal Foundation Models21 Aug
  8. 2023Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language Models26 Jul
  9. 2023Visual Adversarial Examples Jailbreak Aligned Large Language Models22 Jun

Other references · 35

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  5. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  6. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  7. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  8. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
  9. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
  10. 2025Qwen-Image Technical Reportcited by 973
  11. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  12. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
23 more
  1. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  2. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
  3. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 494
  4. 2023RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackcited by 404
  5. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
  6. 2015Visual7W: Grounded Question Answering in Imagescited by 315
  7. 2023MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Modelscited by 255
  8. 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 229
  9. 2025Video models are zero-shot learners and reasonerscited by 208
  10. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 182
  11. 2023Image Hijacks: Adversarial Images can Control Generative Models at Runtimecited by 165
  12. 2025Qwen3Guard Technical Reportcited by 125
  13. 2024Llama Guard 3 Vision: Safeguarding Human-AI Image Understanding Conversationscited by 118
  14. 2024Weak-to-Strong Jailbreaking on Large Language Modelscited by 100
  15. 2025LongCat-Image Technical Reportcited by 92
  16. 2025STAIR: Improving Safety Alignment with Introspective Reasoningcited by 72
  17. 2024Visual Hallucinations of Multi-modal Large Language Modelscited by 68
  18. 2024Perception Tokens Enhance Visual Reasoning in Multimodal Language Modelscited by 68
  19. 2023Ignore This Title and HackAPrompt: Exposing Systemic Vulnerabilities of LLMs through a Global Scale Prompt Hacking Competitioncited by 65
  20. 2024Rethinking Visual Prompting for Multimodal Large Language Models with External Knowledgecited by 13
  21. 2024CoMMIT: Coordinated Multimodal Instruction Tuningcited by 8
  22. 2025Visually Prompted Benchmarks Are Surprisingly Fragilecited by 6
  23. 2025VP-Bench: A Comprehensive Benchmark for Visual Prompting in Multimodal Large Language Modelscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Visual Safety: Jailbreaking Multimodal Large Language Models for Harmful Image Generation via Semantic-Agnostic Inputs
  2. 2026Fully Unleashing the Multimodal Attacker: Meta-Adaptive Jailbreaking of Vision-Language Models
  3. 2025PRISM: Programmatic Reasoning with Image Sequence Manipulation for LVLM Jailbreaking
  4. 2026Jailbreaking Vision-Language Models Through the Visual Modality
  5. 2024ImgTrojan: Jailbreaking Vision-Language Models with ONE Image
  6. 2026When Think-with-Image Meets Safety: What Determines Multimodal Jailbreak Robustness?
  7. 2026TYPO: Instruction-Dense Visual Jailbreaks against Commercial Closed-Source Image-Generation Models
  8. 2026Understanding and Defending VLM Jailbreaks via Jailbreak-Related Representation Shift