mlsanityData to 7 Oct 2026

Render Before Reading: Visual Rendering as a Prompt Injection Defense

arXiv 2609.36121 ↗First posted 28 Sep 2026cs.CR cs.AIcited by 0

On the map: LLM safety and security → Vision-language and text-to-image safety

Abstract (arXiv)

Large language models are vulnerable to prompt injection attacks, where third-party adversarial content can hijack the model's behavior. In this paper, we study the role played by the adversarial data's input modality, and identify a systematic asymmetry: multimodal LLMs are more likely to follow adversarial instruction when they appear as text than when the same instruction is delivered through a non-textual channel (e.g., as an image). We hypothesize that this modality gap arises from text-centric instruction tuning, which teaches models to obey textual instructions while treating other modalities mainly as content to parse or describe. We then demonstrate how this gap can be turned into a training-free defense, by rendering all untrusted payloads as typographic images (or audio) before they reach the model. Across ten models and two prompt injection benchmarks (DirectInject and AgentDojo) we show that our defense Pictionary consistently reduces attack success rates even against the strongest adaptive attacks and human red teamers, while largely preserving benign utility. We further show that benign fine-tuning on image-rendered instructions erodes the modality gap, tracing it to the text-centric instruction-tuning distribution.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Vision-language and text-to-image safety, one of 12 directions in LLM safety and security. Builds on 34 of its 40 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

34 of 40 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Image-based Prompt Injection: Hijacking Multimodal LLMs through Visually Embedded Adversarial Instructions4 Mar
  2. 2025PolyJailbreak: Cross-Modal Jailbreaking Attacks on Black-Box Multimodal LLMs20 Oct
  3. 2025AgentTypo: Adaptive Typographic Prompt Injection Attacks against Black-box Multimodal Agents5 Oct
  4. 2024Visual-RolePlay: Universal Jailbreak Attack on MultiModal Large Language Models via Role-playing Image Character25 May
  5. 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Prompts9 Nov

Other references · 29

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Visual Instruction Tuningcited by 7,792
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  5. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
  6. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
  7. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
  8. 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 591
  9. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  10. 2023SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilitiescited by 518
  11. 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 441
  12. 2025Defeating Prompt Injections by Designcited by 256
17 more
  1. 2023MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Modelscited by 255
  2. 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 233
  3. 2025DeepSeek-OCR: Contexts Optical Compressioncited by 174
  4. 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attackscited by 140
  5. 2023Tensor Trust: Interpretable Prompt Injection Attacks from an Online Gamecited by 135
  6. 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attackscited by 124
  7. 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 108
  8. 2024SafeBench: A Safety Evaluation Framework for Multimodal Large Language Modelscited by 63
  9. 2025VPI-Bench: Visual Prompt Injection Attacks for Computer-Use Agentscited by 42
  10. 2025AgentArmor: Enforcing Program Analysis on Agent Runtime Trace to Defend Against Prompt Injectioncited by 39
  11. 2025RL Is a Hammer and LLMs Are Nails: A Simple Reinforcement Learning Recipe for Strong Prompt Injectioncited by 32
  12. 2025Defending Against Prompt Injection with DataFiltercited by 30
  13. 2025ChatInject: Abusing Chat Templates for Prompt Injection in LLM Agentscited by 28
  14. 2025PromptLocate: Localizing Prompt Injection Attackscited by 23
  15. 2026Learning to Inject: Automated Prompt Injection via Reinforcement Learningcited by 14
  16. 2026Prompt Injection as Role Confusioncited by 11
  17. 2025Format as a Prior: Quantifying and Analyzing Bias in LLMs for Heterogeneous Datacited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Reading Between the Pixels: Linking Text-Image Embedding Alignment to Typographic Attack Success on Vision-Language Models
  2. 2026VisInject: Disruption != Injection -- A Dual-Dimension Evaluation of Universal Adversarial Attacks on Vision-Language Models
  3. 2026One Perturbation, Two Failure Modes: Probing VLM Safety via Embedding-Guided Typographic Perturbations
  4. 2025Con Instruction: Universal Jailbreaking of Multimodal Large Language Models via Non-Textual Modalities
  5. 2025Manipulating Multimodal Agents via Cross-Modal Prompt Injection
  6. 2026Covert Visual Prompt Injection against Commercial Multimodal Large Language Models
  7. 2025Seeing the Threat: Vulnerabilities in Vision-Language Models to Adversarial Attack
  8. 2025Innocence in the Crossfire: Roles of Skip Connections in Jailbreaking Visual Language Models