mlsanityData to 7 Oct 2026

VPA-Guard: Defending and Benchmarking Image-to-Video Generation Against Visual Prompt Attacks

arXiv 2606.25592 ↗First posted 24 Jun 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Recent advancements in Image-to-Video (I2V) generation have transformed input images from simple appearance references into interactive control interfaces where visual cues such as arrows, sketches, and emojis orchestrate complex video dynamics with unprecedented controllability. However, these seemingly innocuous static cues can be interpreted by models as executable temporal instructions, unfolding into harmful actions in the generated videos. Despite the severity of this threat, existing safety benchmarks remain predominantly focused on text-based and content-only image-based jailbreaks, leaving implicit visual prompt attacks insufficiently explored. To bridge this gap, we present VVA-Bench, the first systematic benchmark for evaluating video generation safety under categorized vision-centric prompt attacks. Extensive experiments on VVA-Bench demonstrate that state-of-the-art models are highly susceptible to such attacks, with Attack Success Rates (ASR) reaching 100.0% on Wan 2.7 and 74.8% on Veo 3.1. To mitigate these risks, we propose VPA-Guard, a retrieval-augmented and self-evolving defense framework. By leveraging few-shot reasoning to identify latent malicious intents, our method reduces the attack ASR by 44.2% and the harmfulness score by 73.4% on average, while maintaining the model's utility for legitimate user edits. Our work provides both a rigorous benchmark and an effective defense strategy to advance safe and socially responsible multimodal generation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 44 of its 64 references that are in the map. First posted on arXiv 24 Jun 2026.

Builds on

44 of 64 references.

References · 44

  1. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  3. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  4. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  5. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
  6. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
  7. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
  8. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 494
  9. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
  10. 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Promptscited by 368
  11. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
  12. 2015Visual7W: Grounded Question Answering in Imagescited by 315
32 more
  1. 2023Visual Adversarial Examples Jailbreak Aligned Large Language Modelscited by 307
  2. 2023MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Modelscited by 255
  3. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 182
  4. 2023Image Hijacks: Adversarial Images can Control Generative Models at Runtimecited by 165
  5. 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 138
  6. 2024SAFREE: Training-Free and Adaptive Guard for Safe Text-to-Image And Video Generationcited by 125
  7. 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Promptcited by 103
  8. 2024Weak-to-Strong Jailbreaking on Large Language Modelscited by 100
  9. 2025STAIR: Improving Safety Alignment with Introspective Reasoningcited by 72
  10. 2024Visual Hallucinations of Multi-modal Large Language Modelscited by 68
  11. 2024Perception Tokens Enhance Visual Reasoning in Multimodal Language Modelscited by 68
  12. 2024T2VSafetyBench: Evaluating the Safety of Text-to-Video Generative Modelscited by 66
  13. 2024Video Diffusion Models are Training-free Motion Interpreter and Controllercited by 60
  14. 2025MagicMotion: Controllable Video Generation with Dense-to-Sparse Trajectory Guidancecited by 60
  15. 2024UnsafeBench: Benchmarking Image Safety Classifiers on Real-World and AI-Generated Imagescited by 52
  16. 2023DragVideo: Interactive Drag-style Video Editingcited by 40
  17. 2025Distraction is All You Need for Multimodal Large Language Model Jailbreakingcited by 31
  18. 2025T2V-OptJail: Discrete Prompt Optimization for Text-to-Video Jailbreak Attackscited by 18
  19. 2025T2VShield: Model-Agnostic Jailbreak Defense for Text-to-Video Modelscited by 17
  20. 2025Extrapolating and Decoupling Image-to-Video Generation Models: Motion Modeling is Easier Than You Thinkcited by 12
  21. 2025Video Unlearning via Low-Rank Refusal Vectorcited by 11
  22. 2025Jailbreaking on Text-to-Video Models via Scene Splitting Strategycited by 10
  23. 2025Visual Prompting for One-shot Controllable Video Editing without Inversioncited by 8
  24. 2025Modular-Cam: Modular Dynamic Camera-view Video Generation with LLMcited by 7
  25. 2025Vid-Freeze: Protecting Images from Malicious Image-to-Video Generation via Temporal Freezingcited by 7
  26. 2025Visually Prompted Benchmarks Are Surprisingly Fragilecited by 6
  27. 2026VII: Visual Instruction Injection for Jailbreaking Image-to-Video Generation Modelscited by 6
  28. 2025ConceptGuard: Proactive Safety in Text-and-Image-to-Video Generation through Multimodal Risk Detectioncited by 5
  29. 2025VP-Bench: A Comprehensive Benchmark for Visual Prompting in Multimodal Large Language Modelscited by 4
  30. 2025SPARK: Jailbreaking T2V Models by Synergistically Prompting Auditory and Recontextualized Knowledgecited by 4
  31. 2025NSFW-Classifier Guided Prompt Sanitization for Safe Text-to-Image Generationcited by 3
  32. 2026When the Prompt Becomes Visual: Vision-Centric Jailbreak Attacks for Large Image Editing Modelscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026TempJail: Temporal Jailbreak Attacks against Image-to-Video Generation Models
  2. 2026Anti-I2V: Safeguarding your photos from malicious image-to-video generation
  3. 2026On Success and Simplicity: A Second Look at Transferable Vision-Language Attack Pipeline
  4. 2026I2VShield: An Efficient Proactive Defense Framework against DiT-based Image-to-Video Models
  5. 2024Empirical Analysis of Large Vision-Language Models against Goal Hijacking via Visual Prompt Injection
  6. 2026V-DEAL: Diagnosing Video Safety De-Calibration as an Understanding-Refusal Coupling Failure
  7. 2026Visual Memory Injection Attacks for Multi-Turn Conversations
  8. 2025CAVALRY-V: A Large-Scale Generator Framework for Adversarial Attacks on Video MLLMs