mlsanityData to 14 Oct 2026

Jailbreaking on Text-to-Video Models via Scene Splitting Strategy

arXiv 2509.22292 ↗First posted 26 Sep 2025cs.CV cs.AIcited by 12

On the map: LLM safety and security → Vision-language and text-to-image safety

Abstract (arXiv)

Along with the rapid advancement of numerous Text-to-Video (T2V) models, growing concerns have emerged regarding their safety risks. While recent studies have explored vulnerabilities in models like LLMs, VLMs, and Text-to-Image (T2I) models through jailbreak attacks, T2V models remain largely unexplored, leaving a significant safety gap. To address this gap, we introduce SceneSplit, a novel black-box jailbreak method that works by fragmenting a harmful narrative into multiple scenes, each individually benign. This approach manipulates the generative output space, the abstract set of all potential video outputs for a given prompt, using the combination of scenes as a powerful constraint to guide the final outcome. While each scene individually corresponds to a wide and safe space where most outcomes are benign, their sequential combination collectively restricts this space, narrowing it to an unsafe region and significantly increasing the likelihood of generating a harmful video. This core mechanism is further enhanced through iterative scene manipulation, which bypasses the safety filter within this constrained unsafe region. Additionally, a strategy library that reuses successful attack patterns further improves the attack's overall effectiveness and robustness. To validate our method, we evaluate SceneSplit across 11 safety categories from T2VSafetyBench on T2V models. Our results show that it achieves a high average Attack Success Rate (ASR) of 77.2% on Luma Ray2, 84.1% on Hailuo, 78.2% on Veo2, 78.6% on Kling V1.0, and 68.6% on Sora2, significantly outperforming the existing baselines. Through this work, we demonstrate that current T2V safety mechanisms are vulnerable to attacks that exploit narrative structure, providing new insights for understanding and improving the safety of T2V models.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Vision-language and text-to-image safety, one of 12 directions in LLM safety and security. Builds on 29 of its 39 references that are in the map. First posted on arXiv 26 Sep 2025.

Builds on

29 of 39 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Red-Teaming Text-to-Image Systems by Rule-based Preference Modeling27 May
  2. 2025Are Vision-Language Models Safe in the Wild? A Meme-Based Benchmark Study21 May
  3. 2025ELITE: Enhanced Language-Image Toxicity Evaluation for Safety7 Feb
  4. 2024Jailbreaking Prompt Attack: A Controllable Adversarial Attack against Diffusion Models2 Apr
  5. 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Prompts9 Nov
  6. 2023Ring-A-Bell! How Reliable are Concept Removal Methods for Diffusion Models?16 Oct
  7. 2023Prompting4Debugging: Red-Teaming Text-to-Image Diffusion Models by Finding Problematic Prompts12 Sep

Other references · 22

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2025Qwen3 Technical Reportcited by 8,820
  5. 2024GPT-4o System Cardcited by 4,588
  6. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  7. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
  8. 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 489
  9. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  10. 2023Jailbreak and Guard Aligned Language Models with Only Few In-Context Demonstrationscited by 431
  11. 2023GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Ciphercited by 423
  12. 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 356
10 more
  1. 2024AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to Jailbreak LLMscited by 199
  2. 2023MMA-Diffusion: MultiModal Attack on Diffusion Modelscited by 194
  3. 2022Can Machines Help Us Answering Question 16 in Datasheets, and In Turn Reflecting on Inappropriate Content?cited by 155
  4. 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Modelscited by 131
  5. 2023Cognitive Overload: Jailbreaking Large Language Models with Overloaded Logical Thinkingcited by 81
  6. 2024T2VSafetyBench: Evaluating the Safety of Text-to-Video Generative Modelscited by 66
  7. 2024Learning diverse attacks on large language models for robust red-teaming and safety tuningcited by 54
  8. 2024BSPA: Exploring Black-box Stealthy Prompt Attacks against Image Generatorscited by 7
  9. 2024ShieldDiff: Suppressing Sexual Content Generation from Diffusion Models through Reinforcement Learningcited by 7
  10. 2025Better Safe Than Sorry? Overreaction Problem of Vision Language Models in Visual Emergency Recognitioncited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 11.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025T2V-OptJail: Discrete Prompt Optimization for Text-to-Video Jailbreak Attacks
  2. 2024Multimodal Pragmatic Jailbreak on Text-to-image Models
  3. 2025T2VShield: Model-Agnostic Jailbreak Defense for Text-to-Video Models
  4. 2026Low-Effort Jailbreak Attacks Against Text-to-Image Safety Filters
  5. 2026SceneJail: Exploiting Video Scenario Context to Jailbreak Multimodal LLMs
  6. 2026Open Models, Open Risks: Measuring Unsafe Generation in Text-to-Image Models In the Wild
  7. 2026Jailbreaking Multimodal Large Language Models using Multi-Clip Video
  8. 2025SPARK: Jailbreaking T2V Models by Synergistically Prompting Auditory and Recontextualized Knowledge