DrawVideo: Grounded and Faithful Multi-Shot Video Generation from Storyboard Keyframe Sketches
Not on the map. Why?
Abstract (arXiv)
Long video generation requires high-fidelity visual synthesis, coherent narrative organization, shot-level structure, and explicit user control. Existing text-to-video methods typically generate videos from a single long-form prompt, making it difficult for creators to directly control character pose, camera composition, spatial layout, and local motion. We propose DrawVideo, a sketch-guided and storyboard-driven framework that grounds multi-shot video generation in creator-provided spatial structure, appearance, and motion. Each shot is specified by a black-and-white sketch, an appearance prompt, and a motion prompt. DrawVideo first generates a structure-aligned reference keyframe, expands the motion description into derivative keyframes representing ordered action states, and then synthesizes local video clips between adjacent keyframes. We further introduce SketchLongVideo, to the best of our knowledge the first evaluation dataset of ordered multi-shot storyboards with aligned sketch, appearance, and motion conditions. Extensive experiments demonstrate strong structural controllability, appearance consistency, intra-shot visual stability, and motion alignment, providing an effective solution for director-oriented video creation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 49 references that are in the map. First posted on arXiv 22 May 2026.
Builds on
39 of 49 references.
References · 39
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
27 more
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 242
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
- 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 231
- 2023A Survey on Video Diffusion Modelscited by 203
- 2023NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generationcited by 170
- 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 138
- 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoisingcited by 135
- 2024Evaluation of Text-to-Video Generation Models: A Dynamics Perspectivecited by 66
- 2024A Survey on Long Video Generation: Challenges, Methods, and Prospectscited by 40
- 2023Picture that Sketch: Photorealistic Image Generation from Abstract Sketchescited by 34
- 2024SketchAgent: Language-Driven Sequential Sketch Generationcited by 30
- 2024StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaborationcited by 28
- 2024Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generationcited by 28
- 2024LVCD: Reference-based Lineart Video Colorization with Diffusion Modelscited by 27
- 2025STAGE: Storyboard-Anchored Generation for Cinematic Multi-shot Narrativecited by 23
- 2025LongVie: Multimodal-Guided Controllable Ultra-Long Video Generationcited by 21
- 2025VideoAuteur: Towards Long Narrative Video Generationcited by 17
- 2025SketchVideo: Sketch-based Video Generation and Editingcited by 15
- 2025VidSketch: Hand-drawn Sketch-Driven Video Generation with Diffusion Controlcited by 9
- 2024FlipSketch: Flipping Static Drawings to Text-Guided Sketch Animationscited by 8
- 2025AnimeShooter: A Multi-Shot Animation Dataset for Reference-Guided Video Generationcited by 8
- 2025LongAnimation: Long Animation Generation with Dynamic Global-Local Memorycited by 6
- 2022TeViS:Translating Text Synopses to Video Storyboardscited by 5
- 2023Sketch Video Synthesiscited by 4
- 2021Sketch Me A Videocited by 3
- 2026VideoSketcher: Sequential Sketch Generation Using Video Model Priorscited by 2
Built on by
Not cited yet.