DreamShot: Personalized Storyboard Synthesis with Video Diffusion Prior
On the map: Diffusion models → Video generation
Abstract (arXiv)
Storyboard synthesis plays a crucial role in visual storytelling, aiming to generate coherent shot sequences that visually narrate cinematic events with consistent characters, scenes, and transitions. However, existing approaches are mostly adapted from text-to-image diffusion models, which struggle to maintain long-range temporal coherence, consistent character identities, and narrative flow across multiple shots. In this paper, we introduce DreamShot, a video generative model based storyboard framework that fully exploits powerful video diffusion priors for controllable multi-shot synthesis. DreamShot supports both Text-to-Shot and Reference-to-Shot generation, as well as story continuation conditioned on previous frames, enabling flexible and context-aware storyboard generation. By leveraging the spatial-temporal consistency inherent in video generative models, DreamShot produces visually and semantically coherent sequences with improved narrative fidelity and character continuity. Furthermore, DreamShot incorporates a multi-reference role conditioning module that accepts multiple character reference images and enforces identity alignment via a Role-Attention Consistency Loss, explicitly constraining attention between reference and generated roles. Extensive experiments demonstrate that DreamShot achieves superior scene coherence, role consistency, and generation efficiency compared to state-of-the-art text-to-image storyboard models, establishing a new direction toward controllable video model-driven visual storytelling.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 50 of its 59 references that are in the map. First posted on arXiv 19 Apr 2026.
Builds on
50 of 59 references.
Closest ancestors · 3
Same direction, newest first
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Models10 Jun
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation2 May
Other references · 47
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
35 more
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
- 2025Seed1.5-VL Technical Reportcited by 373
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
- 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 168
- 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generationcited by 156
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
- 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
- 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 135
- 2024Measuring Style Similarity in Diffusion Modelscited by 109
- 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
- 2025LongCat-Video Technical Reportcited by 85
- 2025DreamO: A Unified Framework for Image Customizationcited by 83
- 2022Make-A-Story: Visual Memory Conditioned Consistent Story Generationcited by 76
- 2024SEED-Story: Multimodal Long Story Generation with Large Language Modelcited by 73
- 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulationcited by 56
- 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 54
- 2025TokenVerse: Versatile Multi-concept Personalization in Token Modulation Spacecited by 52
- 2025Captain Cinema: Towards Short Movie Generationcited by 48
- 2024StoryMaker: Towards Holistic Consistent Characters in Text-to-image Generationcited by 29
- 2025VideoAuteur: Towards Long Narrative Video Generationcited by 18
- 2025DreamLayer: Simultaneous Multi-Layer Generation via Diffusion Modecited by 17
- 2025Story2Board: A Training-Free Approach for Expressive Storyboard Generationcited by 17
- 2025AnyStory: Towards Unified Single and Multiple Subject Personalization in Text-to-Image Generationcited by 16
- 2025MOSAIC: Multi-Subject Personalized Generation via Correspondence-Aware Alignment and Disentanglementcited by 14
- 2025DreamFuse: Adaptive Image Fusion with Diffusion Transformercited by 13
- 2025Mod-Adapter: Tuning-Free and Versatile Multi-concept Personalization via Modulation Adaptercited by 13
- 2024StoryWeaver: A Unified World Model for Knowledge-Enhanced Story Character Customizationcited by 10
- 2025STORYANCHORS: Generating Consistent Multi-Scene Story Frames for Long-Form Narrativescited by 9
- 2025A Survey on Long-Video Storytelling Generation: Architectures, Consistency, and Cinematic Qualitycited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025StoryMem: Multi-shot Long Video Storytelling with Memory
- 2024MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequence
- 2025SceneDecorator: Towards Scene-Oriented Story Generation with Scene Planning and Scene Consistency
- 2024DreamRunner: Fine-Grained Compositional Story-to-Video Generation with Retrieval-Augmented Motion Adaptation
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytelling
- 2026PersonaShot: Benchmarking Person-Centric Narrative Continuity in Multi-Shot Video Generation
- 2026ShotStream: Streaming Multi-Shot Video Generation for Interactive Storytelling
- 2026StoryEngine: A State-Grounded Agentic Framework for Video Storytelling