mlsanityData to 14 Oct 2026

DreamShot: Personalized Storyboard Synthesis with Video Diffusion Prior

arXiv 2604.17195 ↗First posted 19 Apr 2026cs.CVcited by 1

On the map: Diffusion models → Video generation

Abstract (arXiv)

Storyboard synthesis plays a crucial role in visual storytelling, aiming to generate coherent shot sequences that visually narrate cinematic events with consistent characters, scenes, and transitions. However, existing approaches are mostly adapted from text-to-image diffusion models, which struggle to maintain long-range temporal coherence, consistent character identities, and narrative flow across multiple shots. In this paper, we introduce DreamShot, a video generative model based storyboard framework that fully exploits powerful video diffusion priors for controllable multi-shot synthesis. DreamShot supports both Text-to-Shot and Reference-to-Shot generation, as well as story continuation conditioned on previous frames, enabling flexible and context-aware storyboard generation. By leveraging the spatial-temporal consistency inherent in video generative models, DreamShot produces visually and semantically coherent sequences with improved narrative fidelity and character continuity. Furthermore, DreamShot incorporates a multi-reference role conditioning module that accepts multiple character reference images and enforces identity alignment via a Role-Attention Consistency Loss, explicitly constraining attention between reference and generated roles. Extensive experiments demonstrate that DreamShot achieves superior scene coherence, role consistency, and generation efficiency compared to state-of-the-art text-to-image storyboard models, establishing a new direction toward controllable video model-driven visual storytelling.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 50 of its 59 references that are in the map. First posted on arXiv 19 Apr 2026.

Builds on

50 of 59 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Models10 Jun
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  3. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation2 May

Other references · 47

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2022Scalable Diffusion Models with Transformerscited by 6,054
  4. 2022Classifier-Free Diffusion Guidancecited by 5,847
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  6. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  8. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  10. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  11. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  12. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
35 more
  1. 2025Qwen-Image Technical Reportcited by 1,044
  2. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  3. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  4. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
  5. 2025Seed1.5-VL Technical Reportcited by 373
  6. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
  7. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
  8. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
  9. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
  10. 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 168
  11. 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generationcited by 156
  12. 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
  13. 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
  14. 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 135
  15. 2024Measuring Style Similarity in Diffusion Modelscited by 109
  16. 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
  17. 2025LongCat-Video Technical Reportcited by 85
  18. 2025DreamO: A Unified Framework for Image Customizationcited by 83
  19. 2022Make-A-Story: Visual Memory Conditioned Consistent Story Generationcited by 76
  20. 2024SEED-Story: Multimodal Long Story Generation with Large Language Modelcited by 73
  21. 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulationcited by 56
  22. 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 54
  23. 2025TokenVerse: Versatile Multi-concept Personalization in Token Modulation Spacecited by 52
  24. 2025Captain Cinema: Towards Short Movie Generationcited by 48
  25. 2024StoryMaker: Towards Holistic Consistent Characters in Text-to-image Generationcited by 29
  26. 2025VideoAuteur: Towards Long Narrative Video Generationcited by 18
  27. 2025DreamLayer: Simultaneous Multi-Layer Generation via Diffusion Modecited by 17
  28. 2025Story2Board: A Training-Free Approach for Expressive Storyboard Generationcited by 17
  29. 2025AnyStory: Towards Unified Single and Multiple Subject Personalization in Text-to-Image Generationcited by 16
  30. 2025MOSAIC: Multi-Subject Personalized Generation via Correspondence-Aware Alignment and Disentanglementcited by 14
  31. 2025DreamFuse: Adaptive Image Fusion with Diffusion Transformercited by 13
  32. 2025Mod-Adapter: Tuning-Free and Versatile Multi-concept Personalization via Modulation Adaptercited by 13
  33. 2024StoryWeaver: A Unified World Model for Knowledge-Enhanced Story Character Customizationcited by 10
  34. 2025STORYANCHORS: Generating Consistent Multi-Scene Story Frames for Long-Form Narrativescited by 9
  35. 2025A Survey on Long-Video Storytelling Generation: Architectures, Consistency, and Cinematic Qualitycited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025StoryMem: Multi-shot Long Video Storytelling with Memory
  2. 2024MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequence
  3. 2025SceneDecorator: Towards Scene-Oriented Story Generation with Scene Planning and Scene Consistency
  4. 2024DreamRunner: Fine-Grained Compositional Story-to-Video Generation with Retrieval-Augmented Motion Adaptation
  5. 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytelling
  6. 2026PersonaShot: Benchmarking Person-Centric Narrative Continuity in Multi-Shot Video Generation
  7. 2026ShotStream: Streaming Multi-Shot Video Generation for Interactive Storytelling
  8. 2026StoryEngine: A State-Grounded Agentic Framework for Video Storytelling