StoryBlender: Inter-Shot Consistent and Editable 3D Storyboard with Spatial-temporal Dynamics
Not on the map. Why?
Abstract (arXiv)
Storyboarding is a core skill in visual storytelling for film, animation, and games. However, automating this process requires a system to achieve two properties that current approaches rarely satisfy simultaneously: inter-shot consistency and explicit editability. While 2D diffusion-based generators produce vivid imagery, they often suffer from identity drift along with limited geometric control; conversely, traditional 3D animation workflows are consistent and editable but require expert-heavy, labor-intensive authoring. We present StoryBlender, a grounded 3D storyboard generation framework governed by a Story-centric Reflection Scheme. At its core, we propose the StoryBlender system, which is built on a three-stage pipeline: (1) Semantic-Spatial Grounding, to construct a continuity memory graph to decouple global assets from shot-specific variables for long-horizon consistency; (2) Canonical Asset Materialization, to instantiate entities in a unified coordinate space to maintain visual identity; and (3) Spatial-Temporal Dynamics, to achieve layout design and cinematic evolution through visual metrics. By orchestrating multiple agents in a hierarchical manner within a verification loop, StoryBlender iteratively self-corrects spatial hallucinations via engine-verified feedback. The resulting native 3D scenes support direct, precise editing of cameras and visual assets while preserving unwavering multi-shot continuity. Experiments demonstrate that StoryBlender significantly improves consistency and editability over both diffusion-based and 3D-grounded baselines. Code, data, and demonstration video are available on https://engineeringai-lab.github.io/StoryBlender/
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 41 of its 48 references that are in the map. First posted on arXiv 1 Apr 2026.
Builds on
41 of 48 references.
References · 41
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2025Qwen-Image Technical Reportcited by 973
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
- 2024In-Context LoRA for Diffusion Transformerscited by 155
- 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 138
- 2024MMAudio: Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesiscited by 134
- 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Codecited by 125
- 2024Training-Free Consistent Text-to-Image Generationcited by 123
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
29 more
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
- 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 101
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 82
- 2023Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion Modelscited by 76
- 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agentcited by 53
- 2024DreamStory: Open-Domain Story Visualization by LLM-Guided Multi-Subject Consistent Diffusioncited by 46
- 2024SceneTeller: Language-to-3D Scene Generationcited by 43
- 2025StoryMem: Multi-shot Long Video Storytelling with Memorycited by 35
- 2024DreamFactory: Pioneering Multi-Scene Long Video Generation with a Multi-Agent Frameworkcited by 31
- 2024Open-World Human-Object Interaction Detection via Multi-modal Promptscited by 28
- 2025Direct Numerical Layout Generation for 3D Indoor Scene Synthesis via Spatial Reasoningcited by 27
- 2023Dynamic Storyboard Generation in an Engine-based Virtual Environment for Video Productioncited by 21
- 2025WorldCraft: Photo-Realistic 3D World Creation and Customization via LLM Agentscited by 21
- 2023Dance with You: The Diversity Controllable Dancer Generation via Diffusion Modelscited by 17
- 2025AniMaker: Multi-Agent Animated Storytelling with MCTS-Driven Clip Generationcited by 17
- 2025Sketch2Anim: Towards Transferring Sketch Storyboards into 3D Animationcited by 16
- 2025Story2Board: A Training-Free Approach for Expressive Storyboard Generationcited by 16
- 2025PAT3D: Physics-Augmented Text-to-3D Scene Generationcited by 14
- 2024Story3D-Agent: Exploring 3D Storytelling Visualization with Large Language Modelscited by 9
- 2023FreeMan: Towards Benchmarking 3D Human Pose Estimation under Real-World Conditionscited by 7
- 2024CinePreGen: Camera Controllable Video Previsualization via Engine-powered Diffusioncited by 7
- 2024Tri-Ergon: Fine-grained Video-to-Audio Generation with Multi-modal Conditions and LUFS Controlcited by 7
- 2025CineVision: An Interactive Pre-visualization Storyboard System for Director-Cinematographer Collaborationcited by 7
- 2025FairyGen: Storied Cartoon Video from a Single Child-Drawn Charactercited by 4
- 2026PrevizWhiz: Combining Rough 3D Scenes and 2D Video to Guide Generative Video Previsualizationcited by 4
- 2024T3-S2S: Training-free Triplet Tuning for Sketch to Scene Synthesis in Controllable Concept Art Generationcited by 2
- 2024Toward Scene Graph and Layout Guided Complex 3D Scene Generationcited by 2
- 2025Hierarchical and Step-Layer-Wise Tuning of Attention Specialty for Multi-Instance Synthesis in Diffusion Transformerscited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.