InfinityStory: Unlimited Video Generation with World Consistency and Character-Aware Shot Transitions
Not on the map. Why?
Abstract (arXiv)
Generating long-form storytelling videos with consistent visual narratives remains a significant challenge in video synthesis. We present a novel framework, dataset, and a model that address three critical limitations: background consistency across shots, seamless multi-subject shot-to-shot transitions, and scalability to hour-long narratives. Our approach introduces a background-consistent generation pipeline that maintains visual coherence across scenes while preserving character identity and spatial relationships. We further propose a transition-aware video synthesis module that generates smooth shot transitions for complex scenarios involving multiple subjects entering or exiting frames, going beyond the single-subject limitations of prior work. To support this, we contribute with a synthetic dataset of 10,000 multi-subject transition sequences covering underrepresented dynamic scene compositions. On VBench, InfinityStory achieves the highest Background Consistency (88.94), highest Subject Consistency (82.11), and the best overall average rank (2.80), showing improved stability, smoother transitions, and better temporal coherence.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 29 of its 34 references that are in the map. First posted on arXiv 4 Mar 2026.
Builds on
29 of 34 references.
References · 29
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2023TinyStories: How Small Can Language Models Be and Still Speak Coherent English?cited by 425
- 2024OmniGen: Unified Image Generationcited by 388
17 more
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
- 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 130
- 2025Long Context Tuning for Video Generationcited by 110
- 2024MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequencecited by 85
- 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 82
- 2023Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion Modelscited by 76
- 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videoscited by 62
- 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 51
- 2025VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual interventioncited by 33
- 2025FilMaster: Bridging Cinematic Principles and Generative AI for Automated Film Generationcited by 28
- 2025CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Modelscited by 26
- 2023StoryGPT-V: Large Language Models as Consistent Story Visualizerscited by 25
- 2025MAViS: A Multi-Agent Framework for Long-Sequence Video Storytellingcited by 19
- 2025Cut2Next: Generating Next Shot via In-Context Tuningcited by 15
- 2025AnimeShooter: A Multi-Shot Animation Dataset for Reference-Guided Video Generationcited by 8
- 2022V3GAN: Decomposing Background, Foreground and Motion for Video Generationcited by 1
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026The Pulse of Motion: Measuring Physical Frame Rate from Visual Dynamicscited by 7
- 2026GroundShot: Visually Consistent Multi-Shot Long Video Generation via Entity-Grounded Shot Schedulingcited by 4
- 2026FilmWorld: Agentic Novel-to-Film Generation through Dynamic Cinematic World Modelingcited by 2
- 2026RECAP-Forcing: Retaining Content Appearances for Long Video Generationcited by 2
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026RECAP-Forcing: Retaining Content Appearances for Long Video Generation27 Aug 2026
- 2026FilmWorld: Agentic Novel-to-Film Generation through Dynamic Cinematic World Modeling21 Jul 2026
- 2026GroundShot: Visually Consistent Multi-Shot Long Video Generation via Entity-Grounded Shot Scheduling18 Jun 2026
- 2026The Pulse of Motion: Measuring Physical Frame Rate from Visual Dynamics15 Mar 2026