mlsanityData to 7 Oct 2026

InfinityStory: Unlimited Video Generation with World Consistency and Character-Aware Shot Transitions

arXiv 2603.03646 ↗First posted 4 Mar 2026cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Generating long-form storytelling videos with consistent visual narratives remains a significant challenge in video synthesis. We present a novel framework, dataset, and a model that address three critical limitations: background consistency across shots, seamless multi-subject shot-to-shot transitions, and scalability to hour-long narratives. Our approach introduces a background-consistent generation pipeline that maintains visual coherence across scenes while preserving character identity and spatial relationships. We further propose a transition-aware video synthesis module that generates smooth shot transitions for complex scenarios involving multiple subjects entering or exiting frames, going beyond the single-subject limitations of prior work. To support this, we contribute with a synthetic dataset of 10,000 multi-subject transition sequences covering underrepresented dynamic scene compositions. On VBench, InfinityStory achieves the highest Background Consistency (88.94), highest Subject Consistency (82.11), and the best overall average rank (2.80), showing improved stability, smoother transitions, and better temporal coherence.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 29 of its 34 references that are in the map. First posted on arXiv 4 Mar 2026.

Builds on

29 of 34 references.

References · 29

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  5. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  6. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  7. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  8. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  9. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  10. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  11. 2023TinyStories: How Small Can Language Models Be and Still Speak Coherent English?cited by 425
  12. 2024OmniGen: Unified Image Generationcited by 388
17 more
  1. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
  2. 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
  3. 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 130
  4. 2025Long Context Tuning for Video Generationcited by 110
  5. 2024MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequencecited by 85
  6. 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 82
  7. 2023Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion Modelscited by 76
  8. 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videoscited by 62
  9. 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 51
  10. 2025VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual interventioncited by 33
  11. 2025FilMaster: Bridging Cinematic Principles and Generative AI for Automated Film Generationcited by 28
  12. 2025CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Modelscited by 26
  13. 2023StoryGPT-V: Large Language Models as Consistent Story Visualizerscited by 25
  14. 2025MAViS: A Multi-Agent Framework for Long-Sequence Video Storytellingcited by 19
  15. 2025Cut2Next: Generating Next Shot via In-Context Tuningcited by 15
  16. 2025AnimeShooter: A Multi-Shot Animation Dataset for Reference-Guided Video Generationcited by 8
  17. 2022V3GAN: Decomposing Background, Foreground and Motion for Video Generationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.