mlsanityData to 14 Oct 2026

World Narrative Model for Highly Controllable Video Generation: A Paradigm Shift from Pixel Sampling to Physical World Orchestration

arXiv 2606.31946 ↗First posted 30 Jun 2026cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

The fundamental obstacle to industrial grade video generation is the lack of controllability: existing models treat video as a pixel distribution sampling problem, bypassing the explicit, instance level 4D (3D + T) physical world. Consequently, content creators cannot specify geometry, motion, camera parameters, or lighting in a deterministic, quantitative way, leading to the infamous ''gacha'' loop that makes professional content creation prohibitively inefficient and expensive. To address this, we introduce the World Narrative Model (WNM), a paradigm that decouples what to render -- the structured physical narrative -- from how to render -- the pixel generation process. WNM replaces end-to-end black-box sampling with orchestrated 4D pre-visualization for media generation. Collaborative agents translate sparse multimodal inputs, including text, reference videos, and sketches, into a fully editable world representation with scene geometry, object layouts, character/animal skeleton motion, trajectories, camera motion, and lighting at quantitative, physically meaningful granularity. This representation acts as a deterministic structural blueprint that drives existing video foundation models, either frozen or lightly adapted, to render final footage, turning the base model into a faithful neural shader. Built on this engine, our human-AI platform supports automatic world generation and pre-visualization aligned with professional filmmaking pipelines, while director consoles enable seamless human refinement. Experiments show that WNM greatly reduces probabilistic ``gacha'' calls and produces videos whose layout, motion, and cinematography closely follow creator intent. The framework is open and modular, allowing each component, such as world representation, control agents, and adapters, to be independently improved. Project website: https://glassroom.sjtu.edu.cn/WNM/.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 15 of its 33 references that are in the map. First posted on arXiv 30 Jun 2026.

Builds on

15 of 33 references.

References · 15

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  2. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  3. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  4. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  5. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  6. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  7. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
  8. 2025SAM 3D: 3Dfy Anything in Imagescited by 247
  9. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
  10. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
  11. 2025Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Modelcited by 80
  12. 2026SAM 3D Body: Robust Full-Body Human Mesh Recoverycited by 69
3 more
  1. 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modelingcited by 21
  2. 2025WorldGen: From Text to Traversable and Interactive 3D Worldscited by 19
  3. 2026Kling-MotionControl Technical Reportcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.