mlsanityData to 7 Oct 2026

InSpatio-WorldFM: An Open-Source Real-Time Generative Frame Model

arXiv 2603.11911 ↗First posted 12 Mar 2026cs.CVcited by 7

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

We present InSpatio-WorldFM, an open-source real-time frame model for spatial intelligence. Unlike video-based world models that rely on sequential frame generation and incur substantial latency due to window-level processing, InSpatio-WorldFM adopts a frame-based paradigm that generates each frame independently, enabling low-latency real-time spatial inference. By enforcing multi-view spatial consistency through explicit 3D anchors and implicit spatial memory, the model preserves global scene geometry while maintaining fine-grained visual details across viewpoint changes. We further introduce a progressive three-stage training pipeline that transforms a pretrained image diffusion model into a controllable frame model and finally into a real-time generator through few-step distillation. Experimental results show that InSpatio-WorldFM achieves strong multi-view consistency while supporting interactive exploration on consumer-grade GPUs, providing an efficient alternative to traditional video-based world models for real-time world simulation.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 41 of its 44 references that are in the map. First posted on arXiv 12 Mar 2026.

Builds on

41 of 44 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026Advancing Open-source World Models28 Jan
  2. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
  3. 2025Video World Models with Long-term Spatial Memory5 Jun
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  5. 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
  6. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  8. 2022Scalable Diffusion Models with Transformers19 Dec

Other references · 33

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  3. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  4. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  5. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  6. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  7. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  8. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
  9. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  10. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
  11. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
  12. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
21 more
  1. 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 326
  2. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  3. 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
  4. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
  5. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  6. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
  7. 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
  8. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 185
  9. 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 179
  10. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
  11. 2023WonderJourney: Going from Anywhere to Everywherecited by 157
  12. 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
  13. 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 97
  14. 2025Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Controlcited by 95
  15. 2025Cameras as Relative Positional Encodingcited by 94
  16. 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generationcited by 93
  17. 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
  18. 2024Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusioncited by 76
  19. 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generationcited by 53
  20. 2023Diffusion360: Seamless 360 Degree Panoramic Image Generation based on Diffusion Modelscited by 49
  21. 2025StarGen: A Spatiotemporal Autoregression Framework with Video Diffusion Model for Scalable and Controllable Scene Generationcited by 26

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026RAYNOVA: Scale-Temporal Autoregressive World Modeling in Ray Space
  2. 2025Seeing through Imagination: Learning Scene Geometry via Implicit Spatial World Modeling
  3. 2026Where to Look: Can Foundation Models Reach a Target Viewpoint Through Active Exploration?
  4. 2026Exploring Spatial Intelligence from a Generative Perspective
  5. 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory
  6. 2026GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space
  7. 2025MindJourney: Test-Time Scaling with World Models for Spatial Reasoning
  8. 2026Beyond Pixel Histories: World Models with Persistent 3D State