InSpatio-WorldFM: An Open-Source Real-Time Generative Frame Model
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
We present InSpatio-WorldFM, an open-source real-time frame model for spatial intelligence. Unlike video-based world models that rely on sequential frame generation and incur substantial latency due to window-level processing, InSpatio-WorldFM adopts a frame-based paradigm that generates each frame independently, enabling low-latency real-time spatial inference. By enforcing multi-view spatial consistency through explicit 3D anchors and implicit spatial memory, the model preserves global scene geometry while maintaining fine-grained visual details across viewpoint changes. We further introduce a progressive three-stage training pipeline that transforms a pretrained image diffusion model into a controllable frame model and finally into a real-time generator through few-step distillation. Experimental results show that InSpatio-WorldFM achieves strong multi-view consistency while supporting interactive exploration on consumer-grade GPUs, providing an efficient alternative to traditional video-based world models for real-time world simulation.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 41 of its 44 references that are in the map. First posted on arXiv 12 Mar 2026.
Builds on
41 of 44 references.
Closest ancestors · 8
Same direction, newest first
- 2026Advancing Open-source World Models28 Jan
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
- 2025Video World Models with Long-term Spatial Memory5 Jun
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2022Scalable Diffusion Models with Transformers19 Dec
Other references · 33
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
21 more
- 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 326
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 185
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 179
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
- 2023WonderJourney: Going from Anywhere to Everywherecited by 157
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
- 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 97
- 2025Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Controlcited by 95
- 2025Cameras as Relative Positional Encodingcited by 94
- 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generationcited by 93
- 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
- 2024Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusioncited by 76
- 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generationcited by 53
- 2023Diffusion360: Seamless 360 Degree Panoramic Image Generation based on Diffusion Modelscited by 49
- 2025StarGen: A Spatiotemporal Autoregression Framework with Video Diffusion Model for Scalable and Controllable Scene Generationcited by 26
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modelingcited by 18
- 2026Echo-Memory: A Controlled Study of Memory in Action World Modelscited by 4
- 2026From Pixels to States: Rethinking Interactive World Models as Game Enginescited by 4
- 2026MoVerse: Real-Time Video World Modeling with Panoramic Gaussian Scaffoldcited by 3
- 20263D-Anchored Lookahead Planning for Persistent Robotic Scene Memory via World-Model-Based MCTScited by 2
- 2026GameDirector: Decoupling Gameplay Logic from Rendering for Player-Configurable Game World Modelscited by 1
- 2026ST-Gen4D: Embedding 4D Spatiotemporal Cognition into World Model for 4D Generationcited by 0
- 2026GameDirector: Decoupling Gameplay Logic from Rendering for Player-Configurable Game World Models22 Sep 2026
- 2026From Pixels to States: Rethinking Interactive World Models as Game Engines15 Jul 2026
- 2026MoVerse: Real-Time Video World Modeling with Panoramic Gaussian Scaffold11 Jun 2026
- 2026Echo-Memory: A Controlled Study of Memory in Action World Models8 Jun 2026
- 2026ST-Gen4D: Embedding 4D Spatiotemporal Cognition into World Model for 4D Generation8 May 2026
- 20263D-Anchored Lookahead Planning for Persistent Robotic Scene Memory via World-Model-Based MCTS13 Apr 2026
- 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling8 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026RAYNOVA: Scale-Temporal Autoregressive World Modeling in Ray Space
- 2025Seeing through Imagination: Learning Scene Geometry via Implicit Spatial World Modeling
- 2026Where to Look: Can Foundation Models Reach a Target Viewpoint Through Active Exploration?
- 2026Exploring Spatial Intelligence from a Generative Perspective
- 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory
- 2026GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space
- 2025MindJourney: Test-Time Scaling with World Models for Spatial Reasoning
- 2026Beyond Pixel Histories: World Models with Persistent 3D State