SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
We introduce SolarWM, a fully open foundation for building interactive video world models from data preparation through long-horizon inference. Training across heterogeneous data sources and video backbones is challenging: datasets differ in temporal scale, camera geometry, visual quality, motion, and captioning styles, while video generators use distinct representations and architectures. Naive data mixing and model-specific implementations therefore produce inconsistent supervision and make results difficult to reproduce and compare. SolarWM addresses this coupling with a reconfigurable multi-source data engine and a backbone-native adaptation framework. The engine converts 1.43 million canonical clips from 10 datasets into a unified, frame-aligned contract covering visual observations, metric camera geometry, captions, quality metadata, selection decisions, and provenance, while decoupling source processing from mixture construction. Under shared camera-conditioning, training, and inference interfaces, we instantiate four 5B--33B models based on Wan2.2, LTX-2.5, and MiniMax-H3 while preserving their native representations and objectives. A unified three-stage recipe combines bidirectional adaptation, teacher-forced autoregressive initialization, and distribution matching distillation. The resulting causal models enable real-time interaction over rollouts ranging from minutes to hours after being trained on only 5s sequences. By releasing the resulting data, pipeline, recipes, weights, and framework, SolarWM provides a reproducible and extensible foundation for interactive world-model research.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 47 of its 59 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
47 of 59 references.
Closest ancestors · 22
Same direction, newest first
- 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory30 Aug
- 2026ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Models14 Aug
- 2026AlayaWorld: Interactive Long-Horizon World Modeling - Full Technical Report (v1.1)13 Aug
- 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU21 Jul
- 2026PhysEditWorld: A Large-Scale Dataset Toward Physics-Editable World Models25 Jun
- 2026DreamX-World 1.0: A General-Purpose Interactive World Model15 Jun
- 2026BiWM: Advancing Open-Source Interactive Video World Models with Bidirectional Autoregression8 Jun
- 2026minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Models28 May
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
- 2026MosaicMem: Hybrid Spatial Memory for Controllable Video World Models17 Mar
- 2026MIND: Benchmarking Memory Consistency and Action Control in World Models8 Feb
10 more
- 2026LIVE: Long-horizon Interactive Video World Modeling3 Feb
- 2026Advancing Open-source World Models28 Jan
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
- 2025Memory Forcing: Spatio-Temporal Memory for Consistent Scene Generation on Minecraft3 Oct
- 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modeling15 Sep
- 2025Yume: An Interactive World Generation Model23 Jul
- 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraft11 Apr
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2024Diffusion Models Are Real-Time Game Engines27 Aug
- 2024Genie: Generative Interactive Environments23 Feb
Other references · 25
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 488
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 213
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
- 2024MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captionscited by 144
13 more
- 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 72
- 2025Sekai: A Video Dataset towards World Explorationcited by 64
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generationcited by 44
- 2026Infinite Worlds with Versatile Interactionscited by 37
- 2026AnyFlow: Any-Step Video Diffusion Model with On-Policy Flow Map Distillationcited by 23
- 2026Astrolabe: Steering Forward-Process Reinforcement Learning for Distilled Autoregressive Video Modelscited by 15
- 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editingcited by 15
- 2025Edit360: 2D Image Edits to 3D Assets from Any Anglecited by 13
- 2025RealCam-Vid: High-resolution Video Dataset with Dynamic Scenes and Metric-scale Camera Movementscited by 12
- 2026RoboStereo: Dual-Tower 4D Embodied World Models for Unified Policy Optimizationcited by 9
- 2026SymphoMotion: Joint Control of Camera Motion and Object Dynamics for Coherent Video Generationcited by 9
- 2026KVPO: ODE-Native GRPO for Autoregressive Video Alignment via KV Semantic Explorationcited by 9
- 2025Composing Concepts from Images and Videos via Concept-prompt Bindingcited by 2
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Mask Forcing: Improving Autoregressive Video Diffusion Distillation via Dual-Noise Masking Rolloutcited by 2
- 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memorycited by 1
- 2026Precise Editing and Flexible Referencing for Interactable Worldscited by 1
- 2026WorldWeave: Growing Persistent Geometric Worlds for Video Generationcited by 0
- 2026LongLive-Plug: Once-for-All Distillation for Video Generationcited by 0
- 2026LOCI: Spatial Linear Memory for Streaming World Modelscited by 0
- 2026SGF+: Decoupling Gradient Flows for Autoregressive Video Generationcited by 0
- 2026AgentGarten: Code Worlds for Evolving Agentscited by 0
- 2026WorldCast: Distributed Multiplayer World Modelscited by 0
- 2026WorldCast: Distributed Multiplayer World Models8 Oct 2026
- 2026AgentGarten: Code Worlds for Evolving Agents8 Oct 2026
- 2026SGF+: Decoupling Gradient Flows for Autoregressive Video Generation7 Oct 2026
- 2026LOCI: Spatial Linear Memory for Streaming World Models30 Sep 2026
- 2026LongLive-Plug: Once-for-All Distillation for Video Generation29 Sep 2026
- 2026Precise Editing and Flexible Referencing for Interactable Worlds28 Sep 2026
- 2026WorldWeave: Growing Persistent Geometric Worlds for Video Generation28 Sep 2026
- 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory21 Sep 2026
- 2026Mask Forcing: Improving Autoregressive Video Diffusion Distillation via Dual-Noise Masking Rollout8 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Sekai2: From World Exploration to Interactive World Modeling
- 2026World in World: Explore the World with World Models
- 2024Owl-1: Omni World Model for Consistent Long Video Generation
- 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Models
- 2025LongVie 2: Multimodal Controllable Ultra-Long Video World Model
- 2026DreamWorld: Unified World Modeling in Video Generation
- 2025WorldWeaver: Generating Long-Horizon Video Worlds via Rich Perception
- 2025Can World Models Benefit VLMs for World Dynamics?