mlsanityData to 7 Oct 2026

SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models

arXiv 2609.02886 ↗First posted 2 Sep 2026cs.CVcited by 9

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

We introduce SolarWM, a fully open foundation for building interactive video world models from data preparation through long-horizon inference. Training across heterogeneous data sources and video backbones is challenging: datasets differ in temporal scale, camera geometry, visual quality, motion, and captioning styles, while video generators use distinct representations and architectures. Naive data mixing and model-specific implementations therefore produce inconsistent supervision and make results difficult to reproduce and compare. SolarWM addresses this coupling with a reconfigurable multi-source data engine and a backbone-native adaptation framework. The engine converts 1.43 million canonical clips from 10 datasets into a unified, frame-aligned contract covering visual observations, metric camera geometry, captions, quality metadata, selection decisions, and provenance, while decoupling source processing from mixture construction. Under shared camera-conditioning, training, and inference interfaces, we instantiate four 5B--33B models based on Wan2.2, LTX-2.5, and MiniMax-H3 while preserving their native representations and objectives. A unified three-stage recipe combines bidirectional adaptation, teacher-forced autoregressive initialization, and distribution matching distillation. The resulting causal models enable real-time interaction over rollouts ranging from minutes to hours after being trained on only 5s sequences. By releasing the resulting data, pipeline, recipes, weights, and framework, SolarWM provides a reproducible and extensible foundation for interactive world-model research.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 47 of its 59 references that are in the map. First posted on arXiv 2 Sep 2026.

Builds on

47 of 59 references.

Closest ancestors · 22

Same direction, newest first

  1. 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory30 Aug
  2. 2026ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Models14 Aug
  3. 2026AlayaWorld: Interactive Long-Horizon World Modeling - Full Technical Report (v1.1)13 Aug
  4. 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU21 Jul
  5. 2026PhysEditWorld: A Large-Scale Dataset Toward Physics-Editable World Models25 Jun
  6. 2026DreamX-World 1.0: A General-Purpose Interactive World Model15 Jun
  7. 2026BiWM: Advancing Open-Source Interactive Video World Models with Bidirectional Autoregression8 Jun
  8. 2026minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Models28 May
  9. 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May
  10. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
  11. 2026MosaicMem: Hybrid Spatial Memory for Controllable Video World Models17 Mar
  12. 2026MIND: Benchmarking Memory Consistency and Action Control in World Models8 Feb
10 more
  1. 2026LIVE: Long-horizon Interactive Video World Modeling3 Feb
  2. 2026Advancing Open-source World Models28 Jan
  3. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
  4. 2025Memory Forcing: Spatio-Temporal Memory for Consistent Scene Generation on Minecraft3 Oct
  5. 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modeling15 Sep
  6. 2025Yume: An Interactive World Generation Model23 Jul
  7. 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraft11 Apr
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  9. 2024Diffusion Models Are Real-Time Game Engines27 Aug
  10. 2024Genie: Generative Interactive Environments23 Feb

Other references · 25

  1. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
  2. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  3. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  4. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  5. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  6. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 488
  7. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  8. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
  9. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  10. 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 213
  11. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
  12. 2024MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captionscited by 144
13 more
  1. 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 72
  2. 2025Sekai: A Video Dataset towards World Explorationcited by 64
  3. 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generationcited by 44
  4. 2026Infinite Worlds with Versatile Interactionscited by 37
  5. 2026AnyFlow: Any-Step Video Diffusion Model with On-Policy Flow Map Distillationcited by 23
  6. 2026Astrolabe: Steering Forward-Process Reinforcement Learning for Distilled Autoregressive Video Modelscited by 15
  7. 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editingcited by 15
  8. 2025Edit360: 2D Image Edits to 3D Assets from Any Anglecited by 13
  9. 2025RealCam-Vid: High-resolution Video Dataset with Dynamic Scenes and Metric-scale Camera Movementscited by 12
  10. 2026RoboStereo: Dual-Tower 4D Embodied World Models for Unified Policy Optimizationcited by 9
  11. 2026SymphoMotion: Joint Control of Camera Motion and Object Dynamics for Coherent Video Generationcited by 9
  12. 2026KVPO: ODE-Native GRPO for Autoregressive Video Alignment via KV Semantic Explorationcited by 9
  13. 2025Composing Concepts from Images and Videos via Concept-prompt Bindingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Sekai2: From World Exploration to Interactive World Modeling
  2. 2026World in World: Explore the World with World Models
  3. 2024Owl-1: Omni World Model for Consistent Long Video Generation
  4. 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Models
  5. 2025LongVie 2: Multimodal Controllable Ultra-Long Video World Model
  6. 2026DreamWorld: Unified World Modeling in Video Generation
  7. 2025WorldWeaver: Generating Long-Horizon Video Worlds via Rich Perception
  8. 2025Can World Models Benefit VLMs for World Dynamics?