mlsanityData to 14 Oct 2026

Waypoint-1.5: A Real-Time Video World Model for Consumer Hardware

arXiv 2609.37107 ↗First posted 29 Sep 2026cs.CV cs.HCcited by 0

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

We present Waypoint 1.5, a real-time diffusion world model for interactive video generation on consumer-grade hardware. Unlike general video diffusion models, interactive world models (iWMs) must respond to dense user controls under strict latency and throughput constraints. Waypoint 1.5 is pre-trained on 100,000 hours of diverse, control-aligned video game data across hundreds of games, and generates playable video conditioned on full keyboard and mouse input. The model includes two resolution variants that run across a wide spectrum of consumer hardware. To characterize this unique setting, we distinguish rendered FPS, latent FPS, and control rate. We describe the data pipeline, architecture, training methodology, and runtime system behind Waypoint 1.5. We evaluate interactivity through latency and throughput. Finally, we discuss the safety and ethics considerations unique to iWMs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 11 of its 24 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

11 of 24 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026DreamX-World 1.0: A General-Purpose Interactive World Model15 Jun
  2. 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun
  3. 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May
  4. 2026Solaris: Building a Multiplayer Video World Model in Minecraft25 Feb
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar

Other references · 6

  1. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  2. 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 98
  3. 2025NorMuon: Making Muon more efficient and scalablecited by 84
  4. 2025SenseFlow: Scaling Distribution Matching for Flow-based Text-to-Image Distillationcited by 32
  5. 2026Kairos: A Regret-Aware Native World-Action Model Stack for Physical AIcited by 9
  6. 2026COMBAT: Conditional World Models for Behavioral Agent Trainingcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model
  2. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory
  3. 2026MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Engines
  4. 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report
  5. 2024Diffusion Models Are Real-Time Game Engines
  6. 2026From Pixels to States: Rethinking Interactive World Models as Game Engines
  7. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
  8. 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model