RAR: Rate-Adaptive Rollout for Time-Consistent Interactive World Models
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Video-based interactive world models aim to enable real-time, user-controllable environments. Yet most existing systems are trained and rolled out at a fixed temporal rate, limiting both runtime-rate adaptation and physical-horizon coverage -- a limitation we term temporal-rate coupling. Specifically, when runtime generation throughput differs from the learned temporal rate, the generated world evolves unintentionally more slowly or quickly. Moreover, using a single temporal rate imposes an inherent trade-off between temporal granularity and physical horizon: higher rates capture finer motion but cover a shorter duration under a fixed context window. To address both limitations, we introduce Rate-Adaptive Rollout (RAR), a framework that enables interactive world models to roll out at controllable temporal rates. At its core, Stride-RoPE aligns latent frames sampled at different rates on a shared physical-time coordinate, enabling consistent multi-rate rollout, unseen-rate generalization, and online rate switching without discarding history. Meanwhile, RAR uses multi-stride video sampling to enable joint learning of fine-grained dynamics and long-horizon evolution. Across action- and camera-controlled environments, RAR achieves temporally consistent multi-rate rollout and online rate switching while preserving high-rate generation quality and extending physical horizons under matched training budgets. RAR also transfers to pretrained world models while preserving perceptual quality.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 37 of its 42 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
37 of 42 references.
Closest ancestors · 12
Same direction, newest first
- 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models2 Sep
- 2026ReWorld: An Interactive World Model with Long-Horizon Memory24 Aug
- 2026DreamX-World 1.0: A General-Purpose Interactive World Model15 Jun
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
- 2026MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Engines3 Mar
- 2026Solaris: Building a Multiplayer Video World Model in Minecraft25 Feb
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
- 2024Diffusion Models Are Real-Time Game Engines27 Aug
- 2024Genie: Generative Interactive Environments23 Feb
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
Other references · 25
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2022Video Diffusion Modelscited by 2,305
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2018World Modelscited by 1,513
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 601
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
13 more
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
- 2024LongRoPE: Extending LLM Context Window Beyond 2 Million Tokenscited by 313
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
- 2023NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generationcited by 171
- 2020Sample Factory: Egocentric 3D Control from Pixels at 100000 FPS with Asynchronous Reinforcement Learningcited by 93
- 2025Sekai: A Video Dataset towards World Explorationcited by 67
- 2018ViZDoom Competitions: Playing Doom from Pixelscited by 51
- 2026Infinite Worlds with Versatile Interactionscited by 48
- 2022MSPred: Video Prediction at Multiple Spatio-Temporal Scales with Hierarchical Recurrent Networkscited by 13
- 2021Human-Piloted Drone Racing: Visual Processing and Controlcited by 9
- 2026Echo-Infinity: Learning Evolving Memory for Real-Time Infinite Video Generationcited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MagicWorld: Towards Long-Horizon Stability for Interactive Video World Exploration
- 2026Twin Rollouts: Noise-Coupled Counterfactual Branching in Interactive Video World Models
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
- 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memory
- 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon
- 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU
- 2026LIVE: Long-horizon Interactive Video World Modeling
- 2026WorldCompass: Reinforcement Learning for Long-Horizon World Models