mlsanityData to 14 Oct 2026

Generative World Renderer at the Speed of Play

arXiv 2607.18703 ↗First posted 21 Jul 2026cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Generative world renderer AlayaRenderer receives structured world states exported from physics engines and synthesizes RGB frames. Unlike models that generate frames from text/control-hints prompts, AlayaRenderer preserves scene structure without altering the underlying world dynamics. This demonstrates an alternative path toward interactive world modeling and user-controllable play. However, the original AlayaRenderer is too computationally expensive for real-time deployment. This technical report introduces AlayaRenderer-Flash, a real-time-oriented generative forward world renderer that pushes AlayaRenderer from 0.56 FPS to 31.54 FPS, reaching the speed of play. AlayaRenderer-Flash reformulates the original renderer as a few-step autoregressive streaming model and introduces lightweight distilled codecs for efficient latent encoding and frame reconstruction. It retains the teacher model's G-buffer and text-prompt interfaces while enabling continuous rendering over input streams of unbounded length. We evaluate AlayaRenderer-Flash on G-buffer streams across content preservation, temporal consistency, cross-window stability, prompt controllability, and runtime efficiency. Our results show that AlayaRenderer-Flash substantially reduces inference cost while preserving the core rendering capabilities of the teacher model. By integrating AlayaRenderer-Flash with a physics engine, we build a fully playable generative world running at 30 FPS.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 16 of its 21 references that are in the map. First posted on arXiv 21 Jul 2026.

Builds on

16 of 21 references.

References · 16

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  4. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  5. 2022On Distillation of Guided Diffusion Modelscited by 725
  6. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  7. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  8. 2024RGBleftrightarrowX: Image decomposition and synthesis using material- and lighting-aware diffusion modelscited by 161
  9. 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 143
  10. 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
  11. 2016Deep Shading: Convolutional Neural Networks for Screen-Space Shadingcited by 46
  12. 2026Generative World Renderercited by 10
4 more
  1. 2026Mean Flow Distillation: Robust and Stable Distillation for Flow Matching Modelscited by 5
  2. 2025FrameDiffuser: G-Buffer-Conditioned Diffusion for Neural Forward Frame Renderingcited by 3
  3. 2026RenderFlow: Single-Step Neural Rendering via Flow Matchingcited by 2
  4. 2026HorizonRelight: Relighting Long-horizon Videos Consistently via Diffusion Transformerscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report
  2. 2026AlayaWorld: Long-Horizon and Playable Video World Generation
  3. 2026Programmable World Model
  4. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling
  5. 2026AlayaWorld: Interactive Long-Horizon World Modeling - Full Technical Report (v1.1)
  6. 2026DreamX-World 1.0: A General-Purpose Interactive World Model
  7. 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory
  8. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model