Yume-1.5: A Text-Controlled Interactive World Generation Model
On the map: Diffusion models → Video generation
Abstract (arXiv)
Recent approaches have demonstrated the promise of using diffusion models to generate interactive and explorable worlds. However, most of these methods face critical challenges such as excessively large parameter sizes, reliance on lengthy inference steps, and rapidly growing historical context, which severely limit real-time performance and lack text-controlled generation capabilities. To address these challenges, we propose method, a novel framework designed to generate realistic, interactive, and continuous worlds from a single image or text prompt. method achieves this through a carefully designed framework that supports keyboard-based exploration of the generated worlds. The framework comprises three core components: (1) a long-video generation framework integrating unified context compression with linear attention; (2) a real-time streaming acceleration strategy powered by bidirectional attention distillation and an enhanced text embedding scheme; (3) a text-controlled method for generating world events. We have provided the codebase in the supplementary material.
Key facts. Cited by 84 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. First posted on arXiv 26 Dec 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 84.
84 papers.
Sort:
By area:
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 184
- 2026Advancing Open-source World Modelscited by 154
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memorycited by 100
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 55
- 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RLcited by 50
- 2026Infinite Worlds with Versatile Interactionscited by 48
- 2026Lyra 2.0: Explorable Generative 3D Worldscited by 44
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worldscited by 44
- 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memorycited by 40
- 2026DreamX-World 1.0: A General-Purpose Interactive World Modelcited by 40
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluationcited by 39
38 more
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Modelscited by 26
- 2026RealWonder: Real-Time Physical Action-Conditioned Video Generationcited by 22
- 2026minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Modelscited by 19
- 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Modelscited by 18
- 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memoriescited by 15
- 2026HiAR: Efficient Autoregressive Long Video Generation via Hierarchical Denoisingcited by 15
- 2026WorldKV: Efficient World Memory with World Retrieval and Compressioncited by 15
- 2026EgoSim: Egocentric World Simulator for Embodied Interaction Generationcited by 14
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 14
- 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memorycited by 14
- 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless Worldcited by 14
- 2026Code World Model: Coding Agent as World Braincited by 14
- 2026WildWorld: A Large-Scale Dataset for Dynamic World Modeling with Actions and Explicit State toward Generative ARPGcited by 13
- 2026Grounding World Simulation Models in a Real-World Metropoliscited by 12
- 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Reportcited by 11
- 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Modelscited by 10
- 2026ReWorld: An Interactive World Model with Long-Horizon Memorycited by 10
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 8
- 2026BiWM: Advancing Open-Source Interactive Video World Models with Bidirectional Autoregressioncited by 6
- 2026WorldOlympiad: Can Your World Model Survive a Triathlon?cited by 6
- 2026AlayaWorld: Long-Horizon and Playable Video World Generationcited by 6
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithmscited by 5
- 2026FashionChameleon: Towards Real-Time and Interactive Human-Garment Video Customizationcited by 5
- 2026EgoCS-400K: An Egocentric Gameplay Dataset for World Modelscited by 5
- 2026WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memorycited by 5
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectivescited by 5
- 2026From Pixels to States: Rethinking Interactive World Models as Game Enginescited by 4
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivitycited by 4
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worldscited by 4
- 2026R2M-Bench: Evaluating Revisit Memory via Relative Consistency in Interactive Video World Modelscited by 4
- 2026H3-World: Turning Language Understanding into World Controlcited by 4
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
- 2026AnchorWorld: Embodied Egocentric World Simulation with View-based Evolution Customizationcited by 3
- 2026WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interactioncited by 3
- 2026Sekai2: From World Exploration to Interactive World Modelingcited by 3
- 2026AI for Games in the Foundation Model Eracited by 3
- 2026Astronex-World 1.0: Real-Time Interactive World Model Foundationcited by 3
- 2026DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memorycited by 2
50 most cited of 84 All 84 (JSON)
- 2026Generative World Simulation with DAO and JING14 Oct 2026
- 20264LC: 4D Latent Cache for Efficient Conditioning in Dynamic World Modeling13 Oct 2026
- 2026Elephant in the Fridge: Constant-Memory Frame Packing for Long Video Understanding12 Oct 2026
- 2026FrameFold: Response-Guided KV Cache Consolidation for Autoregressive Long Video Generation10 Oct 2026
- 2026WorldGuide: Goal-Directed Video World Model for Procedural Task Execution8 Oct 2026
- 2026PWM: Personalized World Models with Online Reinforcement Learning4 Oct 2026
- 2026Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memory1 Oct 2026
- 2026World Editing: Intervening on Executable Worlds at Increasing Depth1 Oct 2026
- 2026Memorizon: Training World Models Beyond Their Context Window30 Sep 2026
- 2026FrameMorrow: Future-guided Frame Selection with Prospective Tokens for Long-Horizon Video Generation30 Sep 2026
- 2026LongTake: Learning to Sustain Dynamics in Long-Horizon Video Generation29 Sep 2026
- 2026LIFT: Layout-In-Future Video Generation under Large Viewpoint Change via On-Policy Self-Distillation29 Sep 2026
38 more
- 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon28 Sep 2026
- 2026CoDrive: Cross-Vehicle World-Consistent Video Generation with Precise Trajectory Control for Cooperative Driving28 Sep 2026
- 2026Geometry as Address: Routing Attention to Visual Memory for Long-Horizon Camera-Controlled Video Generation28 Sep 2026
- 2026Precise Editing and Flexible Referencing for Interactable Worlds28 Sep 2026
- 2026ViRDM: Taming Representation Distribution Matching for Few-Step Causal Video Generation24 Sep 2026
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modeling22 Sep 2026
- 2026GameDirector: Decoupling Gameplay Logic from Rendering for Player-Configurable Game World Models22 Sep 2026
- 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory21 Sep 2026
- 2026OnlineWM: Causality-Aware Active Online Learning for Effective World Modeling20 Sep 2026
- 2026Astronex-World 1.0: Real-Time Interactive World Model Foundation17 Sep 2026
- 2026Recency Forcing: Bridging the Long-Horizon Gap in Autoregressive Video Generation17 Sep 2026
- 2026AI for Games in the Foundation Model Era15 Sep 2026
- 2026WorldReward: Reward Modeling for Camera-Conditioned World Models3 Sep 2026
- 2026H3-World: Turning Language Understanding into World Control1 Sep 2026
- 2026R2M-Bench: Evaluating Revisit Memory via Relative Consistency in Interactive Video World Models27 Aug 2026
- 2026Code World Model: Coding Agent as World Brain26 Aug 2026
- 2026ReWorld: An Interactive World Model with Long-Horizon Memory24 Aug 2026
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worlds17 Aug 2026
- 2026WorldRover: A Scalable Synthetic Video Data Engine for World Exploration with Rich Annotations16 Aug 2026
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives13 Aug 2026
- 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless World13 Aug 2026
- 2026Sekai2: From World Exploration to Interactive World Modeling10 Aug 2026
- 2026HelloWorld: Enabling Socially Interactive Characters in Video World Models5 Aug 2026
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity3 Aug 2026
- 2026MiniWorld: Democratizing the Training of Video World Models from Scratch2 Aug 2026
- 2026ShadowDancer: Teaching Video World Models Any Action by Learning Unified Dynamics Representations from a Video and Its Shadow30 Jul 2026
- 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report20 Jul 2026
- 2026From Pixels to States: Rethinking Interactive World Models as Game Engines15 Jul 2026
- 2026WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interaction14 Jul 2026
- 2026Cycle-World: Mitigating Error Accumulation in Long-term Video World Models via Reverse-Prediction Cycle Consistency13 Jul 2026
- 2026Infinite Worlds with Versatile Interactions8 Jul 2026
- 2026AlayaWorld: Long-Horizon and Playable Video World Generation7 Jul 2026
- 2026MoWorld: A Flash World Model7 Jul 2026
- 2026WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memory2 Jul 2026
- 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models30 Jun 2026
- 2026FLAT: Feedforward Latent Triangle Splatting for Geometrically Accurate Scene Generation23 Jun 2026
- 2026EgoCS-400K: An Egocentric Gameplay Dataset for World Models16 Jun 2026
50 newest of 84 All 84 (JSON)
- 2026Advancing Open-source World Modelscited by 154
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memorycited by 100
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 55
- 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RLcited by 50
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worldscited by 44
- 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memorycited by 40
- 2026DreamX-World 1.0: A General-Purpose Interactive World Modelcited by 40
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluationcited by 39
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Modelscited by 26
- 2026minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Modelscited by 19
- 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Modelscited by 18
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 14
12 most cited of 61 All 61 (JSON)
- 20264LC: 4D Latent Cache for Efficient Conditioning in Dynamic World Modeling13 Oct 2026
- 2026WorldGuide: Goal-Directed Video World Model for Procedural Task Execution8 Oct 2026
- 2026PWM: Personalized World Models with Online Reinforcement Learning4 Oct 2026
- 2026Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memory1 Oct 2026
- 2026World Editing: Intervening on Executable Worlds at Increasing Depth1 Oct 2026
- 2026Memorizon: Training World Models Beyond Their Context Window30 Sep 2026
- 2026LongTake: Learning to Sustain Dynamics in Long-Horizon Video Generation29 Sep 2026
- 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon28 Sep 2026
- 2026CoDrive: Cross-Vehicle World-Consistent Video Generation with Precise Trajectory Control for Cooperative Driving28 Sep 2026
- 2026Precise Editing and Flexible Referencing for Interactable Worlds28 Sep 2026
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modeling22 Sep 2026
- 2026GameDirector: Decoupling Gameplay Logic from Rendering for Player-Configurable Game World Models22 Sep 2026
12 newest of 61 All 61 (JSON)
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 184
- 2026WorldKV: Efficient World Memory with World Retrieval and Compressioncited by 15
- 2026FLAT: Feedforward Latent Triangle Splatting for Geometrically Accurate Scene Generationcited by 0
- 2026ViRDM: Taming Representation Distribution Matching for Few-Step Causal Video Generationcited by 0
- 2026ViRDM: Taming Representation Distribution Matching for Few-Step Causal Video Generation24 Sep 2026
- 2026FLAT: Feedforward Latent Triangle Splatting for Geometrically Accurate Scene Generation23 Jun 2026
- 2026WorldKV: Efficient World Memory with World Retrieval and Compression21 May 2026
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation2 Feb 2026
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
- 2026Infinite Worlds with Versatile Interactionscited by 48
- 2026Lyra 2.0: Explorable Generative 3D Worldscited by 44
- 2026RealWonder: Real-Time Physical Action-Conditioned Video Generationcited by 22
- 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memoriescited by 15
- 2026HiAR: Efficient Autoregressive Long Video Generation via Hierarchical Denoisingcited by 15
- 2026EgoSim: Egocentric World Simulator for Embodied Interaction Generationcited by 14
- 2026FashionChameleon: Towards Real-Time and Interactive Human-Garment Video Customizationcited by 5
- 2026WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interactioncited by 3
- 2026WorldRover: A Scalable Synthetic Video Data Engine for World Exploration with Rich Annotationscited by 2
- 2026SceneExpander: Text-Guided 3D Scene Expansion via Free-Form View Insertioncited by 0
- 2026UNICA: A Unified Neural Framework for Controllable 3D Avatarscited by 0
12 most cited of 15 All 15 (JSON)
- 2026Generative World Simulation with DAO and JING14 Oct 2026
- 2026FrameMorrow: Future-guided Frame Selection with Prospective Tokens for Long-Horizon Video Generation30 Sep 2026
- 2026Geometry as Address: Routing Attention to Visual Memory for Long-Horizon Camera-Controlled Video Generation28 Sep 2026
- 2026WorldRover: A Scalable Synthetic Video Data Engine for World Exploration with Rich Annotations16 Aug 2026
- 2026WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interaction14 Jul 2026
- 2026Infinite Worlds with Versatile Interactions8 Jul 2026
- 2026FashionChameleon: Towards Real-Time and Interactive Human-Garment Video Customization15 May 2026
- 2026Lyra 2.0: Explorable Generative 3D Worlds14 Apr 2026
- 2026UNICA: A Unified Neural Framework for Controllable 3D Avatars3 Apr 2026
- 2026EgoSim: Egocentric World Simulator for Embodied Interaction Generation1 Apr 2026
- 2026SceneExpander: Text-Guided 3D Scene Expansion via Free-Form View Insertion28 Mar 2026
- 2026HiAR: Efficient Autoregressive Long Video Generation via Hierarchical Denoising9 Mar 2026
12 newest of 15 All 15 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Yume: An Interactive World Generation Model
- 2024Sora as a World Model? A Complete Survey on Text-to-Video Generation
- 2024SemanticDraw: Towards Real-Time Interactive Content Creation from Image Diffusion Models
- 2025WorldGen: From Text to Traversable and Interactive 3D Worlds
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model
- 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokens
- 2026A Mechanistic View on Video Generation as World Models: State and Dynamics
- 2026StableWorld: Towards Stable and Consistent Long Interactive Video Generation