DreamX-World 1.0: A General-Purpose Interactive World Model
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
DreamX-World 1.0 is a general-purpose interactive text/image-to-video world model for controllable long-horizon generation. It supports camera navigation, revisits to previously observed regions, and promptable events across photorealistic, game-style, and stylized domains. Our data engine combines camera-accurate Unreal Engine rendering, action-rich gameplay recordings, and real-world videos with recovered camera geometry. For camera control, we introduce E-PRoPE, a lightweight variant of projective positional encoding that retains PRoPE's projective camera geometry while applying camera-aware attention to spatially reduced tokens. We convert a bidirectional video generator into a few-step autoregressive world model using causal forcing, DMD-style distillation, and long-rollout training. Training on self-generated long-horizon contexts exposes the model to its own generated history and reduces the style and color drift that accumulates across autoregressive chunks. Memory-Conditioned Scene Persistence retrieves earlier views through camera-geometry-based retrieval, while residual recycling makes the conditioning path less sensitive to imperfect memory latents. Event Instruction Tuning adds composable event control, and reinforcement learning alignment recovers camera control and visual quality after distillation. With mixed-precision DiT execution, residual reuse, 75%-pruned VAE decoding, and asynchronous pipeline parallelism, DreamX-World 1.0 reaches up to 16,FPS on eight RTX,5090 GPUs. On our 5-second basic evaluation, DreamX-World 1.0 achieves a camera-control score of 73.75 and an overall score of 84.76, outperforming HY-WorldPlay 1.5 and LingBot-World in overall score, which achieve 80.79 and 80.45, respectively.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 62 of its 66 references that are in the map. First posted on arXiv 15 Jun 2026.
Builds on
62 of 66 references.
Closest ancestors · 17
Same direction, newest first
- 2026minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Models28 May
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May
- 2026WorldCraft: From Camera Navigation to Object Manipulation in Interactive Video World Models24 May
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
- 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models23 Mar
- 2026MosaicMem: Hybrid Spatial Memory for Controllable Video World Models17 Mar
- 2026Advancing Open-source World Models28 Jan
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
- 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2024GameGen-X: Interactive Open-world Game Video Generation1 Nov
- 2024Diffusion Models Are Real-Time Game Engines27 Aug
5 more
- 2024Genie: Generative Interactive Environments23 Feb
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2021Learning Transferable Visual Models From Natural Language Supervision26 Feb
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 45
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2023Training Diffusion Models with Reinforcement Learningcited by 939
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 584
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
33 more
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 245
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
- 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 204
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
- 2024SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Accelerationcited by 158
- 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 151
- 2025GPG: A Simple and Strong Reinforcement Learning Baseline for Model Reasoningcited by 147
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
- 2023Randomized Positional Encodings Boost Length Generalization of Transformerscited by 114
- 2025Cameras as Relative Positional Encodingcited by 94
- 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rolloutcited by 78
- 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 77
- 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 72
- 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recyclingcited by 68
- 2025Sekai: A Video Dataset towards World Explorationcited by 64
- 2025VMBench: A Benchmark for Perception-Aligned Video Motion Generationcited by 48
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generationcited by 44
- 2025Omni-Effects: Unified and Spatially-Controllable Visual Effects Generationcited by 27
- 2025USP: Unified Self-Supervised Pretraining for Image Generation and Understandingcited by 24
- 2025There is No VAE: End-to-End Pixel-Space Generative Modeling via Self-Supervised Pre-trainingcited by 23
- 2025FingER: Content Aware Fine-grained Evaluation with Reasoning for AI-Generated Videoscited by 22
- 2026WorldCompass: Reinforcement Learning for Long-Horizon World Modelscited by 22
- 2025Taming Preference Mode Collapse via Directional Decoupling Alignment in Diffusion Reinforcement Learningcited by 18
- 2026Astrolabe: Steering Forward-Process Reinforcement Learning for Distilled Autoregressive Video Modelscited by 15
- 2023Masked Diffusion Models Are Fast Distribution Learnerscited by 7
- 2026FASA: Frequency-aware Sparse Attentioncited by 6
- 2024MutualVPR: A Mutual Learning Framework for Resolving Supervision Inconsistencies via Adaptive Clusteringcited by 5
- 2026AngelSlim: A more accessible, comprehensive, and efficient toolkit for large model compressioncited by 5
- 2026Enhancing Train-Free Infinite-Frame Generation for Consistent Long Videoscited by 1
Built on by
Citing papers per year: 2026: 33.
33 papers.
Sort:
By area:
- 2026Infinite Worlds with Versatile Interactionscited by 37
- 2026Wonder: Video World Model Done Bettercited by 13
- 2026EchoWM: Open and Enterable Omnimodal World Modelscited by 10
- 2026Code World Model: Coding Agent as World Braincited by 9
- 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Modelscited by 9
- 2026ReWorld: An Interactive World Model with Long-Horizon Memorycited by 8
- 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memorycited by 7
- 2026From Pixels to States: Rethinking Interactive World Models as Game Enginescited by 4
- 2026DreamX-Phi 1.0: Action-Conditioned Video World Model for Robotic Manipulationcited by 3
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worldscited by 3
- 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worldscited by 3
- 2026Magpie: Real-Time World Renderer for Interactive Gamescited by 3
21 more
- 2026ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Modelscited by 2
- 2026Mask Forcing: Improving Autoregressive Video Diffusion Distillation via Dual-Noise Masking Rolloutcited by 2
- 2026AI for Games in the Foundation Model Eracited by 2
- 2026Do Video Generators Track the World Across Segments? A Benchmark and Method for World-State Reasoning in Video Continuationcited by 1
- 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memorycited by 1
- 2026GameDirector: Decoupling Gameplay Logic from Rendering for Player-Configurable Game World Modelscited by 1
- 2026Precise Editing and Flexible Referencing for Interactable Worldscited by 1
- 2026DreamForge-World 0.1 Preview: A Low-Compute Real-Time Controllable World Modelcited by 0
- 2026MiniWorld: Democratizing the Training of Video World Models from Scratchcited by 0
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
- 2026DreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolutioncited by 0
- 2026Building Pretraining Data for World Models: An Unreal Engine-Based Pipeline for Action-Conditioned Video Generationcited by 0
- 2026The Right Future for Action: Learning Action-Relevant Predictive States in World Action Modelscited by 0
- 2026HappyWorld-Benchcited by 0
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modelingcited by 0
- 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizoncited by 0
- 2026Waypoint-1.5: A Real-Time Video World Model for Consumer Hardwarecited by 0
- 2026LongLive-Plug: Once-for-All Distillation for Video Generationcited by 0
- 2026Memorizon: Training World Models Beyond Their Context Windowcited by 0
- 2026World Observer: Joint Actor-Observer Generation for Persistent World Modelingcited by 0
- 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interactioncited by 0
- 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interaction8 Oct 2026
- 2026World Observer: Joint Actor-Observer Generation for Persistent World Modeling1 Oct 2026
- 2026Memorizon: Training World Models Beyond Their Context Window30 Sep 2026
- 2026LongLive-Plug: Once-for-All Distillation for Video Generation29 Sep 2026
- 2026Waypoint-1.5: A Real-Time Video World Model for Consumer Hardware29 Sep 2026
- 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon28 Sep 2026
- 2026Precise Editing and Flexible Referencing for Interactable Worlds28 Sep 2026
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modeling22 Sep 2026
- 2026GameDirector: Decoupling Gameplay Logic from Rendering for Player-Configurable Game World Models22 Sep 2026
- 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory21 Sep 2026
- 2026HappyWorld-Bench21 Sep 2026
- 2026The Right Future for Action: Learning Action-Relevant Predictive States in World Action Models20 Sep 2026
21 more
- 2026AI for Games in the Foundation Model Era15 Sep 2026
- 2026Mask Forcing: Improving Autoregressive Video Diffusion Distillation via Dual-Noise Masking Rollout8 Sep 2026
- 2026Do Video Generators Track the World Across Segments? A Benchmark and Method for World-State Reasoning in Video Continuation3 Sep 2026
- 2026Building Pretraining Data for World Models: An Unreal Engine-Based Pipeline for Action-Conditioned Video Generation3 Sep 2026
- 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models2 Sep 2026
- 2026DreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolution31 Aug 2026
- 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory30 Aug 2026
- 2026Magpie: Real-Time World Renderer for Interactive Games27 Aug 2026
- 2026Code World Model: Coding Agent as World Brain26 Aug 2026
- 2026ReWorld: An Interactive World Model with Long-Horizon Memory24 Aug 2026
- 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds24 Aug 2026
- 2026EchoWM: Open and Enterable Omnimodal World Models24 Aug 2026
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worlds17 Aug 2026
- 2026ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Models14 Aug 2026
- 2026DreamX-Phi 1.0: Action-Conditioned Video World Model for Robotic Manipulation13 Aug 2026
- 2026MiniWorld: Democratizing the Training of Video World Models from Scratch2 Aug 2026
- 2026Wonder: Video World Model Done Better28 Jul 2026
- 2026From Pixels to States: Rethinking Interactive World Models as Game Engines15 Jul 2026
- 2026Infinite Worlds with Versatile Interactions8 Jul 2026
- 2026DreamForge-World 0.1 Preview: A Low-Compute Real-Time Controllable World Model29 Jun 2026
- 2026Wonder: Video World Model Done Bettercited by 13
- 2026EchoWM: Open and Enterable Omnimodal World Modelscited by 10
- 2026Code World Model: Coding Agent as World Braincited by 9
- 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Modelscited by 9
- 2026ReWorld: An Interactive World Model with Long-Horizon Memorycited by 8
- 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memorycited by 7
- 2026From Pixels to States: Rethinking Interactive World Models as Game Enginescited by 4
- 2026DreamX-Phi 1.0: Action-Conditioned Video World Model for Robotic Manipulationcited by 3
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worldscited by 3
- 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worldscited by 3
- 2026ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Modelscited by 2
- 2026AI for Games in the Foundation Model Eracited by 2
12 most cited of 26 All 26 (JSON)
- 2026World Observer: Joint Actor-Observer Generation for Persistent World Modeling1 Oct 2026
- 2026Memorizon: Training World Models Beyond Their Context Window30 Sep 2026
- 2026Waypoint-1.5: A Real-Time Video World Model for Consumer Hardware29 Sep 2026
- 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon28 Sep 2026
- 2026Precise Editing and Flexible Referencing for Interactable Worlds28 Sep 2026
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modeling22 Sep 2026
- 2026GameDirector: Decoupling Gameplay Logic from Rendering for Player-Configurable Game World Models22 Sep 2026
- 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory21 Sep 2026
- 2026HappyWorld-Bench21 Sep 2026
- 2026The Right Future for Action: Learning Action-Relevant Predictive States in World Action Models20 Sep 2026
- 2026AI for Games in the Foundation Model Era15 Sep 2026
- 2026Building Pretraining Data for World Models: An Unreal Engine-Based Pipeline for Action-Conditioned Video Generation3 Sep 2026
12 newest of 26 All 26 (JSON)
- 2026Infinite Worlds with Versatile Interactionscited by 37
- 2026Magpie: Real-Time World Renderer for Interactive Gamescited by 3
- 2026Do Video Generators Track the World Across Segments? A Benchmark and Method for World-State Reasoning in Video Continuationcited by 1
- 2026DreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolutioncited by 0
- 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interactioncited by 0
- 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interaction8 Oct 2026
- 2026Do Video Generators Track the World Across Segments? A Benchmark and Method for World-State Reasoning in Video Continuation3 Sep 2026
- 2026DreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolution31 Aug 2026
- 2026Magpie: Real-Time World Renderer for Interactive Games27 Aug 2026
- 2026Infinite Worlds with Versatile Interactions8 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report
- 2026WorldCam: Interactive Autoregressive 3D Gaming Worlds with Camera Pose as a Unifying Geometric Representation
- 2026Astronex-World 1.0: Real-Time Interactive World Model Foundation
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
- 2025CustomX: Unified Character, Action, and Scene Customization in Video World Models
- 2025Dreamland: Controllable World Creation with Simulator and Generative Models
- 2026Beyond Pixel Histories: World Models with Persistent 3D State
- 2026Programmable World Model