mlsanityData to 7 Oct 2026

DreamX-World 1.0: A General-Purpose Interactive World Model

arXiv 2606.16993 ↗First posted 15 Jun 2026cs.CVcited by 33

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

DreamX-World 1.0 is a general-purpose interactive text/image-to-video world model for controllable long-horizon generation. It supports camera navigation, revisits to previously observed regions, and promptable events across photorealistic, game-style, and stylized domains. Our data engine combines camera-accurate Unreal Engine rendering, action-rich gameplay recordings, and real-world videos with recovered camera geometry. For camera control, we introduce E-PRoPE, a lightweight variant of projective positional encoding that retains PRoPE's projective camera geometry while applying camera-aware attention to spatially reduced tokens. We convert a bidirectional video generator into a few-step autoregressive world model using causal forcing, DMD-style distillation, and long-rollout training. Training on self-generated long-horizon contexts exposes the model to its own generated history and reduces the style and color drift that accumulates across autoregressive chunks. Memory-Conditioned Scene Persistence retrieves earlier views through camera-geometry-based retrieval, while residual recycling makes the conditioning path less sensitive to imperfect memory latents. Event Instruction Tuning adds composable event control, and reinforcement learning alignment recovers camera control and visual quality after distillation. With mixed-precision DiT execution, residual reuse, 75%-pruned VAE decoding, and asynchronous pipeline parallelism, DreamX-World 1.0 reaches up to 16,FPS on eight RTX,5090 GPUs. On our 5-second basic evaluation, DreamX-World 1.0 achieves a camera-control score of 73.75 and an overall score of 84.76, outperforming HY-WorldPlay 1.5 and LingBot-World in overall score, which achieve 80.79 and 80.45, respectively.

Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 62 of its 66 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

62 of 66 references.

Closest ancestors · 17

Same direction, newest first

  1. 2026minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Models28 May
  2. 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May
  3. 2026WorldCraft: From Camera Navigation to Object Manipulation in Interactive Video World Models24 May
  4. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
  5. 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models23 Mar
  6. 2026MosaicMem: Hybrid Spatial Memory for Controllable Video World Models17 Mar
  7. 2026Advancing Open-source World Models28 Jan
  8. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
  9. 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  11. 2024GameGen-X: Interactive Open-world Game Video Generation1 Nov
  12. 2024Diffusion Models Are Real-Time Game Engines27 Aug
5 more
  1. 2024Genie: Generative Interactive Environments23 Feb
  2. 2022Scalable Diffusion Models with Transformers19 Dec
  3. 2021Learning Transferable Visual Models From Natural Language Supervision26 Feb
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  5. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 45

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  5. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
  6. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  7. 2023Training Diffusion Models with Reinforcement Learningcited by 939
  8. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  9. 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 584
  10. 2023LightGlue: Local Feature Matching at Light Speedcited by 583
  11. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  12. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
33 more
  1. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  2. 2025VACE: All-in-One Video Creation and Editingcited by 467
  3. 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 245
  4. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  5. 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
  6. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 204
  7. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
  8. 2024SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Accelerationcited by 158
  9. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
  10. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 151
  11. 2025GPG: A Simple and Strong Reinforcement Learning Baseline for Model Reasoningcited by 147
  12. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
  13. 2023Randomized Positional Encodings Boost Length Generalization of Transformerscited by 114
  14. 2025Cameras as Relative Positional Encodingcited by 94
  15. 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rolloutcited by 78
  16. 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 77
  17. 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 72
  18. 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recyclingcited by 68
  19. 2025Sekai: A Video Dataset towards World Explorationcited by 64
  20. 2025VMBench: A Benchmark for Perception-Aligned Video Motion Generationcited by 48
  21. 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generationcited by 44
  22. 2025Omni-Effects: Unified and Spatially-Controllable Visual Effects Generationcited by 27
  23. 2025USP: Unified Self-Supervised Pretraining for Image Generation and Understandingcited by 24
  24. 2025There is No VAE: End-to-End Pixel-Space Generative Modeling via Self-Supervised Pre-trainingcited by 23
  25. 2025FingER: Content Aware Fine-grained Evaluation with Reasoning for AI-Generated Videoscited by 22
  26. 2026WorldCompass: Reinforcement Learning for Long-Horizon World Modelscited by 22
  27. 2025Taming Preference Mode Collapse via Directional Decoupling Alignment in Diffusion Reinforcement Learningcited by 18
  28. 2026Astrolabe: Steering Forward-Process Reinforcement Learning for Distilled Autoregressive Video Modelscited by 15
  29. 2023Masked Diffusion Models Are Fast Distribution Learnerscited by 7
  30. 2026FASA: Frequency-aware Sparse Attentioncited by 6
  31. 2024MutualVPR: A Mutual Learning Framework for Resolving Supervision Inconsistencies via Adaptive Clusteringcited by 5
  32. 2026AngelSlim: A more accessible, comprehensive, and efficient toolkit for large model compressioncited by 5
  33. 2026Enhancing Train-Free Infinite-Frame Generation for Consistent Long Videoscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 33.

33 papers.

Sort:

By area:

  1. 2026Infinite Worlds with Versatile Interactionscited by 37
  2. 2026Wonder: Video World Model Done Bettercited by 13
  3. 2026EchoWM: Open and Enterable Omnimodal World Modelscited by 10
  4. 2026Code World Model: Coding Agent as World Braincited by 9
  5. 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Modelscited by 9
  6. 2026ReWorld: An Interactive World Model with Long-Horizon Memorycited by 8
  7. 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memorycited by 7
  8. 2026From Pixels to States: Rethinking Interactive World Models as Game Enginescited by 4
  9. 2026DreamX-Phi 1.0: Action-Conditioned Video World Model for Robotic Manipulationcited by 3
  10. 2026HarnessEval-W: Agentifying the Evaluation of Visual Worldscited by 3
  11. 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worldscited by 3
  12. 2026Magpie: Real-Time World Renderer for Interactive Gamescited by 3
21 more
  1. 2026ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Modelscited by 2
  2. 2026Mask Forcing: Improving Autoregressive Video Diffusion Distillation via Dual-Noise Masking Rolloutcited by 2
  3. 2026AI for Games in the Foundation Model Eracited by 2
  4. 2026Do Video Generators Track the World Across Segments? A Benchmark and Method for World-State Reasoning in Video Continuationcited by 1
  5. 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memorycited by 1
  6. 2026GameDirector: Decoupling Gameplay Logic from Rendering for Player-Configurable Game World Modelscited by 1
  7. 2026Precise Editing and Flexible Referencing for Interactable Worldscited by 1
  8. 2026DreamForge-World 0.1 Preview: A Low-Compute Real-Time Controllable World Modelcited by 0
  9. 2026MiniWorld: Democratizing the Training of Video World Models from Scratchcited by 0
  10. 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
  11. 2026DreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolutioncited by 0
  12. 2026Building Pretraining Data for World Models: An Unreal Engine-Based Pipeline for Action-Conditioned Video Generationcited by 0
  13. 2026The Right Future for Action: Learning Action-Relevant Predictive States in World Action Modelscited by 0
  14. 2026HappyWorld-Benchcited by 0
  15. 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modelingcited by 0
  16. 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizoncited by 0
  17. 2026Waypoint-1.5: A Real-Time Video World Model for Consumer Hardwarecited by 0
  18. 2026LongLive-Plug: Once-for-All Distillation for Video Generationcited by 0
  19. 2026Memorizon: Training World Models Beyond Their Context Windowcited by 0
  20. 2026World Observer: Joint Actor-Observer Generation for Persistent World Modelingcited by 0
  21. 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interactioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report
  2. 2026WorldCam: Interactive Autoregressive 3D Gaming Worlds with Camera Pose as a Unifying Geometric Representation
  3. 2026Astronex-World 1.0: Real-Time Interactive World Model Foundation
  4. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
  5. 2025CustomX: Unified Character, Action, and Scene Customization in Video World Models
  6. 2025Dreamland: Controllable World Creation with Simulator and Generative Models
  7. 2026Beyond Pixel Histories: World Models with Persistent 3D State
  8. 2026Programmable World Model