mlsanityData to 14 Oct 2026

DeepVerse: 4D Autoregressive Video Generation as a World Model

arXiv 2506.01103 ↗First posted 1 Jun 2025cs.CVcited by 40

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

World models serve as essential building blocks toward Artificial General Intelligence (AGI), enabling intelligent agents to predict future states and plan actions by simulating complex physical interactions. However, existing interactive models primarily predict visual observations, thereby neglecting crucial hidden states like geometric structures and spatial coherence. This leads to rapid error accumulation and temporal inconsistency. To address these limitations, we introduce DeepVerse, a novel 4D interactive world model explicitly incorporating geometric predictions from previous timesteps into current predictions conditioned on actions. Experiments demonstrate that by incorporating explicit geometric constraints, DeepVerse captures richer spatio-temporal relationships and underlying physical dynamics. This capability significantly reduces drift and enhances temporal consistency, enabling the model to reliably generate extended future sequences and achieve substantial improvements in prediction accuracy, visual realism, and scene rationality. Furthermore, our method provides an effective solution for geometry-aware memory retrieval, effectively preserving long-term spatial consistency. We validate the effectiveness of DeepVerse across diverse scenarios, establishing its capacity for high-fidelity, long-horizon predictions grounded in geometry-aware dynamics.

Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 46 of its 55 references that are in the map. First posted on arXiv 1 Jun 2025.

Builds on

46 of 55 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025GameFactory: Creating New Games with Generative Interactive Videos14 Jan
  2. 2024Genie: Generative Interactive Environments23 Feb
  3. 2022Flow Matching for Generative Modeling6 Oct
  4. 2021Learning Transferable Visual Models From Natural Language Supervision26 Feb

Other references · 42

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  5. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  6. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  7. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  8. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  9. 2019Root Mean Square Layer Normalizationcited by 1,480
  10. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  11. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
  12. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
30 more
  1. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  2. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  3. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
  4. 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
  5. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
  6. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
  7. 2020Query-Key Normalization for Transformerscited by 280
  8. 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 183
  9. 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 143
  10. 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 131
  11. 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
  12. 2025Aether: Geometric-Aware Unified World Modelingcited by 97
  13. 2024The Matrix: Infinite-Horizon World Generation with Real-Time Moving Controlcited by 80
  14. 2023UniPAD: A Universal Pre-training Paradigm for Autonomous Drivingcited by 73
  15. 2025DemoGen: Synthetic Demonstration Generation for Data-Efficient Visuomotor Policy Learningcited by 69
  16. 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstructioncited by 67
  17. 2023PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigmcited by 56
  18. 2024GVGEN: Text-to-3D Generation with Volumetric Representationcited by 51
  19. 2024Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulationcited by 46
  20. 2024Point Cloud Matters: Rethinking the Impact of Different Observation Spaces on Robot Learningcited by 45
  21. 2024RISE: 3D Perception Makes Real-World Robot Imitation Simple and Effectivecited by 41
  22. 2025FP3: A 3D Foundation Policy for Robotic Manipulationcited by 32
  23. 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
  24. 2024SPA: 3D Spatial-Awareness Enables Effective Embodied Representationcited by 28
  25. 2024GigaGS: Scaling up Planar-Based 3D Gaussians for Large Scene Surface Reconstructioncited by 20
  26. 2025H3DP: Triply-Hierarchical Diffusion Policy for Visuomotor Learningcited by 16
  27. 2025MeshCraft: Exploring Efficient and Controllable Mesh Generation with Flow-based DiTscited by 14
  28. 2024CoSurfGS:Collaborative 3D Surface Gaussian Splatting with Distributed Learning for Large Scene Reconstructioncited by 11
  29. 2022X-NeRF: Explicit Neural Radiance Field for Multi-Scene 360circ Insufficient RGB-D Viewscited by 10
  30. 2024Where Am I and What Will I See: An Auto-Regressive Model for Spatial Localization and View Predictioncited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 14; 2026: 26.

40 papers.

Sort:

By area:

  1. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 186
  2. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memorycited by 100
  3. 2025RELIC: Interactive Video World Model with Long-Horizon Memorycited by 96
  4. 2025A Comprehensive Survey on World Models for Embodied AIcited by 68
  5. 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 62
  6. 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 55
  7. 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Modelscited by 51
  8. 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Predictioncited by 38
  9. 2025WinT3R: Window-Based Streaming Reconstruction with Camera Token Poolcited by 35
  10. 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Controlcited by 28
  11. 2026VINO: A Unified Visual Generator with Interleaved OmniModal Contextcited by 26
  12. 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memoriescited by 18
28 more
  1. 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPUcited by 16
  2. 2026Grounding World Simulation Models in a Real-World Metropoliscited by 12
  3. 2026WorldCam: Interactive Autoregressive 3D Gaming Worlds with Camera Pose as a Unifying Geometric Representationcited by 12
  4. 2026Plenoptic Video Generationcited by 9
  5. 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memorycited by 9
  6. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 8
  7. 2025UnityVideo: Unified Multi-Modal Multi-Task Learning for Enhancing World-Aware Video Generationcited by 7
  8. 2025iMontage: Unified, Versatile, Highly Dynamic Many-to-many Image Generationcited by 6
  9. 2025Terra: Explorable Native 3D World Model with Point Latentscited by 4
  10. 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
  11. 2026Stereo World Model: Camera-Guided Stereo Video Generationcited by 3
  12. 2026DisCo: World Models with Discrete Camera Motion Controlcited by 2
  13. 2026CP4D: Compositional Physics-aware 4D Scene Generationcited by 2
  14. 2026Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Meshcited by 2
  15. 2025SyncMV4D: Synchronized Multi-view Joint Diffusion of Appearance and Motion for Hand-Object Interaction Synthesiscited by 1
  16. 2025CustomX: Unified Character, Action, and Scene Customization in Video World Modelscited by 1
  17. 2026Preserve, Reveal, Expand: Faithful 4D Video Editing with Region-Aware Conditioningcited by 1
  18. 2026OctWorld: Long-Range World-Consistent Video Generation with Octree-Based 3D Mappingcited by 1
  19. 2025Thinking Ahead: Foresight Intelligence in MLLMs and World Modelcited by 0
  20. 2026Divide and Conquer: Decoupled Representation Alignment for Multimodal World Modelscited by 0
  21. 2026DeblurNVS: Geometric Latent Diffusion for Novel View Synthesis from Sparse Motion-Blurred Imagescited by 0
  22. 2026World in World: Explore the World with World Modelscited by 0
  23. 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modelingcited by 0
  24. 20264Director: Controlling Video World Models with Rigid 3D Geometrycited by 0
  25. 2026Kepler4D: Controllable Future Video Generation via 4D Scene State Evolutioncited by 0
  26. 2026ChronoWorld: Camera-Controlled Consistent 4D World Generation via Spatiotemporal Cues and Geometric Reflectionscited by 0
  27. 2026GAD: Geometry Attention Distillation for Consistent Video Generationcited by 0
  28. 2026OneLA: Learning Many Worlds from Latent Actionscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025DynamicVerse: A Physically-Aware Multimodal Framework for 4D World Modeling
  2. 2026GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space
  3. 2025Video World Models with Long-term Spatial Memory
  4. 2026Beyond Pixel Histories: World Models with Persistent 3D State
  5. 2026RAYNOVA: Scale-Temporal Autoregressive World Modeling in Ray Space
  6. 2026Demiurge: Forging Navigable 4D Worlds via Autoregressive Video Rerendering
  7. 2025UniFuture: A 4D Driving World Model for Future Generation and Perception
  8. 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videos