DeepVerse: 4D Autoregressive Video Generation as a World Model
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
World models serve as essential building blocks toward Artificial General Intelligence (AGI), enabling intelligent agents to predict future states and plan actions by simulating complex physical interactions. However, existing interactive models primarily predict visual observations, thereby neglecting crucial hidden states like geometric structures and spatial coherence. This leads to rapid error accumulation and temporal inconsistency. To address these limitations, we introduce DeepVerse, a novel 4D interactive world model explicitly incorporating geometric predictions from previous timesteps into current predictions conditioned on actions. Experiments demonstrate that by incorporating explicit geometric constraints, DeepVerse captures richer spatio-temporal relationships and underlying physical dynamics. This capability significantly reduces drift and enhances temporal consistency, enabling the model to reliably generate extended future sequences and achieve substantial improvements in prediction accuracy, visual realism, and scene rationality. Furthermore, our method provides an effective solution for geometry-aware memory retrieval, effectively preserving long-term spatial consistency. We validate the effectiveness of DeepVerse across diverse scenarios, establishing its capacity for high-fidelity, long-horizon predictions grounded in geometry-aware dynamics.
Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 46 of its 55 references that are in the map. First posted on arXiv 1 Jun 2025.
Builds on
46 of 55 references.
Closest ancestors · 4
Same direction, newest first
- 2025GameFactory: Creating New Games with Generative Interactive Videos14 Jan
- 2024Genie: Generative Interactive Environments23 Feb
- 2022Flow Matching for Generative Modeling6 Oct
- 2021Learning Transferable Visual Models From Natural Language Supervision26 Feb
Other references · 42
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2019Root Mean Square Layer Normalizationcited by 1,480
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
30 more
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
- 2020Query-Key Normalization for Transformerscited by 280
- 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 183
- 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 143
- 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 131
- 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
- 2025Aether: Geometric-Aware Unified World Modelingcited by 97
- 2024The Matrix: Infinite-Horizon World Generation with Real-Time Moving Controlcited by 80
- 2023UniPAD: A Universal Pre-training Paradigm for Autonomous Drivingcited by 73
- 2025DemoGen: Synthetic Demonstration Generation for Data-Efficient Visuomotor Policy Learningcited by 69
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstructioncited by 67
- 2023PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigmcited by 56
- 2024GVGEN: Text-to-3D Generation with Volumetric Representationcited by 51
- 2024Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulationcited by 46
- 2024Point Cloud Matters: Rethinking the Impact of Different Observation Spaces on Robot Learningcited by 45
- 2024RISE: 3D Perception Makes Real-World Robot Imitation Simple and Effectivecited by 41
- 2025FP3: A 3D Foundation Policy for Robotic Manipulationcited by 32
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
- 2024SPA: 3D Spatial-Awareness Enables Effective Embodied Representationcited by 28
- 2024GigaGS: Scaling up Planar-Based 3D Gaussians for Large Scene Surface Reconstructioncited by 20
- 2025H3DP: Triply-Hierarchical Diffusion Policy for Visuomotor Learningcited by 16
- 2025MeshCraft: Exploring Efficient and Controllable Mesh Generation with Flow-based DiTscited by 14
- 2024CoSurfGS:Collaborative 3D Surface Gaussian Splatting with Distributed Learning for Large Scene Reconstructioncited by 11
- 2022X-NeRF: Explicit Neural Radiance Field for Multi-Scene 360circ Insufficient RGB-D Viewscited by 10
- 2024Where Am I and What Will I See: An Auto-Regressive Model for Spatial Localization and View Predictioncited by 4
Built on by
Citing papers per year: 2025: 14; 2026: 26.
40 papers.
Sort:
By area:
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 186
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memorycited by 100
- 2025RELIC: Interactive Video World Model with Long-Horizon Memorycited by 96
- 2025A Comprehensive Survey on World Models for Embodied AIcited by 68
- 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 62
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 55
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Modelscited by 51
- 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Predictioncited by 38
- 2025WinT3R: Window-Based Streaming Reconstruction with Camera Token Poolcited by 35
- 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Controlcited by 28
- 2026VINO: A Unified Visual Generator with Interleaved OmniModal Contextcited by 26
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memoriescited by 18
28 more
- 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPUcited by 16
- 2026Grounding World Simulation Models in a Real-World Metropoliscited by 12
- 2026WorldCam: Interactive Autoregressive 3D Gaming Worlds with Camera Pose as a Unifying Geometric Representationcited by 12
- 2026Plenoptic Video Generationcited by 9
- 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memorycited by 9
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 8
- 2025UnityVideo: Unified Multi-Modal Multi-Task Learning for Enhancing World-Aware Video Generationcited by 7
- 2025iMontage: Unified, Versatile, Highly Dynamic Many-to-many Image Generationcited by 6
- 2025Terra: Explorable Native 3D World Model with Point Latentscited by 4
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
- 2026Stereo World Model: Camera-Guided Stereo Video Generationcited by 3
- 2026DisCo: World Models with Discrete Camera Motion Controlcited by 2
- 2026CP4D: Compositional Physics-aware 4D Scene Generationcited by 2
- 2026Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Meshcited by 2
- 2025SyncMV4D: Synchronized Multi-view Joint Diffusion of Appearance and Motion for Hand-Object Interaction Synthesiscited by 1
- 2025CustomX: Unified Character, Action, and Scene Customization in Video World Modelscited by 1
- 2026Preserve, Reveal, Expand: Faithful 4D Video Editing with Region-Aware Conditioningcited by 1
- 2026OctWorld: Long-Range World-Consistent Video Generation with Octree-Based 3D Mappingcited by 1
- 2025Thinking Ahead: Foresight Intelligence in MLLMs and World Modelcited by 0
- 2026Divide and Conquer: Decoupled Representation Alignment for Multimodal World Modelscited by 0
- 2026DeblurNVS: Geometric Latent Diffusion for Novel View Synthesis from Sparse Motion-Blurred Imagescited by 0
- 2026World in World: Explore the World with World Modelscited by 0
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modelingcited by 0
- 20264Director: Controlling Video World Models with Rigid 3D Geometrycited by 0
- 2026Kepler4D: Controllable Future Video Generation via 4D Scene State Evolutioncited by 0
- 2026ChronoWorld: Camera-Controlled Consistent 4D World Generation via Spatiotemporal Cues and Geometric Reflectionscited by 0
- 2026GAD: Geometry Attention Distillation for Consistent Video Generationcited by 0
- 2026OneLA: Learning Many Worlds from Latent Actionscited by 0
- 2026OneLA: Learning Many Worlds from Latent Actions14 Oct 2026
- 2026GAD: Geometry Attention Distillation for Consistent Video Generation13 Oct 2026
- 2026ChronoWorld: Camera-Controlled Consistent 4D World Generation via Spatiotemporal Cues and Geometric Reflections5 Oct 2026
- 2026Kepler4D: Controllable Future Video Generation via 4D Scene State Evolution2 Oct 2026
- 20264Director: Controlling Video World Models with Rigid 3D Geometry1 Oct 2026
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modeling22 Sep 2026
- 2026World in World: Explore the World with World Models10 Sep 2026
- 2026OctWorld: Long-Range World-Consistent Video Generation with Octree-Based 3D Mapping3 Sep 2026
- 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory30 Aug 2026
- 2026Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Mesh30 Jul 2026
- 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU21 Jul 2026
- 2026CP4D: Compositional Physics-aware 4D Scene Generation8 Jun 2026
28 more
- 2026DisCo: World Models with Discrete Camera Motion Control6 Jun 2026
- 2026DeblurNVS: Geometric Latent Diffusion for Novel View Synthesis from Sparse Motion-Blurred Images31 May 2026
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends31 May 2026
- 2026Preserve, Reveal, Expand: Faithful 4D Video Editing with Region-Aware Conditioning20 May 2026
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May 2026
- 2026Divide and Conquer: Decoupled Representation Alignment for Multimodal World Models3 May 2026
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr 2026
- 2026Stereo World Model: Camera-Guided Stereo Video Generation18 Mar 2026
- 2026WorldCam: Interactive Autoregressive 3D Gaming Worlds with Camera Pose as a Unifying Geometric Representation17 Mar 2026
- 2026Grounding World Simulation Models in a Real-World Metropolis16 Mar 2026
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories2 Mar 2026
- 2026Plenoptic Video Generation8 Jan 2026
- 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Control8 Jan 2026
- 2026VINO: A Unified Visual Generator with Interleaved OmniModal Context5 Jan 2026
- 2025CustomX: Unified Character, Action, and Scene Customization in Video World Models18 Dec 2025
- 2025UnityVideo: Unified Multi-Modal Multi-Task Learning for Enhancing World-Aware Video Generation8 Dec 2025
- 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec 2025
- 2025iMontage: Unified, Versatile, Highly Dynamic Many-to-many Image Generation25 Nov 2025
- 2025SyncMV4D: Synchronized Multi-view Joint Diffusion of Appearance and Motion for Hand-Object Interaction Synthesis24 Nov 2025
- 2025Thinking Ahead: Foresight Intelligence in MLLMs and World Model24 Nov 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
- 2025A Comprehensive Survey on World Models for Embodied AI19 Oct 2025
- 2025Terra: Explorable Native 3D World Model with Point Latents16 Oct 2025
- 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Prediction25 Sep 2025
- 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modeling15 Sep 2025
- 2025WinT3R: Window-Based Streaming Reconstruction with Camera Token Pool5 Sep 2025
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug 2025
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models1 Jul 2025
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 186
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memorycited by 100
- 2025RELIC: Interactive Video World Model with Long-Horizon Memorycited by 96
- 2025A Comprehensive Survey on World Models for Embodied AIcited by 68
- 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 62
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 55
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Modelscited by 51
- 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Predictioncited by 38
- 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Controlcited by 28
- 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPUcited by 16
- 2026Grounding World Simulation Models in a Real-World Metropoliscited by 12
- 2026WorldCam: Interactive Autoregressive 3D Gaming Worlds with Camera Pose as a Unifying Geometric Representationcited by 12
12 most cited of 25 All 25 (JSON)
- 2026OneLA: Learning Many Worlds from Latent Actions14 Oct 2026
- 2026Kepler4D: Controllable Future Video Generation via 4D Scene State Evolution2 Oct 2026
- 20264Director: Controlling Video World Models with Rigid 3D Geometry1 Oct 2026
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modeling22 Sep 2026
- 2026World in World: Explore the World with World Models10 Sep 2026
- 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory30 Aug 2026
- 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU21 Jul 2026
- 2026DisCo: World Models with Discrete Camera Motion Control6 Jun 2026
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends31 May 2026
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May 2026
- 2026Divide and Conquer: Decoupled Representation Alignment for Multimodal World Models3 May 2026
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr 2026
12 newest of 25 All 25 (JSON)
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memoriescited by 18
- 2026Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Meshcited by 2
- 2026Preserve, Reveal, Expand: Faithful 4D Video Editing with Region-Aware Conditioningcited by 1
- 2026OctWorld: Long-Range World-Consistent Video Generation with Octree-Based 3D Mappingcited by 1
- 2026DeblurNVS: Geometric Latent Diffusion for Novel View Synthesis from Sparse Motion-Blurred Imagescited by 0
- 2026GAD: Geometry Attention Distillation for Consistent Video Generationcited by 0
- 2026GAD: Geometry Attention Distillation for Consistent Video Generation13 Oct 2026
- 2026OctWorld: Long-Range World-Consistent Video Generation with Octree-Based 3D Mapping3 Sep 2026
- 2026Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Mesh30 Jul 2026
- 2026DeblurNVS: Geometric Latent Diffusion for Novel View Synthesis from Sparse Motion-Blurred Images31 May 2026
- 2026Preserve, Reveal, Expand: Faithful 4D Video Editing with Region-Aware Conditioning20 May 2026
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories2 Mar 2026
- 2025WinT3R: Window-Based Streaming Reconstruction with Camera Token Poolcited by 35
- 2026VINO: A Unified Visual Generator with Interleaved OmniModal Contextcited by 26
- 2026Plenoptic Video Generationcited by 9
- 2025UnityVideo: Unified Multi-Modal Multi-Task Learning for Enhancing World-Aware Video Generationcited by 7
- 2025iMontage: Unified, Versatile, Highly Dynamic Many-to-many Image Generationcited by 6
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
- 2026CP4D: Compositional Physics-aware 4D Scene Generationcited by 2
- 2025SyncMV4D: Synchronized Multi-view Joint Diffusion of Appearance and Motion for Hand-Object Interaction Synthesiscited by 1
- 2026ChronoWorld: Camera-Controlled Consistent 4D World Generation via Spatiotemporal Cues and Geometric Reflectionscited by 0
- 2026ChronoWorld: Camera-Controlled Consistent 4D World Generation via Spatiotemporal Cues and Geometric Reflections5 Oct 2026
- 2026CP4D: Compositional Physics-aware 4D Scene Generation8 Jun 2026
- 2026Plenoptic Video Generation8 Jan 2026
- 2026VINO: A Unified Visual Generator with Interleaved OmniModal Context5 Jan 2026
- 2025UnityVideo: Unified Multi-Modal Multi-Task Learning for Enhancing World-Aware Video Generation8 Dec 2025
- 2025iMontage: Unified, Versatile, Highly Dynamic Many-to-many Image Generation25 Nov 2025
- 2025SyncMV4D: Synchronized Multi-view Joint Diffusion of Appearance and Motion for Hand-Object Interaction Synthesis24 Nov 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
- 2025WinT3R: Window-Based Streaming Reconstruction with Camera Token Pool5 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025DynamicVerse: A Physically-Aware Multimodal Framework for 4D World Modeling
- 2026GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space
- 2025Video World Models with Long-term Spatial Memory
- 2026Beyond Pixel Histories: World Models with Persistent 3D State
- 2026RAYNOVA: Scale-Temporal Autoregressive World Modeling in Ray Space
- 2026Demiurge: Forging Navigable 4D Worlds via Autoregressive Video Rerendering
- 2025UniFuture: A 4D Driving World Model for Future Generation and Perception
- 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videos