mlsanityData to 7 Oct 2026

Terra: Explorable Native 3D World Model with Point Latents

arXiv 2510.14977 ↗First posted 16 Oct 2025cs.CV cs.AI cs.LGcited by 4

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

World models have garnered increasing attention for comprehensive modeling of the real world. However, most existing methods still rely on pixel-aligned representations as the basis for world evolution, neglecting the inherent 3D nature of the physical world. This could undermine the 3D consistency and diminish the modeling efficiency of world models. In this paper, we present Terra, a native 3D world model that represents and generates explorable environments in an intrinsic 3D latent space. Specifically, we propose a novel point-to-Gaussian variational autoencoder (P2G-VAE) that encodes 3D inputs into a latent point representation, which is subsequently decoded as 3D Gaussian primitives to jointly model geometry and appearance. We then introduce a sparse point flow matching network (SPFlow) for generating the latent point representation, which simultaneously denoises the positions and features of the point latents. Our Terra enables exact multi-view consistency with native 3D representation and architecture, and supports flexible rendering from any viewpoint with only a single generation process. Furthermore, Terra achieves explorable world modeling through progressive generation in the point latent space. We conduct extensive experiments on the challenging indoor scenes from ScanNet v2. Terra achieves state-of-the-art performance in both reconstruction and generation with high 3D consistency.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 59 of its 66 references that are in the map. First posted on arXiv 16 Oct 2025.

Builds on

59 of 66 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025Video World Models with Long-term Spatial Memory5 Jun
  2. 2025DeepVerse: 4D Autoregressive Video Generation as a World Model1 Jun
  3. 2024Owl-1: Omni World Model for Consistent Long Video Generation12 Dec
  4. 2024Pandora: Towards General World Model with Natural Language Actions and Video States12 Jun
  5. 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text21 Mar
  6. 2024Genie: Generative Interactive Environments23 Feb
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  8. 2022Scalable Diffusion Models with Transformers19 Dec
  9. 2022Flow Matching for Generative Modeling6 Oct
  10. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 49

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  7. 2013Auto-Encoding Variational Bayescited by 3,980
  8. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  9. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  10. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  11. 2020Point Transformercited by 1,462
  12. 2018World Modelscited by 1,444
37 more
  1. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  2. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  3. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  4. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  5. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
  6. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  7. 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
  8. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
  9. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
  10. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
  11. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
  12. 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 230
  13. 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 202
  14. 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
  15. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
  16. 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
  17. 2023NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generationcited by 170
  18. 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 146
  19. 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 132
  20. 2025Aether: Geometric-Aware Unified World Modelingcited by 94
  21. 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generationcited by 93
  22. 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Drivingcited by 89
  23. 2024Doe-1: Closed-Loop Autonomous Driving with Large World Modelcited by 51
  24. 2024OA-CNNs: Omni-Adaptive Sparse CNNs for 3D Semantic Segmentationcited by 43
  25. 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understandingcited by 43
  26. 2025VideoWorld: Exploring Knowledge Learning from Unlabeled Videoscited by 42
  27. 2025Matrix3D: Large Photogrammetry Model All-in-Onecited by 39
  28. 2024Prometheus: 3D-Aware Latent Diffusion Models for Feed-Forward Text-to-3D Scene Generationcited by 33
  29. 2025Matrix-3D: Omnidirectional Explorable 3D World Generationcited by 33
  30. 2024Effective Rank Analysis and Regularization for Enhanced 3D Gaussian Splattingcited by 29
  31. 2024Monocular Occupancy Prediction for Scalable Indoor Scenescited by 29
  32. 2024P2P-Bridge: Diffusion Bridges for 3D Point Cloud Denoisingcited by 18
  33. 2024World Model-based Perception for Visual Legged Locomotioncited by 17
  34. 2025Not-So-Optimal Transport Flows for 3D Point Cloud Generationcited by 17
  35. 2023FrePolad: Frequency-Rectified Point Latent Diffusion for Point Cloud Generationcited by 9
  36. 2025SceneCompleter: Dense 3D Scene Completion for Generative Novel View Synthesiscited by 5
  37. 2025Can3Tok: Canonical 3D Tokenization and Latent Modeling of Scene-Level 3D Gaussianscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Persistent Nature: A Generative Model of Unbounded 3D Worlds
  2. 2025EarthCrafter: Scalable 3D Earth Generation via Dual-Sparse Latent Diffusion
  3. 20253D and 4D World Modeling: A Survey
  4. 2026Beyond Pixel Histories: World Models with Persistent 3D State
  5. 2026GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space
  6. 2026ABot-3DWorld 0: A Universal World Model to Explore Any 3D Space
  7. 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds
  8. 2026WorldFlow3D: Flowing Through 3D Distributions for Unbounded World Generation