Terra: Explorable Native 3D World Model with Point Latents
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
World models have garnered increasing attention for comprehensive modeling of the real world. However, most existing methods still rely on pixel-aligned representations as the basis for world evolution, neglecting the inherent 3D nature of the physical world. This could undermine the 3D consistency and diminish the modeling efficiency of world models. In this paper, we present Terra, a native 3D world model that represents and generates explorable environments in an intrinsic 3D latent space. Specifically, we propose a novel point-to-Gaussian variational autoencoder (P2G-VAE) that encodes 3D inputs into a latent point representation, which is subsequently decoded as 3D Gaussian primitives to jointly model geometry and appearance. We then introduce a sparse point flow matching network (SPFlow) for generating the latent point representation, which simultaneously denoises the positions and features of the point latents. Our Terra enables exact multi-view consistency with native 3D representation and architecture, and supports flexible rendering from any viewpoint with only a single generation process. Furthermore, Terra achieves explorable world modeling through progressive generation in the point latent space. We conduct extensive experiments on the challenging indoor scenes from ScanNet v2. Terra achieves state-of-the-art performance in both reconstruction and generation with high 3D consistency.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 59 of its 66 references that are in the map. First posted on arXiv 16 Oct 2025.
Builds on
59 of 66 references.
Closest ancestors · 10
Same direction, newest first
- 2025Video World Models with Long-term Spatial Memory5 Jun
- 2025DeepVerse: 4D Autoregressive Video Generation as a World Model1 Jun
- 2024Owl-1: Omni World Model for Consistent Long Video Generation12 Dec
- 2024Pandora: Towards General World Model with Natural Language Actions and Video States12 Jun
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text21 Mar
- 2024Genie: Generative Interactive Environments23 Feb
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022Flow Matching for Generative Modeling6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 49
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2020Point Transformercited by 1,462
- 2018World Modelscited by 1,444
37 more
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 230
- 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 202
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
- 2023NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generationcited by 170
- 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 146
- 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 132
- 2025Aether: Geometric-Aware Unified World Modelingcited by 94
- 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generationcited by 93
- 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Drivingcited by 89
- 2024Doe-1: Closed-Loop Autonomous Driving with Large World Modelcited by 51
- 2024OA-CNNs: Omni-Adaptive Sparse CNNs for 3D Semantic Segmentationcited by 43
- 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understandingcited by 43
- 2025VideoWorld: Exploring Knowledge Learning from Unlabeled Videoscited by 42
- 2025Matrix3D: Large Photogrammetry Model All-in-Onecited by 39
- 2024Prometheus: 3D-Aware Latent Diffusion Models for Feed-Forward Text-to-3D Scene Generationcited by 33
- 2025Matrix-3D: Omnidirectional Explorable 3D World Generationcited by 33
- 2024Effective Rank Analysis and Regularization for Enhanced 3D Gaussian Splattingcited by 29
- 2024Monocular Occupancy Prediction for Scalable Indoor Scenescited by 29
- 2024P2P-Bridge: Diffusion Bridges for 3D Point Cloud Denoisingcited by 18
- 2024World Model-based Perception for Visual Legged Locomotioncited by 17
- 2025Not-So-Optimal Transport Flows for 3D Point Cloud Generationcited by 17
- 2023FrePolad: Frequency-Rectified Point Latent Diffusion for Point Cloud Generationcited by 9
- 2025SceneCompleter: Dense 3D Scene Completion for Generative Novel View Synthesiscited by 5
- 2025Can3Tok: Canonical 3D Tokenization and Latent Modeling of Scene-Level 3D Gaussianscited by 5
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modelingcited by 2
- 2026Grounding Spatial Relations in a Compact World Model: Instruction Leakage and a Goal-Free Dynamics Fixcited by 0
- 2026World in World: Explore the World with World Modelscited by 0
- 2026World in World: Explore the World with World Models10 Sep 2026
- 2026Grounding Spatial Relations in a Compact World Model: Instruction Leakage and a Goal-Free Dynamics Fix8 Jul 2026
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modeling14 May 2026
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmap11 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2023Persistent Nature: A Generative Model of Unbounded 3D Worlds
- 2025EarthCrafter: Scalable 3D Earth Generation via Dual-Sparse Latent Diffusion
- 20253D and 4D World Modeling: A Survey
- 2026Beyond Pixel Histories: World Models with Persistent 3D State
- 2026GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space
- 2026ABot-3DWorld 0: A Universal World Model to Explore Any 3D Space
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds
- 2026WorldFlow3D: Flowing Through 3D Distributions for Unbounded World Generation