WorldRecon: Generative Multi-View Mesh Reconstruction for Large-Scale 3D World
Not on the map. Why?
Abstract (arXiv)
Reconstructing complete, high-quality meshes of large-scale scenes from unposed multi-view images requires faithful geometric grounding while plausibly completing surfaces that are unobserved or only sparsely captured. We present WorldRecon, a generative multi-view reconstruction framework for recovering complete, large-scale 3D scene meshes from unposed RGB images. WorldRecon uses a coarse, noisy global point cloud and camera poses estimated from the input images by a reconstruction model as a global scaffold for whole-scene generation and partitions it into overlapping spatial blocks. To robustly leverage these imperfect geometric priors, we equip the native 3D generative model TRELLIS.2 with a dedicated reconstruction-based conditioning architecture that generates each block from its local point-cloud crop and block-relevant image observations, producing sparse structure, detailed geometry, and PBR materials. To maintain scene-level coherence, we introduce neighbour-aware latent inpainting and a causal world-generation procedure that propagates structural, geometric, and material context across overlapping blocks. Together, these designs scale multi-view generative reconstruction to large-scale scenes, yielding coherent, unified meshes. Extensive experiments demonstrate that WorldRecon achieves state-of-the-art reconstruction performance, reducing Chamfer distance by 14.9% and 43.1% while improving F-score by 17.3% and 12.0% over the strongest baselines on synthetic and real-world indoor scenes, respectively, thereby demonstrating faithful and complete generative reconstruction as well as strong sim-to-real generalization. Project page: https://kszpxxzmc.github.io/WorldRecon-website/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 51 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
43 of 51 references.
References · 43
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
31 more
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
- 2019Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inferencecited by 254
- 2024Global Structure-from-Motion Revisitedcited by 218
- 2020PatchmatchNet: Learned Multi-View Patchmatch Stereocited by 207
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
- 2025Native and Compact Structured Latents for 3D Generationcited by 175
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 166
- 2020SceneFormer: Indoor Scene Generation with Transformerscited by 158
- 2024Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splatscited by 114
- 2024BlockFusion: Expandable 3D Scene Generation using Latent Tri-plane Extrapolationcited by 83
- 2024SCube: Instant Large-Scale Scene Reconstruction using VoxSplatscited by 60
- 2023ControlRoom3D: Room Generation using Semantic Proxy Roomscited by 56
- 2024LT3SD: Latent Trees for 3D Scene Diffusioncited by 55
- 2026SAGE: Scalable Agentic 3D Scene Generation for Embodied AIcited by 50
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priorscited by 37
- 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 33
- 2025SynCity: Training-Free Generation of 3D Worldscited by 31
- 2026VGGT-Omegacited by 26
- 2025Multi-view Reconstruction via SfM-guided Monocular Depth Estimationcited by 20
- 2023FineRecon: Depth-aware Feed-forward Network for Detailed 3D Reconstructioncited by 17
- 2025WorldGrow: Generating Infinite 3D Worldcited by 16
- 2025TRELLISWorld: Training-Free World Generation from Object Generatorscited by 8
- 2026BVB: Benchmarking Agentic Video Understanding via Programmatic Reconstruction in Blendercited by 6
Built on by
Not cited yet.