GenRecon: Bridging Generative Priors for Multi-View 3D Scene Reconstruction
Not on the map. Why?
Abstract (arXiv)
We introduce a new approach to high-fidelity 3D scene reconstruction from multi-view RGB images that tightly couples reconstruction with a strong generative 3D prior. We cast scene reconstruction as conditional 3D generation over a set of spatially-localized, overlapping chunks that together tile the scene, scaling generation to large scene extents. Crucially, we inherit the fidelity and completeness of state-of-the-art generative shape models -- we use Trellis.2 as an example -- which we generalize to the scene level. To this end, we propose a projection-based conditioning mechanism that lifts posed multi-view image features into a coherent 3D representation aligned with the generative model, independent of view ordering and spatially anchored to the scene, yielding high-fidelity, multi-view consistent generated geometry. This enables lifting the strong object-level prior of Trellis.2 to multi-view, scene-scale generation, producing faithful, editable PBR mesh reconstructions of indoor environments. As a result, we obtain high-fidelity results that outperform cutting-edge reconstruction methods by 16%.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 55 of its 65 references that are in the map. First posted on arXiv 22 May 2026.
Builds on
55 of 65 references.
References · 55
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
38 more
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 248
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 243
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 204
- 2025Native and Compact Structured Latents for 3D Generationcited by 175
- 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 143
- 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidancecited by 138
- 2024GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splattingcited by 109
- 2021TransformerFusion: Monocular RGB Scene Reconstruction using Transformerscited by 106
- 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
- 2022SimpleRecon: 3D Reconstruction Without 3D Convolutionscited by 83
- 2024PF3plat: Pose-Free Feed-Forward 3D Gaussian Splattingcited by 62
- 2024ComboVerse: Compositional 3D Assets Creation Using Spatially-Aware Diffusion Guidancecited by 59
- 2026SAGE: Scalable Agentic 3D Scene Generation for Embodied AIcited by 50
- 2024REPARO: Compositional 3D Assets Generation with Differentiable 3D Layout Alignmentcited by 45
- 2021VoRTX: Volumetric 3D Reconstruction With Transformers for Voxelwise View Selection and Fusioncited by 38
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priorscited by 37
- 2025YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splattingcited by 37
- 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 33
- 2024UFORecon: Generalizable Sparse-View Surface Reconstruction from Arbitrary and UnFavOrable Setscited by 23
- 2025Multi-view Reconstruction via SfM-guided Monocular Depth Estimationcited by 20
- 2026MV-SAM3D: Adaptive Multi-View Fusion for Layout-Aware 3D Generationcited by 19
- 2023FineRecon: Depth-aware Feed-forward Network for Detailed 3D Reconstructioncited by 17
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026WorldSculpt: Generating Compositional Worlds from Grounded Videoscited by 2
- 2026Revisiting Local Context for Long-Horizon Streaming 3D Reconstructioncited by 1
- 2026CODA: Depth-Aligned Scene Completion and Object Decomposition from a Single RGB-D Imagecited by 0
- 2026Building Rome from a Single Imagecited by 0
- 2026Into the LidarVerse: A Real-Time Unified LiDAR World Model Across Tasks and Sensorscited by 0
- 2026Into the LidarVerse: A Real-Time Unified LiDAR World Model Across Tasks and Sensors13 Oct 2026
- 2026Building Rome from a Single Image6 Oct 2026
- 2026CODA: Depth-Aligned Scene Completion and Object Decomposition from a Single RGB-D Image22 Sep 2026
- 2026WorldSculpt: Generating Compositional Worlds from Grounded Videos4 Sep 2026
- 2026Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction27 Aug 2026