Beyond Existance: Fulfill 3D Reconstructed Scenes with Pseudo Details
Not on the map. Why?
Abstract (arXiv)
The emergence of 3D Gaussian Splatting (3D-GS) has significantly advanced 3D reconstruction by providing high fidelity and fast training speeds across various scenarios. While recent efforts have mainly focused on improving model structures to compress data volume or reduce artifacts during zoom-in and zoom-out operations, they often overlook an underlying issue: training sampling deficiency. In zoomed-in views, Gaussian primitives can appear unregulated and distorted due to their dilation limitations and the insufficient availability of scale-specific training samples. Consequently, incorporating pseudo-details that ensure the completeness and alignment of the scene becomes essential. In this paper, we introduce a new training method that integrates diffusion models and multi-scale training using pseudo-ground-truth data. This approach not only notably mitigates the dilation and zoomed-in artifacts but also enriches reconstructed scenes with precise details out of existing scenarios. Our method achieves state-of-the-art performance across various benchmarks and extends the capabilities of 3D reconstruction beyond training datasets.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 67 of its 84 references that are in the map. First posted on arXiv 6 Mar 2025.
Builds on
67 of 84 references.
References · 67
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
38 more
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2020Neural Sparse Voxel Fieldscited by 959
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
- 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 420
- 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 396
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
- 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 359
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
- 2023Text-to-3D using Gaussian Splattingcited by 299
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2021BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Renderingcited by 228
- 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 225
- 2020Image Matching across Wide Baselines: From Paper to Practicecited by 224
- 2023MatrixCity: A Large-scale City Dataset for City-scale Neural Rendering and Beyondcited by 185
- 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 175
50 most cited of 67 All 67 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstruction
- 2025FixingGS: Enhancing 3D Gaussian Splatting via Training-Free Score Distillation
- 2025Diffusion-Guided Gaussian Splatting for Large-Scale Unconstrained 3D Reconstruction and Novel View Synthesis
- 2025Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors
- 2026GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors
- 2026DensiTok: Making Feed-Forward 3D Gaussian Splatting See More Views Than It Is Given
- 2025Breaking the Vicious Cycle: Coherent 3D Gaussian Splatting from Sparse and Motion-Blurred Views
- 2024LM-Gaussian: Boost Sparse-view 3D Gaussian Splatting with Large Model Priors