Evaluating Alternatives to SFM Point Cloud Initialization for Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting has recently been embraced as a versatile and effective method for scene reconstruction and novel view synthesis, owing to its high-quality results and compatibility with hardware rasterization. Despite its advantages, Gaussian Splatting's reliance on high-quality point cloud initialization by Structure-from-Motion (SFM) algorithms is a significant limitation to be overcome. To this end, we investigate various initialization strategies for Gaussian Splatting and delve into how volumetric reconstructions from Neural Radiance Fields (NeRF) can be utilized to bypass the dependency on SFM data. Our findings demonstrate that random initialization can perform much better if carefully designed and that by employing a combination of improved initialization strategies and structure distillation from low-cost NeRF models, it is possible to achieve equivalent results, or at times even superior, to those obtained from SFM initialization. Source code is available at https://theialab.github.io/nerf-3dgs .
Key facts. Cited by 9 papers in the map (data through 13 Oct 2026). Builds on 35 of its 42 references that are in the map. First posted on arXiv 18 Apr 2024.
Builds on
35 of 42 references.
References · 35
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,082
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,170
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,712
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,686
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,039
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,021
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,610
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,277
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,150
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 984
- 2020Neural Sparse Voxel Fieldscited by 959
23 more
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 895
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 866
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 839
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 756
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 733
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 673
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 663
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
- 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
- 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 257
- 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
- 20243D Gaussian Splatting as Markov Chain Monte Carlocited by 214
- 2023COLMAP-Free 3D Gaussian Splattingcited by 193
- 2023HUGS: Human Gaussian Splatscited by 154
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
- 2023Multi-Scale 3D Gaussian Splatting for Anti-Aliased Renderingcited by 137
- 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 112
- 2023NerfAcc: Efficient Sampling Accelerates NeRFscited by 90
- 2021LOLNeRF: Learn from One Lookcited by 84
- 2023GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learningcited by 63
- 2022nerf2nerf: Pairwise Registration of Neural Radiance Fieldscited by 39
- 2023A Large-Scale Outdoor Multi-modal Dataset and Benchmark for Novel View Synthesis and Implicit Scene Reconstructioncited by 32
Built on by
Citing papers per year: 2024: 2; 2025: 3; 2026: 4.
9 papers.
- 2024Turbo-GS: Accelerating 3D Gaussian Fitting for High-Quality Radiance Fieldscited by 8
- 2026GaussFusion: Improving 3D Reconstruction in the Wild with A Geometry-Informed Video Generatorcited by 6
- 2025ConeGS: Error-Guided Densification Using Pixel Cones for Improved Reconstruction With Fewer Primitivescited by 5
- 2024Exploring Dynamic Novel View Synthesis Technologies for Cinematographycited by 1
- 2025DBMovi-GS: Dynamic View Synthesis from Blurry Monocular Video via Sparse-Controlled Gaussian Splattingcited by 1
- 2025Reconstructing Tornadoes in 3D with Gaussian Splattingcited by 0
- 2026The Role of Initialization in 3D Gaussian Splattingcited by 0
- 2026RouteBridge: Reliability-Routed Bidirectional Distillation Between Neural Radiance Fields and 3D Gaussian Splattingcited by 0
- 2026Is Gaussian Splatting Becoming Neural Again? A Taxonomy and Controlled Study of Learned Parameterizationcited by 0
- 2026Is Gaussian Splatting Becoming Neural Again? A Taxonomy and Controlled Study of Learned Parameterization11 Sep 2026
- 2026RouteBridge: Reliability-Routed Bidirectional Distillation Between Neural Radiance Fields and 3D Gaussian Splatting9 Sep 2026
- 2026GaussFusion: Improving 3D Reconstruction in the Wild with A Geometry-Informed Video Generator26 Mar 2026
- 2026The Role of Initialization in 3D Gaussian Splatting21 Mar 2026
- 2025ConeGS: Error-Guided Densification Using Pixel Cones for Improved Reconstruction With Fewer Primitives10 Nov 2025
- 2025DBMovi-GS: Dynamic View Synthesis from Blurry Monocular Video via Sparse-Controlled Gaussian Splatting26 Jun 2025
- 2025Reconstructing Tornadoes in 3D with Gaussian Splatting23 Jun 2025
- 2024Exploring Dynamic Novel View Synthesis Technologies for Cinematography23 Dec 2024
- 2024Turbo-GS: Accelerating 3D Gaussian Fitting for High-Quality Radiance Fields18 Dec 2024