mlsanityData to 13 Oct 2026

Evaluating Alternatives to SFM Point Cloud Initialization for Gaussian Splatting

arXiv 2404.12547 ↗First posted 18 Apr 2024cs.CVcited by 9

Not on the map. Why?

Abstract (arXiv)

3D Gaussian Splatting has recently been embraced as a versatile and effective method for scene reconstruction and novel view synthesis, owing to its high-quality results and compatibility with hardware rasterization. Despite its advantages, Gaussian Splatting's reliance on high-quality point cloud initialization by Structure-from-Motion (SFM) algorithms is a significant limitation to be overcome. To this end, we investigate various initialization strategies for Gaussian Splatting and delve into how volumetric reconstructions from Neural Radiance Fields (NeRF) can be utilized to bypass the dependency on SFM data. Our findings demonstrate that random initialization can perform much better if carefully designed and that by employing a combination of improved initialization strategies and structure distillation from low-cost NeRF models, it is possible to achieve equivalent results, or at times even superior, to those obtained from SFM initialization. Source code is available at https://theialab.github.io/nerf-3dgs .

Key facts. Cited by 9 papers in the map (data through 13 Oct 2026). Builds on 35 of its 42 references that are in the map. First posted on arXiv 18 Apr 2024.

Builds on

35 of 42 references.

References · 35

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,082
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,170
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,712
  4. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,686
  5. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,039
  6. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,021
  7. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,610
  8. 2022TensoRF: Tensorial Radiance Fieldscited by 1,277
  9. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,150
  10. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  11. 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 984
  12. 2020Neural Sparse Voxel Fieldscited by 959
23 more
  1. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 895
  2. 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 866
  3. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 839
  4. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 756
  5. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 733
  6. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 673
  7. 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 663
  8. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
  9. 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
  10. 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
  11. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 257
  12. 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
  13. 20243D Gaussian Splatting as Markov Chain Monte Carlocited by 214
  14. 2023COLMAP-Free 3D Gaussian Splattingcited by 193
  15. 2023HUGS: Human Gaussian Splatscited by 154
  16. 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
  17. 2023Multi-Scale 3D Gaussian Splatting for Anti-Aliased Renderingcited by 137
  18. 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 112
  19. 2023NerfAcc: Efficient Sampling Accelerates NeRFscited by 90
  20. 2021LOLNeRF: Learn from One Lookcited by 84
  21. 2023GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learningcited by 63
  22. 2022nerf2nerf: Pairwise Registration of Neural Radiance Fieldscited by 39
  23. 2023A Large-Scale Outdoor Multi-modal Dataset and Benchmark for Novel View Synthesis and Implicit Scene Reconstructioncited by 32

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2024: 2; 2025: 3; 2026: 4.

9 papers.