mlsanityData to 14 Oct 2026

Scaffold-GS: Structured 3D Gaussians for View-Adaptive Rendering

arXiv 2312.00109 ↗First posted 30 Nov 2023cs.CVcited by 695

Not on the map. Why?

Cited by 25 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Neural rendering methods have significantly advanced photo-realistic 3D scene rendering in various academic and industrial applications. The recent 3D Gaussian Splatting method has achieved the state-of-the-art rendering quality and speed combining the benefits of both primitive-based representations and volumetric representations. However, it often leads to heavily redundant Gaussians that try to fit every training view, neglecting the underlying scene geometry. Consequently, the resulting model becomes less robust to significant view changes, texture-less area and lighting effects. We introduce Scaffold-GS, which uses anchor points to distribute local 3D Gaussians, and predicts their attributes on-the-fly based on viewing direction and distance within the view frustum. Anchor growing and pruning strategies are developed based on the importance of neural Gaussians to reliably improve the scene coverage. We show that our method effectively reduces redundant Gaussians while delivering high-quality rendering. We also demonstrates an enhanced capability to accommodate scenes with varying levels-of-detail and view-dependent observations, without sacrificing the rendering speed.

Key facts. Cited by 695 papers in the map (data through 14 Oct 2026). Builds on 40 of its 57 references that are in the map. First posted on arXiv 30 Nov 2023.

Builds on

40 of 57 references.

References · 40

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  5. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  6. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  7. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  8. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  9. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  10. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  11. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  12. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
28 more
  1. 2021Volume Rendering of Neural Implicit Surfacescited by 996
  2. 2020Convolutional Occupancy Networkscited by 761
  3. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
  4. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 724
  5. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 671
  6. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
  7. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 588
  8. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  9. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 468
  10. 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 398
  11. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 366
  12. 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
  13. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 332
  14. 2019Neural Point-Based Graphicscited by 327
  15. 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 311
  16. 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
  17. 20223D Neural Field Generation using Triplane Diffusioncited by 274
  18. 2019Differentiable Surface Splatting for Point-based Geometry Processingcited by 239
  19. 2021BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Renderingcited by 229
  20. 2017Learning a Multi-View Stereo Machinecited by 194
  21. 2021Point-Based Neural Rendering with Per-View Optimizationcited by 190
  22. 2017Multi-view Supervision for Single-view Reconstruction via Differentiable Ray Consistencycited by 177
  23. 2017Learning Efficient Point Cloud Generation for Dense 3D Object Reconstructioncited by 133
  24. 2023Grid-guided Neural Radiance Fields for Large Urban Scenescited by 100
  25. 2018Unsupervised Learning of Shape and Pose with Differentiable Point Cloudscited by 89
  26. 2023VR-NeRF: High-Fidelity Virtualized Walkable Spacescited by 86
  27. 2023Factor Fields: A Unified Framework for Neural Fields and Beyondcited by 58
  28. 2023AssetField: Assets Mining and Reconfiguration in Ground Feature Plane Representationcited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 166; 2025: 289; 2026: 240.

695 papers.

Sort:

By area:

  1. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  2. 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
  3. 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 243
  4. 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 230
  5. 2024A Survey on 3D Gaussian Splattingcited by 224
  6. 2024HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compressioncited by 209
  7. 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 200
  8. 2024WildGaussians: 3D Gaussian Splatting in the Wildcited by 152
  9. 2024Recent Advances in 3D Gaussian Splattingcited by 131
  10. 2024Revising Densification in Gaussian Splattingcited by 128
  11. 2024Gaussian in the Wild: 3D Gaussian Splatting for Unconstrained Image Collectionscited by 117
  12. 2024Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splatscited by 114
38 more
  1. 2024Pixel-GS: Density Control with Pixel-aware Gradient for 3D Gaussian Splattingcited by 113
  2. 20243D Gaussian as a New Era: A Surveycited by 104
  3. 2024Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splattingcited by 104
  4. 2024ContextGS: Compact 3D Gaussian Splatting with Anchor Level Context Modelcited by 102
  5. 2024PUP 3D-GS: Principled Uncertainty Pruning for 3D Gaussian Splattingcited by 95
  6. 2024Speedy-Splat: Fast 3D Gaussian Splatting with Sparse Pixels and Sparse Primitivescited by 95
  7. 2024FlashGS: Efficient 3D Gaussian Splatting for Large-scale and High-resolution Renderingcited by 88
  8. 20243DGUT: Enabling Distorted Cameras and Secondary Rays in Gaussian Splattingcited by 88
  9. 2024GSDF: 3DGS Meets SDF for Improved Rendering and Reconstructioncited by 83
  10. 2024CompGS: Efficient 3D Scene Representation via Compressed Gaussian Splattingcited by 82
  11. 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 78
  12. 2024TranSplat: Generalizable 3D Gaussian Splatting from Sparse Multi-View Images with Transformerscited by 75
  13. 2024Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splattingcited by 74
  14. 2024InstantSplat: Sparse-view Gaussian Splatting in Secondscited by 70
  15. 20243DGS.zip: A survey on 3D Gaussian Splatting Compression Methodscited by 69
  16. 2024R2-Gaussian: Rectifying Radiative Gaussian Splatting for Tomographic Reconstructioncited by 67
  17. 2024SCube: Instant Large-Scale Scene Reconstruction using VoxSplatscited by 60
  18. 2025HAC++: Towards 100X Compression of 3D Gaussian Splattingcited by 57
  19. 2024SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstructioncited by 52
  20. 2024Fast Feedforward 3D Gaussian Splatting Compressioncited by 52
  21. 2024Director3D: Real-world Camera Trajectory and 3D Scene Generation from Textcited by 50
  22. 2024On Scaling Up 3D Gaussian Splatting Trainingcited by 49
  23. 2025NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidancecited by 49
  24. 2025VolSplat: Rethinking Feed-Forward 3D Gaussian Splatting with Voxel-Aligned Predictioncited by 48
  25. 2024Trimming the Fat: Efficient Compression of 3D Gaussian Splats through Pruningcited by 47
  26. 2024MEGA: Memory-Efficient 4D Gaussian Splatting for Dynamic Scenescited by 47
  27. 2024RenderWorld: World Model with Self-Supervised 3D Labelcited by 46
  28. 2025Dens3R: A Foundation Model for 3D Geometry Predictioncited by 46
  29. 20243D-HGS: 3D Half-Gaussian Splattingcited by 44
  30. 2024Generative Gaussian Splatting for Unbounded 3D City Generationcited by 44
  31. 2024When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Modelscited by 43
  32. 20243DGS-LM: Faster Gaussian-Splatting Optimization with Levenberg-Marquardtcited by 43
  33. 2025FastGS: Training 3D Gaussian Splatting in 100 Secondscited by 43
  34. 2024BAGS: Blur Agnostic Gaussian Splatting through Multi-Scale Kernel Modelingcited by 42
  35. 2025Swift4D:Adaptive divide-and-conquer Gaussian Splatting for compact and efficient reconstruction of dynamic scenecited by 42
  36. 2024Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Reviewcited by 41
  37. 2024MaskGaussian: Adaptive 3D Gaussian Representation from Probabilistic Maskscited by 41
  38. 2025CAT-3DGS: A Context-Adaptive Triplane Approach to Rate-Distortion-Optimized 3DGS Compressioncited by 41

50 most cited of 695 All 695 (JSON)