Spiking GS: Towards High-Accuracy and Low-Cost Surface Reconstruction via Spiking Neuron-based Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting is capable of reconstructing 3D scenes in minutes. Despite recent advances in improving surface reconstruction accuracy, the reconstructed results still exhibit bias and suffer from inefficiency in storage and training. This paper provides a different observation on the cause of the inefficiency and the reconstruction bias, which is attributed to the integration of the low-opacity parts (LOPs) of the generated Gaussians. We show that LOPs consist of Gaussians with overall low-opacity (LOGs) and the low-opacity tails (LOTs) of Gaussians. We propose Spiking GS to reduce such two types of LOPs by integrating spiking neurons into the Gaussian Splatting pipeline. Specifically, we introduce global and local full-precision integrate-and-fire spiking neurons to the opacity and representation function of flattened 3D Gaussians, respectively. Furthermore, we enhance the density control strategy with spiking neurons' thresholds and a new criterion on the scale of Gaussians. Our method can represent more accurate reconstructed surfaces at a lower cost. The supplementary material and code are available at https://github.com/zju-bmi-lab/SpikingGS.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 40 of its 46 references that are in the map. First posted on arXiv 9 Oct 2024.
Builds on
40 of 46 references.
References · 40
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
- 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 575
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
- 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 436
28 more
- 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 372
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
- 2024Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenescited by 232
- 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 212
- 2024HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compressioncited by 209
- 2024High-quality Surface Reconstruction using Gaussian Surfelscited by 161
- 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidancecited by 138
- 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 138
- 2020Back to Event Basics: Self-Supervised Learning of Image Reconstruction for Event Cameras via Photometric Constancycited by 125
- 2021NeRFReN: Neural Radiance Fields with Reflectionscited by 122
- 2022HF-NeuS: Improved Surface Reconstruction Using High-Frequency Detailscited by 121
- 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
- 20243DGSR: Implicit Surface Reconstruction with 3D Gaussian Splattingcited by 79
- 2021Learning Signed Distance Field for Multi-view Surface Reconstructioncited by 76
- 2021HIRE-SNN: Harnessing the Inherent Robustness of Energy-Efficient Deep Spiking Neural Networks by Training with Crafted Input Noisecited by 65
- 2022Event-based Video Reconstruction via Potential-assisted Spiking Neural Networkcited by 59
- 2024VCR-GauS: View Consistent Depth-Normal Regularizer for Gaussian Surface Reconstructioncited by 50
- 2019Temporal-Coded Deep Spiking Neural Network with Easy Training and Robust Performancecited by 46
- 2024Binary Opacity Grids: Capturing Fine Geometric Detail for Mesh-Based View Synthesiscited by 41
- 2023PET-NeuS: Positional Encoding Tri-Planes for Neural Surfacescited by 37
- 2023Spiking PointNet: Spiking Neural Networks for Point Cloudscited by 34
- 2024Trim 3D Gaussian Splatting for Accurate Geometry Representationcited by 28
- 2022View Synthesis with Sculpted Neural Pointscited by 20
- 2022Brain-inspired Multilayer Perceptron with Spiking Neuronscited by 16
- 2021PrivateSNN: Privacy-Preserving Spiking Neural Networkscited by 15
- 2022Toward Robust Spiking Neural Network Against Adversarial Perturbationcited by 12
- 2022DeepShadow: Neural Shape from Shadowcited by 6
- 2023Spiking NeRF: Representing the Real-World Geometry by a Discontinuous Representationcited by 6
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.