GridPull: Towards Scalability in Learning Implicit Representations from 3D Point Clouds
Not on the map. Why?
Abstract (arXiv)
Learning implicit representations has been a widely used solution for surface reconstruction from 3D point clouds. The latest methods infer a distance or occupancy field by overfitting a neural network on a single point cloud. However, these methods suffer from a slow inference due to the slow convergence of neural networks and the extensive calculation of distances to surface points, which limits them to small scale points. To resolve the scalability issue in surface reconstruction, we propose GridPull to improve the efficiency of learning implicit representations from large scale point clouds. Our novelty lies in the fast inference of a discrete distance field defined on grids without using any neural components. To remedy the lack of continuousness brought by neural networks, we introduce a loss function to encourage continuous distances and consistent gradients in the field during pulling queries onto the surface in grids near to the surface. We use uniform grids for a fast grid search to localize sampled queries, and organize surface points in a tree structure to speed up the calculation of distances to the surface. We do not rely on learning priors or normal supervision during optimization, and achieve superiority over the latest methods in terms of complexity and accuracy. We evaluate our method on shape and scene benchmarks, and report numerical and visual comparisons with the latest methods to justify our effectiveness and superiority. The code is available at https://github.com/chenchao15/GridPull.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 86 of its 108 references that are in the map. First posted on arXiv 25 Aug 2023.
Builds on
86 of 108 references.
References · 86
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
38 more
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2020Convolutional Occupancy Networkscited by 761
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 390
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
- 2020Local Implicit Grid Representations for 3D Scenescited by 373
- 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
- 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
- 2019Learning Shape Templates with Structured Implicit Functionscited by 242
- 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 212
- 2021Shape As Points: A Differentiable Poisson Solvercited by 187
- 2016Thingi10K: A Dataset of 10,000 3D-Printing Modelscited by 183
- 2019DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracingcited by 180
- 2021SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformercited by 164
- 2019SDFDiff: Differentiable Rendering of Signed Distance Fields for 3D Shape Optimizationcited by 159
- 2020Neural-Pull: Learning Signed Distance Functions from Point Clouds by Learning to Pull Space onto Surfacescited by 147
- 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
- 2020Points2Surf: Learning Implicit Surfaces from Point Cloud Patchescited by 122
- 2022HF-NeuS: Improved Surface Reconstruction Using High-Frequency Detailscited by 121
- 2020SALD: Sign Agnostic Learning with Derivativescited by 115
- 2018Deep Geometric Prior for Surface Reconstructioncited by 110
- 2019Learning to Infer Implicit Surfaces without 3D Supervisioncited by 103
- 2021ShaRF: Shape-conditioned Radiance Fields from a Single Viewcited by 92
- 2022POCO: Point Convolution for Surface Reconstructioncited by 92
- 2020PatchNets: Patch-Based Generalizable Deep Implicit 3D Shape Representationscited by 81
- 2021DiGS : Divergence guided shape implicit neural representation for unoriented point cloudscited by 77
- 2019Autolabeling 3D Objects with Differentiable Rendering of SDF Shape Priorscited by 74
- 2022PermutoSDF: Fast Multi-View Reconstruction with Implicit Surfaces using Permutohedral Latticescited by 73
- 2022Dual Octree Graph Networks for Learning Adaptive Volumetric Shape Representationscited by 71
- 2020SDF-SRN: Learning Signed Distance 3D Object Reconstruction from Static Imagescited by 68
50 most cited of 86 All 86 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 9; 2025: 0; 2026: 1.
11 papers.
- 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Setcited by 49
- 2024VRP-UDF: Towards Unbiased Learning of Unsigned Distance Functions from Multi-view Images with Volume Rendering Priorscited by 17
- 2024Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mappingcited by 15
- 2023Learning Neural Implicit through Volume Rendering with Attentive Depth Fusion Priorscited by 11
- 2024MultiPull: Detailing Signed Distance Functions by Pulling Multi-Level Queries at Multi-Stepcited by 11
- 2024Implicit Filtering for Learning Neural Signed Distance Functions from 3D Point Cloudscited by 7
- 2024Inferring Neural Signed Distance Functions by Overfitting on Single Noisy Point Clouds through Finetuning Data-Driven based Priorscited by 7
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversariescited by 5
- 2024Learning Local Pattern Modularization for Point Cloud Reconstruction from Unseen Classescited by 3
- 2024NumGrad-Pull: Numerical Gradient Guided Tri-plane Representation for Surface Reconstruction from Point Cloudscited by 2
- 2026Joint Orientation and Weight Optimization for Robust Watertight Surface Reconstruction via Dirichlet-Regularized Winding Fieldscited by 0
- 2026Joint Orientation and Weight Optimization for Robust Watertight Surface Reconstruction via Dirichlet-Regularized Winding Fields14 Feb 2026
- 2024NumGrad-Pull: Numerical Gradient Guided Tri-plane Representation for Surface Reconstruction from Point Clouds26 Nov 2024
- 2024MultiPull: Detailing Signed Distance Functions by Pulling Multi-Level Queries at Multi-Step2 Nov 2024
- 2024Inferring Neural Signed Distance Functions by Overfitting on Single Noisy Point Clouds through Finetuning Data-Driven based Priors25 Oct 2024
- 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Set18 Oct 2024
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversaries27 Aug 2024
- 2024Learning Local Pattern Modularization for Point Cloud Reconstruction from Unseen Classes26 Aug 2024
- 2024VRP-UDF: Towards Unbiased Learning of Unsigned Distance Functions from Multi-view Images with Volume Rendering Priors23 Jul 2024
- 2024Implicit Filtering for Learning Neural Signed Distance Functions from 3D Point Clouds18 Jul 2024
- 2024Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mapping4 Jul 2024
- 2023Learning Neural Implicit through Volume Rendering with Attentive Depth Fusion Priors17 Oct 2023