mlsanityData to 14 Oct 2026

GridPull: Towards Scalability in Learning Implicit Representations from 3D Point Clouds

arXiv 2308.13175 ↗First posted 25 Aug 2023cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

Learning implicit representations has been a widely used solution for surface reconstruction from 3D point clouds. The latest methods infer a distance or occupancy field by overfitting a neural network on a single point cloud. However, these methods suffer from a slow inference due to the slow convergence of neural networks and the extensive calculation of distances to surface points, which limits them to small scale points. To resolve the scalability issue in surface reconstruction, we propose GridPull to improve the efficiency of learning implicit representations from large scale point clouds. Our novelty lies in the fast inference of a discrete distance field defined on grids without using any neural components. To remedy the lack of continuousness brought by neural networks, we introduce a loss function to encourage continuous distances and consistent gradients in the field during pulling queries onto the surface in grids near to the surface. We use uniform grids for a fast grid search to localize sampled queries, and organize surface points in a tree structure to speed up the calculation of distances to the surface. We do not rely on learning priors or normal supervision during optimization, and achieve superiority over the latest methods in terms of complexity and accuracy. We evaluate our method on shape and scene benchmarks, and report numerical and visual comparisons with the latest methods to justify our effectiveness and superiority. The code is available at https://github.com/chenchao15/GridPull.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 86 of its 108 references that are in the map. First posted on arXiv 25 Aug 2023.

Builds on

86 of 108 references.

References · 86

  1. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  2. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  3. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  4. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  5. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  6. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  7. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  8. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  9. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  10. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  11. 2021Volume Rendering of Neural Implicit Surfacescited by 996
  12. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
38 more
  1. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
  2. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  3. 2020Convolutional Occupancy Networkscited by 761
  4. 2020Implicit Geometric Regularization for Learning Shapescited by 710
  5. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
  6. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
  7. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  8. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
  9. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
  10. 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
  11. 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 390
  12. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
  13. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
  14. 2020Local Implicit Grid Representations for 3D Scenescited by 373
  15. 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
  16. 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
  17. 2019Learning Shape Templates with Structured Implicit Functionscited by 242
  18. 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 212
  19. 2021Shape As Points: A Differentiable Poisson Solvercited by 187
  20. 2016Thingi10K: A Dataset of 10,000 3D-Printing Modelscited by 183
  21. 2019DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracingcited by 180
  22. 2021SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformercited by 164
  23. 2019SDFDiff: Differentiable Rendering of Signed Distance Fields for 3D Shape Optimizationcited by 159
  24. 2020Neural-Pull: Learning Signed Distance Functions from Point Clouds by Learning to Pull Space onto Surfacescited by 147
  25. 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
  26. 2020Points2Surf: Learning Implicit Surfaces from Point Cloud Patchescited by 122
  27. 2022HF-NeuS: Improved Surface Reconstruction Using High-Frequency Detailscited by 121
  28. 2020SALD: Sign Agnostic Learning with Derivativescited by 115
  29. 2018Deep Geometric Prior for Surface Reconstructioncited by 110
  30. 2019Learning to Infer Implicit Surfaces without 3D Supervisioncited by 103
  31. 2021ShaRF: Shape-conditioned Radiance Fields from a Single Viewcited by 92
  32. 2022POCO: Point Convolution for Surface Reconstructioncited by 92
  33. 2020PatchNets: Patch-Based Generalizable Deep Implicit 3D Shape Representationscited by 81
  34. 2021DiGS : Divergence guided shape implicit neural representation for unoriented point cloudscited by 77
  35. 2019Autolabeling 3D Objects with Differentiable Rendering of SDF Shape Priorscited by 74
  36. 2022PermutoSDF: Fast Multi-View Reconstruction with Implicit Surfaces using Permutohedral Latticescited by 73
  37. 2022Dual Octree Graph Networks for Learning Adaptive Volumetric Shape Representationscited by 71
  38. 2020SDF-SRN: Learning Signed Distance 3D Object Reconstruction from Static Imagescited by 68

50 most cited of 86 All 86 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 9; 2025: 0; 2026: 1.

11 papers.