NeeDrop: Self-supervised Shape Representation from Sparse Point Clouds using Needle Dropping
Not on the map. Why?
Abstract (arXiv)
There has been recently a growing interest for implicit shape representations. Contrary to explicit representations, they have no resolution limitations and they easily deal with a wide variety of surface topologies. To learn these implicit representations, current approaches rely on a certain level of shape supervision (e.g., inside/outside information or distance-to-shape knowledge), or at least require a dense point cloud (to approximate well enough the distance-to-shape). In contrast, we introduce NeeDrop, a self-supervised method for learning shape representations from possibly extremely sparse point clouds. Like in Buffon's needle problem, we "drop" (sample) needles on the point cloud and consider that, statistically, close to the surface, the needle end points lie on opposite sides of the surface. No shape knowledge is required and the point cloud can be highly sparse, e.g., as lidar point clouds acquired by vehicles. Previous self-supervised shape representation approaches fail to produce good-quality results on this kind of data. We obtain quantitative results on par with existing supervised approaches on shape reconstruction datasets and show promising qualitative results on hard autonomous driving datasets such as KITTI.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 51 of its 84 references that are in the map. First posted on arXiv 30 Nov 2021.
Builds on
51 of 84 references.
References · 51
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,048
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
38 more
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
- 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 748
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
- 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 588
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 488
- 2016Semantic Scene Completion from a Single Depth Imagecited by 472
- 2016Tutorial on Variational Autoencoderscited by 409
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 390
- 2020Local Implicit Grid Representations for 3D Scenescited by 373
- 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
- 2016OctNet: Learning Deep 3D Representations at High Resolutionscited by 342
- 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 333
- 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 268
- 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
- 2020Learning Gradient Fields for Shape Generationcited by 245
- 2016Volumetric and Multi-View CNNs for Object Classification on 3D Datacited by 240
- 2016Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesiscited by 219
- 2016Adversarially Learned Inferencecited by 216
- 2017Learning a Multi-View Stereo Machinecited by 194
- 2017Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputscited by 189
- 2016Learning Shape Abstractions by Assembling Volumetric Primitivescited by 181
- 2017Multi-view Supervision for Single-view Reconstruction via Differentiable Ray Consistencycited by 177
- 2017Modulating early visual processing by languagecited by 167
- 20183D-CODED : 3D Correspondences by Deep Deformationcited by 160
- 2019NASA: Neural Articulated Shape Approximationcited by 149
- 2017SurfaceNet: An End-to-end 3D Neural Network for Multiview Stereopsiscited by 128
- 2020Complete & Label: A Domain Adaptation Approach to Semantic Segmentation of LiDAR Point Cloudscited by 116
- 2020SALD: Sign Agnostic Learning with Derivativescited by 115
- 2018MeshNet: Mesh Neural Network for 3D Shape Representationcited by 95
- 2017Hierarchical Surface Prediction for 3D Object Reconstructioncited by 89
- 2018Unsupervised Learning of Shape and Pose with Differentiable Point Cloudscited by 89
- 2016Unsupervised Learning of 3D Structure from Imagescited by 67
- 2018Scan2Mesh: From Unstructured Range Scans to 3D Meshescited by 51
- 2019C-Flow: Conditional Generative Flow Models for Images and 3D Point Cloudscited by 50
- 2017OctNetFusion: Learning Depth Fusion from Datacited by 45
- 2014Spatially-sparse convolutional neural networkscited by 33
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2022: 6; 2023: 3; 2024: 4; 2025: 3.
16 papers.
Sort:
By area:
- 2022POCO: Point Convolution for Surface Reconstructioncited by 92
- 2022ALSO: Automotive Lidar Self-supervision by Occupancy estimationcited by 68
- 2022Reconstructing Surfaces for Sparse Point Clouds with On-Surface Priorscited by 60
- 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Setcited by 49
- 2023Towards Better Gradient Consistency for Neural Signed Distance Functions via Level Set Alignmentcited by 39
- 2023Unsupervised Inference of Signed Distance Functions from Single Sparse Point Clouds without Learning Priorscited by 28
- 2024Unsupervised Occupancy Learning from Sparse Point Cloudcited by 15
- 2025LiDPM: Rethinking Point Diffusion for Lidar Scene Completioncited by 10
- 2022What's the Situation with Intelligent Mesh Generation: A Survey and Perspectivescited by 9
- 2022City-scale Incremental Neural Mapping with Three-layer Sampling and Panoptic Representationcited by 7
- 2025Learning Bijective Surface Parameterization for Inferring Signed Distance Functions from Sparse Point Clouds with Grid Deformationcited by 7
- 2022Minimal Neural Atlas: Parameterizing Complex Surfaces with Minimal Charts and Distortioncited by 5
4 more
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversariescited by 5
- 2024Toward Robust Neural Reconstruction from Sparse Point Setscited by 5
- 2025Point2Quad: Generating Quad Meshes from Point Clouds via Face Predictioncited by 5
- 2023A Review of Deep Learning-Powered Mesh Reconstruction Methodscited by 3
- 2025Point2Quad: Generating Quad Meshes from Point Clouds via Face Prediction28 Apr 2025
- 2025LiDPM: Rethinking Point Diffusion for Lidar Scene Completion24 Apr 2025
- 2025Learning Bijective Surface Parameterization for Inferring Signed Distance Functions from Sparse Point Clouds with Grid Deformation31 Mar 2025
- 2024Toward Robust Neural Reconstruction from Sparse Point Sets20 Dec 2024
- 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Set18 Oct 2024
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversaries27 Aug 2024
- 2024Unsupervised Occupancy Learning from Sparse Point Cloud3 Apr 2024
- 2023Towards Better Gradient Consistency for Neural Signed Distance Functions via Level Set Alignment19 May 2023
- 2023Unsupervised Inference of Signed Distance Functions from Single Sparse Point Clouds without Learning Priors25 Mar 2023
- 2023A Review of Deep Learning-Powered Mesh Reconstruction Methods6 Mar 2023
- 2022ALSO: Automotive Lidar Self-supervision by Occupancy estimation12 Dec 2022
- 2022What's the Situation with Intelligent Mesh Generation: A Survey and Perspectives11 Nov 2022
4 more
- 2022City-scale Incremental Neural Mapping with Three-layer Sampling and Panoptic Representation28 Sep 2022
- 2022Minimal Neural Atlas: Parameterizing Complex Surfaces with Minimal Charts and Distortion29 Jul 2022
- 2022Reconstructing Surfaces for Sparse Point Clouds with On-Surface Priors22 Apr 2022
- 2022POCO: Point Convolution for Surface Reconstruction5 Jan 2022
- 2025LiDPM: Rethinking Point Diffusion for Lidar Scene Completioncited by 10
- 2025LiDPM: Rethinking Point Diffusion for Lidar Scene Completion24 Apr 2025
- 2022POCO: Point Convolution for Surface Reconstructioncited by 92
- 2022ALSO: Automotive Lidar Self-supervision by Occupancy estimationcited by 68
- 2022Reconstructing Surfaces for Sparse Point Clouds with On-Surface Priorscited by 60
- 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Setcited by 49
- 2023Towards Better Gradient Consistency for Neural Signed Distance Functions via Level Set Alignmentcited by 39
- 2023Unsupervised Inference of Signed Distance Functions from Single Sparse Point Clouds without Learning Priorscited by 28
- 2024Unsupervised Occupancy Learning from Sparse Point Cloudcited by 15
- 2022What's the Situation with Intelligent Mesh Generation: A Survey and Perspectivescited by 9
- 2022City-scale Incremental Neural Mapping with Three-layer Sampling and Panoptic Representationcited by 7
- 2025Learning Bijective Surface Parameterization for Inferring Signed Distance Functions from Sparse Point Clouds with Grid Deformationcited by 7
- 2022Minimal Neural Atlas: Parameterizing Complex Surfaces with Minimal Charts and Distortioncited by 5
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversariescited by 5
12 most cited of 15 All 15 (JSON)
- 2025Point2Quad: Generating Quad Meshes from Point Clouds via Face Prediction28 Apr 2025
- 2025Learning Bijective Surface Parameterization for Inferring Signed Distance Functions from Sparse Point Clouds with Grid Deformation31 Mar 2025
- 2024Toward Robust Neural Reconstruction from Sparse Point Sets20 Dec 2024
- 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Set18 Oct 2024
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversaries27 Aug 2024
- 2024Unsupervised Occupancy Learning from Sparse Point Cloud3 Apr 2024
- 2023Towards Better Gradient Consistency for Neural Signed Distance Functions via Level Set Alignment19 May 2023
- 2023Unsupervised Inference of Signed Distance Functions from Single Sparse Point Clouds without Learning Priors25 Mar 2023
- 2023A Review of Deep Learning-Powered Mesh Reconstruction Methods6 Mar 2023
- 2022ALSO: Automotive Lidar Self-supervision by Occupancy estimation12 Dec 2022
- 2022What's the Situation with Intelligent Mesh Generation: A Survey and Perspectives11 Nov 2022
- 2022City-scale Incremental Neural Mapping with Three-layer Sampling and Panoptic Representation28 Sep 2022
12 newest of 15 All 15 (JSON)