Unsupervised Occupancy Learning from Sparse Point Cloud
Not on the map. Why?
Abstract (arXiv)
Implicit Neural Representations have gained prominence as a powerful framework for capturing complex data modalities, encompassing a wide range from 3D shapes to images and audio. Within the realm of 3D shape representation, Neural Signed Distance Functions (SDF) have demonstrated remarkable potential in faithfully encoding intricate shape geometry. However, learning SDFs from 3D point clouds in the absence of ground truth supervision remains a very challenging task. In this paper, we propose a method to infer occupancy fields instead of SDFs as they are easier to learn from sparse inputs. We leverage a margin-based uncertainty measure to differentially sample from the decision boundary of the occupancy function and supervise the sampled boundary points using the input point cloud. We further stabilize the optimization process at the early stages of the training by biasing the occupancy function towards minimal entropy fields while maximizing its entropy at the input point cloud. Through extensive experiments and evaluations, we illustrate the efficacy of our proposed method, highlighting its capacity to improve implicit shape inference with respect to baselines and the state-of-the-art using synthetic and real data.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 70 of its 97 references that are in the map. First posted on arXiv 3 Apr 2024.
Builds on
70 of 97 references.
References · 70
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
38 more
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2020Convolutional Occupancy Networkscited by 760
- 2020Implicit Geometric Regularization for Learning Shapescited by 707
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2017Neural 3D Mesh Renderercited by 437
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 389
- 2020Local Implicit Grid Representations for 3D Scenescited by 372
- 2016OctNet: Learning Deep 3D Representations at High Resolutionscited by 340
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
- 2019Neural Point-Based Graphicscited by 326
- 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
- 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
- 2019Learning Shape Templates with Structured Implicit Functionscited by 242
- 2020MetaSDF: Meta-learning Signed Distance Functionscited by 214
- 2019BSP-Net: Generating Compact Meshes via Binary Space Partitioningcited by 205
- 2017Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputscited by 189
- 2021Shape As Points: A Differentiable Poisson Solvercited by 186
- 2016Learning Shape Abstractions by Assembling Volumetric Primitivescited by 181
- 2019CvxNet: Learnable Convex Decompositioncited by 173
- 2020Neural-Pull: Learning Signed Distance Functions from Point Clouds by Learning to Pull Space onto Surfacescited by 146
- 2020Points2Surf: Learning Implicit Surfaces from Point Cloud Patchescited by 122
- 2020SALD: Sign Agnostic Learning with Derivativescited by 115
- 2018Deep Geometric Prior for Surface Reconstructioncited by 110
- 2023Neural Kernel Surface Reconstructioncited by 102
- 2019Learning elementary structures for 3D shape generation and matchingcited by 98
- 2022POCO: Point Convolution for Surface Reconstructioncited by 91
- 2022Learning Smooth Neural Functions via Lipschitz Regularizationcited by 86
- 2020PatchNets: Patch-Based Generalizable Deep Implicit 3D Shape Representationscited by 81
- 2022Transformers as Meta-Learners for Implicit Neural Representationscited by 79
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
- 20173D-PRNN: Generating Shape Primitives with Recurrent Neural Networkscited by 77
- 2018PlaneNet: Piece-wise Planar Reconstruction from a Single RGB Imagecited by 77
- 2021DiGS : Divergence guided shape implicit neural representation for unoriented point cloudscited by 76
- 2021Deep Implicit Moving Least-Squares Functions for 3D Reconstructioncited by 67
50 most cited of 70 All 70 (JSON)
Built on by
Citing papers per year: 2024: 6; 2025: 9.
15 papers.
Sort:
- 2024SparseCraft: Few-Shot Neural Reconstruction through Stereopsis Guided Geometric Linearizationcited by 19
- 2024A Lightweight UDF Learning Framework for 3D Reconstruction Based on Local Shape Functionscited by 7
- 2024Inferring Neural Signed Distance Functions by Overfitting on Single Noisy Point Clouds through Finetuning Data-Driven based Priorscited by 7
- 2025Learning Bijective Surface Parameterization for Inferring Signed Distance Functions from Sparse Point Clouds with Grid Deformationcited by 7
- 2025SparSplat: Fast Multi-View Reconstruction with Generalizable 2D Gaussian Splattingcited by 7
- 2025Sparfels: Fast Reconstruction from Sparse Unposed Imagerycited by 7
- 2025Anti-Aliased 2D Gaussian Splattingcited by 7
- 2024GeoTransfer : Generalizable Few-Shot Multi-View Reconstruction via Transfer Learningcited by 5
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversariescited by 5
- 2024Toward Robust Neural Reconstruction from Sparse Point Setscited by 5
- 2025NoKSR: Kernel-Free Neural Surface Reconstruction via Point Cloud Serializationcited by 3
- 2025TextureSplat: Per-Primitive Texture Mapping for Reflective Gaussian Splattingcited by 3
- 2025RibPull: Implicit Occupancy Fields and Medial Axis Extraction for CT Ribcage Scans1 Sep 2025
- 2025TextureSplat: Per-Primitive Texture Mapping for Reflective Gaussian Splatting16 Jun 2025
- 2025Anti-Aliased 2D Gaussian Splatting12 Jun 2025
- 2025MIND: Material Interface Generation from UDFs for Non-Manifold Surface Reconstruction3 Jun 2025
- 2025Sparfels: Fast Reconstruction from Sparse Unposed Imagery4 May 2025
- 2025SparSplat: Fast Multi-View Reconstruction with Generalizable 2D Gaussian Splatting4 May 2025
- 2025Learning Bijective Surface Parameterization for Inferring Signed Distance Functions from Sparse Point Clouds with Grid Deformation31 Mar 2025
- 2025OffsetOPT: Explicit Surface Reconstruction without Normals20 Mar 2025
- 2025NoKSR: Kernel-Free Neural Surface Reconstruction via Point Cloud Serialization18 Feb 2025
- 2024Toward Robust Neural Reconstruction from Sparse Point Sets20 Dec 2024
- 2024Inferring Neural Signed Distance Functions by Overfitting on Single Noisy Point Clouds through Finetuning Data-Driven based Priors25 Oct 2024
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversaries27 Aug 2024
3 more
- 2024GeoTransfer : Generalizable Few-Shot Multi-View Reconstruction via Transfer Learning27 Aug 2024
- 2024SparseCraft: Few-Shot Neural Reconstruction through Stereopsis Guided Geometric Linearization19 Jul 2024
- 2024A Lightweight UDF Learning Framework for 3D Reconstruction Based on Local Shape Functions1 Jul 2024
- 2024SparseCraft: Few-Shot Neural Reconstruction through Stereopsis Guided Geometric Linearizationcited by 19
- 2024A Lightweight UDF Learning Framework for 3D Reconstruction Based on Local Shape Functionscited by 7
- 2024Inferring Neural Signed Distance Functions by Overfitting on Single Noisy Point Clouds through Finetuning Data-Driven based Priorscited by 7
- 2025Learning Bijective Surface Parameterization for Inferring Signed Distance Functions from Sparse Point Clouds with Grid Deformationcited by 7
- 2025SparSplat: Fast Multi-View Reconstruction with Generalizable 2D Gaussian Splattingcited by 7
- 2025Sparfels: Fast Reconstruction from Sparse Unposed Imagerycited by 7
- 2025Anti-Aliased 2D Gaussian Splattingcited by 7
- 2024GeoTransfer : Generalizable Few-Shot Multi-View Reconstruction via Transfer Learningcited by 5
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversariescited by 5
- 2024Toward Robust Neural Reconstruction from Sparse Point Setscited by 5
- 2025NoKSR: Kernel-Free Neural Surface Reconstruction via Point Cloud Serializationcited by 3
- 2025TextureSplat: Per-Primitive Texture Mapping for Reflective Gaussian Splattingcited by 3
12 most cited of 15 All 15 (JSON)
- 2025RibPull: Implicit Occupancy Fields and Medial Axis Extraction for CT Ribcage Scans1 Sep 2025
- 2025TextureSplat: Per-Primitive Texture Mapping for Reflective Gaussian Splatting16 Jun 2025
- 2025Anti-Aliased 2D Gaussian Splatting12 Jun 2025
- 2025MIND: Material Interface Generation from UDFs for Non-Manifold Surface Reconstruction3 Jun 2025
- 2025Sparfels: Fast Reconstruction from Sparse Unposed Imagery4 May 2025
- 2025SparSplat: Fast Multi-View Reconstruction with Generalizable 2D Gaussian Splatting4 May 2025
- 2025Learning Bijective Surface Parameterization for Inferring Signed Distance Functions from Sparse Point Clouds with Grid Deformation31 Mar 2025
- 2025OffsetOPT: Explicit Surface Reconstruction without Normals20 Mar 2025
- 2025NoKSR: Kernel-Free Neural Surface Reconstruction via Point Cloud Serialization18 Feb 2025
- 2024Toward Robust Neural Reconstruction from Sparse Point Sets20 Dec 2024
- 2024Inferring Neural Signed Distance Functions by Overfitting on Single Noisy Point Clouds through Finetuning Data-Driven based Priors25 Oct 2024
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversaries27 Aug 2024
12 newest of 15 All 15 (JSON)