mlsanityData to 7 Oct 2026

Unsupervised Occupancy Learning from Sparse Point Cloud

arXiv 2404.02759 ↗First posted 3 Apr 2024cs.CV cs.AI cs.GRcited by 15

Not on the map. Why?

Abstract (arXiv)

Implicit Neural Representations have gained prominence as a powerful framework for capturing complex data modalities, encompassing a wide range from 3D shapes to images and audio. Within the realm of 3D shape representation, Neural Signed Distance Functions (SDF) have demonstrated remarkable potential in faithfully encoding intricate shape geometry. However, learning SDFs from 3D point clouds in the absence of ground truth supervision remains a very challenging task. In this paper, we propose a method to infer occupancy fields instead of SDFs as they are easier to learn from sparse inputs. We leverage a margin-based uncertainty measure to differentially sample from the decision boundary of the occupancy function and supervise the sampled boundary points using the input point cloud. We further stabilize the optimization process at the early stages of the training by biasing the occupancy function towards minimal entropy fields while maximizing its entropy at the input point cloud. Through extensive experiments and evaluations, we illustrate the efficacy of our proposed method, highlighting its capacity to improve implicit shape inference with respect to baselines and the state-of-the-art using synthetic and real data.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 70 of its 97 references that are in the map. First posted on arXiv 3 Apr 2024.

Builds on

70 of 97 references.

References · 70

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  4. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  5. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  6. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  7. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  8. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  9. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  10. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  11. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  12. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
38 more
  1. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  2. 2020Convolutional Occupancy Networkscited by 760
  3. 2020Implicit Geometric Regularization for Learning Shapescited by 707
  4. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
  5. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  6. 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
  7. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  8. 2017Neural 3D Mesh Renderercited by 437
  9. 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
  10. 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 389
  11. 2020Local Implicit Grid Representations for 3D Scenescited by 372
  12. 2016OctNet: Learning Deep 3D Representations at High Resolutionscited by 340
  13. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
  14. 2019Neural Point-Based Graphicscited by 326
  15. 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
  16. 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
  17. 2019Learning Shape Templates with Structured Implicit Functionscited by 242
  18. 2020MetaSDF: Meta-learning Signed Distance Functionscited by 214
  19. 2019BSP-Net: Generating Compact Meshes via Binary Space Partitioningcited by 205
  20. 2017Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputscited by 189
  21. 2021Shape As Points: A Differentiable Poisson Solvercited by 186
  22. 2016Learning Shape Abstractions by Assembling Volumetric Primitivescited by 181
  23. 2019CvxNet: Learnable Convex Decompositioncited by 173
  24. 2020Neural-Pull: Learning Signed Distance Functions from Point Clouds by Learning to Pull Space onto Surfacescited by 146
  25. 2020Points2Surf: Learning Implicit Surfaces from Point Cloud Patchescited by 122
  26. 2020SALD: Sign Agnostic Learning with Derivativescited by 115
  27. 2018Deep Geometric Prior for Surface Reconstructioncited by 110
  28. 2023Neural Kernel Surface Reconstructioncited by 102
  29. 2019Learning elementary structures for 3D shape generation and matchingcited by 98
  30. 2022POCO: Point Convolution for Surface Reconstructioncited by 91
  31. 2022Learning Smooth Neural Functions via Lipschitz Regularizationcited by 86
  32. 2020PatchNets: Patch-Based Generalizable Deep Implicit 3D Shape Representationscited by 81
  33. 2022Transformers as Meta-Learners for Implicit Neural Representationscited by 79
  34. 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
  35. 20173D-PRNN: Generating Shape Primitives with Recurrent Neural Networkscited by 77
  36. 2018PlaneNet: Piece-wise Planar Reconstruction from a Single RGB Imagecited by 77
  37. 2021DiGS : Divergence guided shape implicit neural representation for unoriented point cloudscited by 76
  38. 2021Deep Implicit Moving Least-Squares Functions for 3D Reconstructioncited by 67

50 most cited of 70 All 70 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 6; 2025: 9.

15 papers.

Sort: