A Deep Signed Directional Distance Function for Object Shape Representation
Not on the map. Why?
Abstract (arXiv)
Neural networks that map 3D coordinates to signed distance function (SDF) or occupancy values have enabled high-fidelity implicit representations of object shape. This paper develops a new shape model that allows synthesizing novel distance views by optimizing a continuous signed directional distance function (SDDF). Similar to deep SDF models, our SDDF formulation can represent whole categories of shapes and complete or interpolate across shapes from partial input data. Unlike an SDF, which measures distance to the nearest surface in any direction, an SDDF measures distance in a given direction. This allows training an SDDF model without 3D shape supervision, using only distance measurements, readily available from depth camera or Lidar sensors. Our model also removes post-processing steps like surface extraction or rendering by directly predicting distance at arbitrary locations and viewing directions. Unlike deep view-synthesis techniques, such as Neural Radiance Fields, which train high-capacity black-box models, our model encodes by construction the property that SDDF values decrease linearly along the viewing direction. This structure constraint not only results in dimensionality reduction but also provides analytical confidence about the accuracy of SDDF predictions, regardless of the distance to the object surface.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 46 of its 69 references that are in the map. First posted on arXiv 23 Jul 2021.
Builds on
46 of 69 references.
References · 46
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
34 more
- 2018Open3D: A Modern Library for 3D Data Processingcited by 721
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
- 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
- 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 588
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 488
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2018PCN: Point Completion Networkcited by 384
- 2020Local Implicit Grid Representations for 3D Scenescited by 373
- 2016OctNet: Learning Deep 3D Representations at High Resolutionscited by 342
- 20163DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructionscited by 336
- 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 333
- 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
- 2017Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputscited by 189
- 2016Learning Shape Abstractions by Assembling Volumetric Primitivescited by 181
- 2020GRNet: Gridding Residual Network for Dense Point Cloud Completioncited by 174
- 20193D Point Cloud Generative Adversarial Network Based on Tree Structured Graph Convolutionscited by 173
- 2019PU-GAN: a Point Cloud Upsampling Adversarial Networkcited by 164
- 2019Morphing and Sampling Network for Dense Point Cloud Completioncited by 132
- 2019Superquadrics Revisited: Learning 3D Shape Parsing beyond Cuboidscited by 124
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 114
- 2018Deep Geometric Prior for Surface Reconstructioncited by 110
- 2018CubeSLAM: Monocular 3D Object SLAMcited by 102
- 2018QuadricSLAM: Dual Quadrics from Object Detections as Landmarks in Object-oriented SLAMcited by 86
- 2020DualSDF: Semantic Shape Manipulation using a Two-Level Representationcited by 82
- 2017Variational Autoencoders for Deforming 3D Mesh Modelscited by 70
- 2020SDF-SRN: Learning Signed Distance 3D Object Reconstruction from Static Imagescited by 68
- 2017OctNetFusion: Learning Depth Fusion from Datacited by 45
- 2017SurfNet: Generating 3D shape surfaces using deep residual networkscited by 32
- 2019FIESTA: Fast Incremental Euclidean Distance Fields for Online Motion Planning of Aerial Robotscited by 31
- 2017Sparse Data Driven Mesh Deformationcited by 21
Built on by
Citing papers per year: 2021: 2; 2022: 4; 2023: 3; 2024: 1.
10 papers.
- 2021Neural Fields in Visual Computing and Beyondcited by 540
- 2021Representing 3D Shapes with Probabilistic Directed Distance Fieldscited by 21
- 2023The Sky's the Limit: Re-lightable Outdoor Scenes via a Sky-pixel Constrained Illumination Prior and Outside-In Visibilitycited by 11
- 2022Neural Vector Fields for Implicit Surface Representation and Inferencecited by 10
- 2022FIRe: Fast Inverse Rendering using Directional and Signed Distance Functionscited by 9
- 2022Multi-View Reconstruction using Signed Ray Distance Functions (SRDF)cited by 9
- 20223D Neural Sculpting (3DNS): Editing Neural Signed Distance Functionscited by 4
- 2023TransPoser: Transformer as an Optimizer for Joint Object Shape and Pose Estimationcited by 2
- 2023Neural directional distance field object representation for uni-directional path-traced renderingcited by 2
- 2024Probabilistic Directed Distance Fields for Ray-Based Shape Representationscited by 0
- 2024Probabilistic Directed Distance Fields for Ray-Based Shape Representations13 Apr 2024
- 2023The Sky's the Limit: Re-lightable Outdoor Scenes via a Sky-pixel Constrained Illumination Prior and Outside-In Visibility28 Nov 2023
- 2023Neural directional distance field object representation for uni-directional path-traced rendering28 Jun 2023
- 2023TransPoser: Transformer as an Optimizer for Joint Object Shape and Pose Estimation23 Mar 2023
- 20223D Neural Sculpting (3DNS): Editing Neural Signed Distance Functions28 Sep 2022
- 2022Multi-View Reconstruction using Signed Ray Distance Functions (SRDF)31 Aug 2022
- 2022Neural Vector Fields for Implicit Surface Representation and Inference13 Apr 2022
- 2022FIRe: Fast Inverse Rendering using Directional and Signed Distance Functions30 Mar 2022
- 2021Representing 3D Shapes with Probabilistic Directed Distance Fields10 Dec 2021
- 2021Neural Fields in Visual Computing and Beyond22 Nov 2021