Learning Implicit Functions for Dense 3D Shape Correspondence of Generic Objects
Not on the map. Why?
Abstract (arXiv)
The objective of this paper is to learn dense 3D shape correspondence for topology-varying generic objects in an unsupervised manner. Conventional implicit functions estimate the occupancy of a 3D point given a shape latent code. Instead, our novel implicit function produces a probabilistic embedding to represent each 3D point in a part embedding space. Assuming the corresponding points are similar in the embedding space, we implement dense correspondence through an inverse function mapping from the part embedding vector to a corresponded 3D point. Both functions are jointly learned with several effective and uncertainty-aware loss functions to realize our assumption, together with the encoder generating the shape latent code. During inference, if a user selects an arbitrary point on the source shape, our algorithm can automatically generate a confidence score indicating whether there is a correspondence on the target shape, as well as the corresponding semantic point if there is one. Such a mechanism inherently benefits man-made objects with different part constitutions. The effectiveness of our approach is demonstrated through unsupervised 3D semantic correspondence and shape segmentation.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 60 of its 96 references that are in the map. First posted on arXiv 29 Dec 2022.
Builds on
60 of 96 references.
References · 60
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2020Convolutional Occupancy Networkscited by 761
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
38 more
- 2018Predictive Uncertainty Estimation via Prior Networkscited by 557
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 2022AdaFace: Quality Adaptive Margin for Face Recognitioncited by 391
- 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
- 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 333
- 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 312
- 2019Learning Shape Templates with Structured Implicit Functionscited by 242
- 2015Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understandingcited by 218
- 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
- 2020On the uncertainty of self-supervised monocular depth estimationcited by 182
- 2016Learning Shape Abstractions by Assembling Volumetric Primitivescited by 181
- 2019Probabilistic Face Embeddingscited by 173
- 20183D-CODED : 3D Correspondences by Deep Deformationcited by 160
- 2017Deep Functional Maps: Structured Prediction for Dense Shape Correspondencecited by 134
- 2020Data Uncertainty Learning in Face Recognitioncited by 134
- 2020Deformed Implicit Field: Modeling 3D Shapes with Learned Dense Correspondencecited by 119
- 2021Learning Accurate Dense Correspondences and When to Trust Themcited by 113
- 2020i3DMM: Deep Implicit 3D Morphable Model of Human Headscited by 109
- 2020LoopReg: Self-supervised Learning of Implicit Surface Correspondences, Pose and Shape for 3D Human Mesh Registrationcited by 108
- 2019Learning to Infer Implicit Surfaces without 3D Supervisioncited by 103
- 2019Learning elementary structures for 3D shape generation and matchingcited by 98
- 2016Learning shape correspondence with anisotropic convolutional neural networkscited by 95
- 2017Hierarchical Surface Prediction for 3D Object Reconstructioncited by 89
- 2019BAE-NET: Branched Autoencoder for Shape Co-Segmentationcited by 89
- 2020LUVLi Face Alignment: Estimating Landmarks' Location, Uncertainty, and Visibility Likelihoodcited by 87
- 2020Deep Implicit Templates for 3D Shape Representationcited by 86
- 2018Unsupervised Deep Learning for Structured Shape Matchingcited by 81
- 2019Controlling Neural Level Setscited by 76
- 2020Learning Unsupervised Hierarchical Part Decomposition of 3D Objects from a Single RGB Imagecited by 72
- 2016SyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentationcited by 70
- 2018Deep Part Induction from Articulated Object Pairscited by 66
- 2020KeypointNet: A Large-scale 3D Keypoint Dataset Aggregated from Numerous Human Annotationscited by 51
- 2021Radar-Camera Pixel Depth Association for Depth Completioncited by 50
- 2018Efficient Uncertainty Estimation for Semantic Segmentation in Videoscited by 46
- 2021Depth Completion with Twin Surface Extrapolation at Occlusion Boundariescited by 41
- 2020Unsupervised Learning of Intrinsic Structural Representation Pointscited by 39
- 2021Digging into Uncertainty in Self-supervised Multi-view Stereocited by 31
- 2020Learning Implicit Functions for Topology-Varying Dense 3D Shape Correspondencecited by 27
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 0; 2026: 1.
2 papers.