Learning Implicit Functions for Topology-Varying Dense 3D Shape Correspondence
Not on the map. Why?
Abstract (arXiv)
The goal of this paper is to learn dense 3D shape correspondence for topology-varying objects in an unsupervised manner. Conventional implicit functions estimate the occupancy of a 3D point given a shape latent code. Instead, our novel implicit function produces a part embedding vector for each 3D point, which is assumed to be similar to its densely corresponded point in another 3D shape of the same object category. Furthermore, we implement dense correspondence through an inverse function mapping from the part embedding to a corresponded 3D point. Both functions are jointly learned with several effective loss functions to realize our assumption, together with the encoder generating the shape latent code. During inference, if a user selects an arbitrary point on the source shape, our algorithm can automatically generate a confidence score indicating whether there is a correspondence on the target shape, as well as the corresponding semantic point if there is one. Such a mechanism inherently benefits man-made objects with different part constitutions. The effectiveness of our approach is demonstrated through unsupervised 3D semantic correspondence and shape segmentation.
Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 5; 2023: 15; 2024: 2.
27 papers.
Sort:
By area:
- 2022ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 64
- 2023FeatureNeRF: Learning Generalizable NeRFs by Distilling Foundation Modelscited by 47
- 2021Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Cloudscited by 44
- 2022AUV-Net: Learning Aligned UV Maps for Texture Transfer and Synthesiscited by 39
- 2022Topology-Preserving Shape Reconstruction and Registration via Neural Diffeomorphic Flowcited by 38
- 2023Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generationcited by 38
- 2023Instant Multi-View Head Capture through Learnable Registrationcited by 34
- 2021Learning 3D Dense Correspondence via Canonical Point Autoencodercited by 21
- 2021Voxel-based 3D Detection and Reconstruction of Multiple Objects from a Single Imagecited by 20
- 2023NCP: Neural Correspondence Prior for Effective Unsupervised Shape Matchingcited by 18
- 2023EFEM: Equivariant Neural Field Expectation Maximization for 3D Object Segmentation Without Scene Supervisioncited by 18
- 2023Back to 3D: Few-Shot 3D Keypoint Detection with Back-Projected 2D Featurescited by 17
15 more
- 2021Fully Understanding Generic Objects: Modeling, Segmentation, and Reconstructioncited by 16
- 2023Point2SSM: Learning Morphological Variations of Anatomies from Point Cloudcited by 14
- 2023Zero-shot Pose Transfer for Unrigged Stylized 3D Characterscited by 13
- 2023GenCorres: Consistent Shape Matching via Coupled Implicit-Explicit Shape Generative Modelscited by 11
- 2023ImFace++: A Sophisticated Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 10
- 2022Correspondence Distillation from NeRF-based GANcited by 8
- 2023Deep Deformable Models: Learning 3D Shape Abstractions with Part Consistencycited by 5
- 2021Adjoint Rigid Transform Network: Task-conditioned Alignment of 3D Shapescited by 4
- 2023TEGLO: High Fidelity Canonical Texture Mapping from Single-View Imagescited by 4
- 2024Learning SO(3)-Invariant Semantic Correspondence via Local Shape Transformcited by 3
- 2022Learning Implicit Functions for Dense 3D Shape Correspondence of Generic Objectscited by 2
- 2023Laplacian ICP for Progressive Registration of 3D Human Head Meshescited by 2
- 20233D Semantic Subspace Traverser: Empowering 3D Generative Model with Shape Editing Capabilitycited by 1
- 2023Trustworthy Representation Learning Across Domainscited by 1
- 2024Mitigating Prior Shape Bias in Point Clouds via Differentiable Center Learningcited by 1
- 2024Learning SO(3)-Invariant Semantic Correspondence via Local Shape Transform17 Apr 2024
- 2024Mitigating Prior Shape Bias in Point Clouds via Differentiable Center Learning3 Feb 2024
- 2023Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation12 Dec 2023
- 2023ImFace++: A Sophisticated Nonlinear 3D Morphable Face Model with Implicit Neural Representations7 Dec 2023
- 2023Back to 3D: Few-Shot 3D Keypoint Detection with Back-Projected 2D Features29 Nov 2023
- 2023Deep Deformable Models: Learning 3D Shape Abstractions with Part Consistency2 Sep 2023
- 2023Trustworthy Representation Learning Across Domains23 Aug 2023
- 20233D Semantic Subspace Traverser: Empowering 3D Generative Model with Shape Editing Capability26 Jul 2023
- 2023Instant Multi-View Head Capture through Learnable Registration12 Jun 2023
- 2023Zero-shot Pose Transfer for Unrigged Stylized 3D Characters31 May 2023
- 2023Point2SSM: Learning Morphological Variations of Anatomies from Point Cloud23 May 2023
- 2023GenCorres: Consistent Shape Matching via Coupled Implicit-Explicit Shape Generative Models20 Apr 2023
15 more
- 2023EFEM: Equivariant Neural Field Expectation Maximization for 3D Object Segmentation Without Scene Supervision27 Mar 2023
- 2023TEGLO: High Fidelity Canonical Texture Mapping from Single-View Images24 Mar 2023
- 2023FeatureNeRF: Learning Generalizable NeRFs by Distilling Foundation Models22 Mar 2023
- 2023Laplacian ICP for Progressive Registration of 3D Human Head Meshes4 Feb 2023
- 2023NCP: Neural Correspondence Prior for Effective Unsupervised Shape Matching14 Jan 2023
- 2022Learning Implicit Functions for Dense 3D Shape Correspondence of Generic Objects29 Dec 2022
- 2022Correspondence Distillation from NeRF-based GAN19 Dec 2022
- 2022AUV-Net: Learning Aligned UV Maps for Texture Transfer and Synthesis6 Apr 2022
- 2022ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representations28 Mar 2022
- 2022Topology-Preserving Shape Reconstruction and Registration via Neural Diffeomorphic Flow16 Mar 2022
- 2021Voxel-based 3D Detection and Reconstruction of Multiple Objects from a Single Image4 Nov 2021
- 2021Learning 3D Dense Correspondence via Canonical Point Autoencoder10 Jul 2021
- 2021Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Clouds7 Jun 2021
- 2021Fully Understanding Generic Objects: Modeling, Segmentation, and Reconstruction2 Apr 2021
- 2021Adjoint Rigid Transform Network: Task-conditioned Alignment of 3D Shapes1 Feb 2021
- 2022ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 64
- 2023FeatureNeRF: Learning Generalizable NeRFs by Distilling Foundation Modelscited by 47
- 2021Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Cloudscited by 44
- 2022AUV-Net: Learning Aligned UV Maps for Texture Transfer and Synthesiscited by 39
- 2022Topology-Preserving Shape Reconstruction and Registration via Neural Diffeomorphic Flowcited by 38
- 2023Instant Multi-View Head Capture through Learnable Registrationcited by 34
- 2021Learning 3D Dense Correspondence via Canonical Point Autoencodercited by 21
- 2021Voxel-based 3D Detection and Reconstruction of Multiple Objects from a Single Imagecited by 20
- 2023NCP: Neural Correspondence Prior for Effective Unsupervised Shape Matchingcited by 18
- 2023EFEM: Equivariant Neural Field Expectation Maximization for 3D Object Segmentation Without Scene Supervisioncited by 18
- 2023Back to 3D: Few-Shot 3D Keypoint Detection with Back-Projected 2D Featurescited by 17
- 2021Fully Understanding Generic Objects: Modeling, Segmentation, and Reconstructioncited by 16
12 most cited of 26 All 26 (JSON)
- 2024Learning SO(3)-Invariant Semantic Correspondence via Local Shape Transform17 Apr 2024
- 2024Mitigating Prior Shape Bias in Point Clouds via Differentiable Center Learning3 Feb 2024
- 2023ImFace++: A Sophisticated Nonlinear 3D Morphable Face Model with Implicit Neural Representations7 Dec 2023
- 2023Back to 3D: Few-Shot 3D Keypoint Detection with Back-Projected 2D Features29 Nov 2023
- 2023Deep Deformable Models: Learning 3D Shape Abstractions with Part Consistency2 Sep 2023
- 2023Trustworthy Representation Learning Across Domains23 Aug 2023
- 20233D Semantic Subspace Traverser: Empowering 3D Generative Model with Shape Editing Capability26 Jul 2023
- 2023Instant Multi-View Head Capture through Learnable Registration12 Jun 2023
- 2023Zero-shot Pose Transfer for Unrigged Stylized 3D Characters31 May 2023
- 2023Point2SSM: Learning Morphological Variations of Anatomies from Point Cloud23 May 2023
- 2023GenCorres: Consistent Shape Matching via Coupled Implicit-Explicit Shape Generative Models20 Apr 2023
- 2023EFEM: Equivariant Neural Field Expectation Maximization for 3D Object Segmentation Without Scene Supervision27 Mar 2023
12 newest of 26 All 26 (JSON)