Toward Mesh-Invariant 3D Generative Deep Learning with Geometric Measures
Not on the map. Why?
Abstract (arXiv)
3D generative modeling is accelerating as the technology allowing the capture of geometric data is developing. However, the acquired data is often inconsistent, resulting in unregistered meshes or point clouds. Many generative learning algorithms require correspondence between each point when comparing the predicted shape and the target shape. We propose an architecture able to cope with different parameterizations, even during the training phase. In particular, our loss function is built upon a kernel-based metric over a representation of meshes using geometric measures such as currents and varifolds. The latter allows to implement an efficient dissimilarity measure with many desirable properties such as robustness to resampling of the mesh or point cloud. We demonstrate the efficiency and resilience of our model with a generative learning task of human faces.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 36 of its 58 references that are in the map. First posted on arXiv 27 Jun 2023.
Builds on
36 of 58 references.
References · 36
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2020Point Transformercited by 1,470
- 2015Spatial Transformer Networkscited by 1,429
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2018Computational Optimal Transportcited by 780
- 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 436
- 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
- 20193D Morphable Face Models -- Past, Present and Futurecited by 270
- 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 268
24 more
- 2016Volumetric and Multi-View CNNs for Object Classification on 3D Datacited by 240
- 2020DiffusionNet: Discretization Agnostic Learning on Surfacescited by 164
- 20183D-CODED : 3D Correspondences by Deep Deformationcited by 160
- 20163D Shape Induction from 2D Views of Multiple Objectscited by 121
- 2021Density-aware Chamfer Distance as a Comprehensive Metric for Point Cloud Completioncited by 112
- 2020Kernel Operations on the GPU, with Autodiff, without Memory Overflowscited by 104
- 2020Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Renderingcited by 101
- 2020Gauge Equivariant Mesh CNNs: Anisotropic convolutions on geometric graphscited by 92
- 2019Neural 3D Morphable Models: Spiral Convolutional Networks for 3D Shape Representation Learning and Generationcited by 90
- 2018Unsupervised Deep Learning for Structured Shape Matchingcited by 81
- 2020Deep Shells: Unsupervised Shape Correspondence with Optimal Transportcited by 74
- 2020LIMP: Learning Latent Shape Representations with Metric Preservation Priorscited by 55
- 2022Unsupervised Deep Multi-Shape Matchingcited by 39
- 20193D Face Modeling From Diverse Raw Scan Datacited by 25
- 2013The varifold representation of non-oriented shapes for diffeomorphic registrationcited by 24
- 2019Deep Unsupervised Learning of 3D Point Clouds via Graph Topology Inference and Filteringcited by 21
- 2021Sparse to Dense Dynamic 3D Facial Expression Generationcited by 19
- 2022Elastic shape analysis of surfaces with second-order Sobolev metrics: a comprehensive numerical frameworkcited by 19
- 2022Fine Detailed Texture Learning for 3D Meshes with Generative Modelscited by 15
- 2020Shape My Face: Registering 3D Face Scans by Surface-to-Surface Translationcited by 14
- 2021Field Convolutions for Surface CNNscited by 14
- 2021DeltaConv: Anisotropic Operators for Geometric Deep Learning on Point Cloudscited by 10
- 2021Unsupervised Diffeomorphic Surface Registration and Non-Linear Modellingcited by 8
- 20223D Shape Sequence of Human Comparison and Classification using Current and Varifoldscited by 8
Built on by
Citing papers per year: 2023: 2; 2024: 2; 2025: 1; 2026: 1.
6 papers.
- 2024ScanTalk: 3D Talking Heads from Unregistered Scanscited by 24
- 2023Basis restricted elastic shape analysis on the space of unregistered surfacescited by 5
- 2024Beyond Fixed Topologies: Unregistered Training and Comprehensive Evaluation Metrics for 3D Talking Headscited by 5
- 2023VariGrad: A Novel Feature Vector Architecture for Geometric Deep Learning on Unregistered Datacited by 4
- 2025SVarM: Linear Support Varifold Machines for Classification and Regression on Geometric Datacited by 1
- 2026FreeTalk: Emotional Topology-Free 3D Talking Headscited by 0
- 2026FreeTalk: Emotional Topology-Free 3D Talking Heads16 Mar 2026
- 2025SVarM: Linear Support Varifold Machines for Classification and Regression on Geometric Data1 Jun 2025
- 2024Beyond Fixed Topologies: Unregistered Training and Comprehensive Evaluation Metrics for 3D Talking Heads14 Oct 2024
- 2024ScanTalk: 3D Talking Heads from Unregistered Scans16 Mar 2024
- 2023Basis restricted elastic shape analysis on the space of unregistered surfaces7 Nov 2023
- 2023VariGrad: A Novel Feature Vector Architecture for Geometric Deep Learning on Unregistered Data7 Jul 2023