Deformable Shape Completion with Graph Convolutional Autoencoders
Not on the map. Why?
Abstract (arXiv)
The availability of affordable and portable depth sensors has made scanning objects and people simpler than ever. However, dealing with occlusions and missing parts is still a significant challenge. The problem of reconstructing a (possibly non-rigidly moving) 3D object from a single or multiple partial scans has received increasing attention in recent years. In this work, we propose a novel learning-based method for the completion of partial shapes. Unlike the majority of existing approaches, our method focuses on objects that can undergo non-rigid deformations. The core of our method is a variational autoencoder with graph convolutional operations that learns a latent space for complete realistic shapes. At inference, we optimize to find the representation in this latent space that best fits the generated shape to the known partial input. The completed shape exhibits a realistic appearance on the unknown part. We show promising results towards the completion of synthetic and real scans of human body and face meshes exhibiting different styles of articulation and partiality.
Key facts. Cited by 50 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Dec 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 13; 2023: 11; 2024: 8; 2025: 4; 2026: 2.
50 papers.
Sort:
By area:
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
- 2022ShapeFormer: Transformer-based Shape Completion via Sparse Representationcited by 106
- 2023Neural Kernel Surface Reconstructioncited by 104
- 2021Neural Fields as Learnable Kernels for 3D Reconstructioncited by 58
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generationcited by 47
- 2021ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generatorscited by 40
- 2021Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinementcited by 36
- 2021ASFM-Net: Asymmetrical Siamese Feature Matching Network for Point Completioncited by 28
- 2022Neural Jacobian Fields: Learning Intrinsic Mappings of Arbitrary Meshescited by 28
- 2024SpaceMesh: A Continuous Representation for Learning Manifold Surface Meshescited by 20
- 2021Deep Graph Convolutional Networks for Wind Speed Predictioncited by 19
- 2021Sparse to Dense Dynamic 3D Facial Expression Generationcited by 19
38 more
- 2021Frame Averaging for Equivariant Shape Space Learningcited by 19
- 20213D Shape Variational Autoencoder Latent Disentanglement via Mini-Batch Feature Swapping for Bodies and Facescited by 15
- 2023Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D Shapescited by 14
- 2021Learning Feature Aggregation for Deep 3D Morphable Modelscited by 13
- 2022Deep Structural Causal Shape Modelscited by 11
- 2023GenCorres: Consistent Shape Matching via Coupled Implicit-Explicit Shape Generative Modelscited by 11
- 2023SCoDA: Domain Adaptive Shape Completion for Real Scanscited by 9
- 2022Generating Multiple 4D Expression Transitions by Learning Face Landmark Trajectoriescited by 7
- 2024Shape Non-rigid Kinematics (SNK): A Zero-Shot Method for Non-Rigid Shape Matching via Unsupervised Functional Map Regularized Reconstructioncited by 7
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequencescited by 7
- 2022Structure-Aware NeRF without Posed Camera via Epipolar Constraintcited by 6
- 20233D Generative Model Latent Disentanglement via Local Eigenprojectioncited by 6
- 2025OT-Talk: Animating 3D Talking Head with Optimal Transportationcited by 6
- 2022A Generative Shape Compositional Framework to Synthesise Populations of Virtual Chimaerascited by 5
- 2023LASA: Instance Reconstruction from Real Scans using A Large-scale Aligned Shape Annotation Datasetcited by 5
- 2021Learning Spectral Unions of Partial Deformable 3D Shapescited by 4
- 2021Dense Graph Convolutional Neural Networks on 3D Meshes for 3D Object Segmentation and Classificationcited by 4
- 2023Adaptive Local Basis Functions for Shape Completioncited by 4
- 2022Surface Analysis with Vision Transformerscited by 3
- 2022Transfer Learning using Spectral Convolutional Autoencoders on Semi-Regular Surface Meshescited by 3
- 2025GenAnalysis: Joint Shape Analysis by Learning Man-Made Shape Generators with Deformation Regularizationscited by 3
- 2021A 3D Mesh-based Lifting-and-Projection Network for Human Pose Transfercited by 2
- 2024Self-Supervised Dual Contouringcited by 2
- 2022GCN-FFNN: A Two-Stream Deep Model for Learning Solution to Partial Differential Equationscited by 1
- 2022Deep Active Latent Surfaces for Medical Geometriescited by 1
- 2023Stability and Generalization of Hypergraph Collaborative Networkscited by 1
- 2023WrappingNet: Mesh Autoencoder via Deep Sphere Deformationcited by 1
- 2023Unsupervised Representation Learning for Diverse Deformable Shape Collectionscited by 1
- 2024CADGL: Context-Aware Deep Graph Learning for Predicting Drug-Drug Interactionscited by 1
- 2024Disentangling Hippocampal Shape Variations: A Study of Neurological Disorders Using Mesh Variational Autoencoder with Contrastive Learningcited by 1
- 2024FaceCom: Towards High-fidelity 3D Facial Shape Completion via Optimization and Inpainting Guidancecited by 1
- 2025TopoDiT-3D: Topology-Aware Diffusion Transformer with Bottleneck Structure for 3D Point Cloud Generationcited by 1
- 2022Implicit Shape Completion via Adversarial Shape Priorscited by 0
- 2022Pixel-Aligned Non-parametric Hand Mesh Reconstructioncited by 0
- 2023Towards AI-Architecture Liberty: A Comprehensive Survey on Design and Generation of Virtual Architecture by Deep Learningcited by 0
- 2024LISR: Learning Linear 3D Implicit Surface Representation Using Compactly Supported Radial Basis Functionscited by 0
- 2026A 3D mesh convolution-based autoencoder for geometry compressioncited by 0
- 2026A Strong Linear Baseline for Whole-Heart Cardiac Shape Completion on CT, with an Open Eleven-Structure Statistical Shape Modelcited by 0
- 2026A Strong Linear Baseline for Whole-Heart Cardiac Shape Completion on CT, with an Open Eleven-Structure Statistical Shape Model20 Aug 2026
- 2026A 3D mesh convolution-based autoencoder for geometry compression2 Mar 2026
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequences2 Dec 2025
- 2025TopoDiT-3D: Topology-Aware Diffusion Transformer with Bottleneck Structure for 3D Point Cloud Generation14 May 2025
- 2025OT-Talk: Animating 3D Talking Head with Optimal Transportation3 May 2025
- 2025GenAnalysis: Joint Shape Analysis by Learning Man-Made Shape Generators with Deformation Regularizations2 Mar 2025
- 2024SpaceMesh: A Continuous Representation for Learning Manifold Surface Meshes30 Sep 2024
- 2024FaceCom: Towards High-fidelity 3D Facial Shape Completion via Optimization and Inpainting Guidance4 Jun 2024
- 2024Self-Supervised Dual Contouring28 May 2024
- 2024Disentangling Hippocampal Shape Variations: A Study of Neurological Disorders Using Mesh Variational Autoencoder with Contrastive Learning31 Mar 2024
- 2024CADGL: Context-Aware Deep Graph Learning for Predicting Drug-Drug Interactions25 Mar 2024
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generation15 Mar 2024
38 more
- 2024Shape Non-rigid Kinematics (SNK): A Zero-Shot Method for Non-Rigid Shape Matching via Unsupervised Functional Map Regularized Reconstruction11 Mar 2024
- 2024LISR: Learning Linear 3D Implicit Surface Representation Using Compactly Supported Radial Basis Functions11 Feb 2024
- 2023LASA: Instance Reconstruction from Real Scans using A Large-scale Aligned Shape Annotation Dataset19 Dec 2023
- 2023Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D Shapes7 Dec 2023
- 2023Unsupervised Representation Learning for Diverse Deformable Shape Collections27 Oct 2023
- 2023WrappingNet: Mesh Autoencoder via Deep Sphere Deformation29 Aug 2023
- 2023Stability and Generalization of Hypergraph Collaborative Networks4 Aug 2023
- 2023Adaptive Local Basis Functions for Shape Completion17 Jul 2023
- 2023Neural Kernel Surface Reconstruction31 May 2023
- 2023Towards AI-Architecture Liberty: A Comprehensive Survey on Design and Generation of Virtual Architecture by Deep Learning30 Apr 2023
- 2023GenCorres: Consistent Shape Matching via Coupled Implicit-Explicit Shape Generative Models20 Apr 2023
- 2023SCoDA: Domain Adaptive Shape Completion for Real Scans20 Apr 2023
- 20233D Generative Model Latent Disentanglement via Local Eigenprojection24 Feb 2023
- 2022Transfer Learning using Spectral Convolutional Autoencoders on Semi-Regular Surface Meshes12 Dec 2022
- 2022Pixel-Aligned Non-parametric Hand Mesh Reconstruction17 Oct 2022
- 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct 2022
- 2022A Generative Shape Compositional Framework to Synthesise Populations of Virtual Chimaeras4 Oct 2022
- 2022Structure-Aware NeRF without Posed Camera via Epipolar Constraint1 Oct 2022
- 2022Deep Structural Causal Shape Models23 Aug 2022
- 2022Generating Multiple 4D Expression Transitions by Learning Face Landmark Trajectories29 Jul 2022
- 2022Deep Active Latent Surfaces for Medical Geometries21 Jun 2022
- 2022Surface Analysis with Vision Transformers31 May 2022
- 2022Neural Jacobian Fields: Learning Intrinsic Mappings of Arbitrary Meshes5 May 2022
- 2022GCN-FFNN: A Two-Stream Deep Model for Learning Solution to Partial Differential Equations28 Apr 2022
- 2022Implicit Shape Completion via Adversarial Shape Priors21 Apr 2022
- 2022ShapeFormer: Transformer-based Shape Completion via Sparse Representation25 Jan 2022
- 2021Frame Averaging for Equivariant Shape Space Learning3 Dec 2021
- 2021Neural Fields as Learnable Kernels for 3D Reconstruction26 Nov 2021
- 20213D Shape Variational Autoencoder Latent Disentanglement via Mini-Batch Feature Swapping for Bodies and Faces24 Nov 2021
- 2021A 3D Mesh-based Lifting-and-Projection Network for Human Pose Transfer24 Sep 2021
- 2021ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generators21 Aug 2021
- 2021Dense Graph Convolutional Neural Networks on 3D Meshes for 3D Object Segmentation and Classification30 Jun 2021
- 2021Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinement21 Jun 2021
- 2021Sparse to Dense Dynamic 3D Facial Expression Generation16 May 2021
- 2021Learning Feature Aggregation for Deep 3D Morphable Models5 May 2021
- 2021ASFM-Net: Asymmetrical Siamese Feature Matching Network for Point Completion19 Apr 2021
- 2021Learning Spectral Unions of Partial Deformable 3D Shapes31 Mar 2021
- 2021Deep Graph Convolutional Networks for Wind Speed Prediction25 Jan 2021
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generationcited by 47
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequencescited by 7
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequences2 Dec 2025
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generation15 Mar 2024
- 2022Deep Structural Causal Shape Modelscited by 11
- 2022Deep Structural Causal Shape Models23 Aug 2022
- 2022ShapeFormer: Transformer-based Shape Completion via Sparse Representationcited by 106
- 2023Neural Kernel Surface Reconstructioncited by 104
- 2021Neural Fields as Learnable Kernels for 3D Reconstructioncited by 58
- 2021ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generatorscited by 40
- 2021Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinementcited by 36
- 2021ASFM-Net: Asymmetrical Siamese Feature Matching Network for Point Completioncited by 28
- 2022Neural Jacobian Fields: Learning Intrinsic Mappings of Arbitrary Meshescited by 28
- 2024SpaceMesh: A Continuous Representation for Learning Manifold Surface Meshescited by 20
- 2021Deep Graph Convolutional Networks for Wind Speed Predictioncited by 19
- 2021Sparse to Dense Dynamic 3D Facial Expression Generationcited by 19
- 2021Frame Averaging for Equivariant Shape Space Learningcited by 19
- 20213D Shape Variational Autoencoder Latent Disentanglement via Mini-Batch Feature Swapping for Bodies and Facescited by 15
12 most cited of 45 All 45 (JSON)
- 2026A Strong Linear Baseline for Whole-Heart Cardiac Shape Completion on CT, with an Open Eleven-Structure Statistical Shape Model20 Aug 2026
- 2026A 3D mesh convolution-based autoencoder for geometry compression2 Mar 2026
- 2025OT-Talk: Animating 3D Talking Head with Optimal Transportation3 May 2025
- 2025GenAnalysis: Joint Shape Analysis by Learning Man-Made Shape Generators with Deformation Regularizations2 Mar 2025
- 2024SpaceMesh: A Continuous Representation for Learning Manifold Surface Meshes30 Sep 2024
- 2024FaceCom: Towards High-fidelity 3D Facial Shape Completion via Optimization and Inpainting Guidance4 Jun 2024
- 2024Self-Supervised Dual Contouring28 May 2024
- 2024Disentangling Hippocampal Shape Variations: A Study of Neurological Disorders Using Mesh Variational Autoencoder with Contrastive Learning31 Mar 2024
- 2024CADGL: Context-Aware Deep Graph Learning for Predicting Drug-Drug Interactions25 Mar 2024
- 2024Shape Non-rigid Kinematics (SNK): A Zero-Shot Method for Non-Rigid Shape Matching via Unsupervised Functional Map Regularized Reconstruction11 Mar 2024
- 2024LISR: Learning Linear 3D Implicit Surface Representation Using Compactly Supported Radial Basis Functions11 Feb 2024
- 2023LASA: Instance Reconstruction from Real Scans using A Large-scale Aligned Shape Annotation Dataset19 Dec 2023
12 newest of 45 All 45 (JSON)