Variational Autoencoders for Deforming 3D Mesh Models
Not on the map. Why?
Abstract (arXiv)
3D geometric contents are becoming increasingly popular. In this paper, we study the problem of analyzing deforming 3D meshes using deep neural networks. Deforming 3D meshes are flexible to represent 3D animation sequences as well as collections of objects of the same category, allowing diverse shapes with large-scale non-linear deformations. We propose a novel framework which we call mesh variational autoencoders (mesh VAE), to explore the probabilistic latent space of 3D surfaces. The framework is easy to train, and requires very few training examples. We also propose an extended model which allows flexibly adjusting the significance of different latent variables by altering the prior distribution. Extensive experiments demonstrate that our general framework is able to learn a reasonable representation for a collection of deformable shapes, and produce competitive results for a variety of applications, including shape generation, shape interpolation, shape space embedding and shape exploration, outperforming state-of-the-art methods.
Key facts. Cited by 69 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Sep 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 12; 2023: 15; 2024: 13; 2025: 10; 2026: 3.
69 papers.
Sort:
By area:
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 216
- 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 198
- 2023TextDeformer: Geometry Manipulation using Text Guidancecited by 94
- 2024SPAD : Spatially Aware Multiview Diffuserscited by 62
- 2022Uncertainty Inspired Underwater Image Enhancementcited by 53
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generationcited by 45
- 2024VideoMV: Consistent Multi-View Generation Based on Large Video Generative Modelcited by 45
- 2021ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generatorscited by 40
- 2021DeepMetaHandles: Learning Deformation Meta-Handles of 3D Meshes with Biharmonic Coordinatescited by 36
- 2024Tailor3D: Customized 3D Assets Editing and Generation with Dual-Side Imagescited by 34
- 20213D Pose Transfer with Correspondence Learning and Mesh Refinementcited by 30
38 more
- 2022Skeleton-free Pose Transfer for Stylized 3D Characterscited by 29
- 2022SPAGHETTI: Editing Implicit Shapes Through Part Aware Generationcited by 28
- 2022Neural Jacobian Fields: Learning Intrinsic Mappings of Arbitrary Meshescited by 28
- 2024Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splattingcited by 26
- 2023Neural Face Rigging for Animating and Retargeting Facial Meshes in the Wildcited by 25
- 2021Deep 3D-to-2D Watermarking: Embedding Messages in 3D Meshes and Extracting Them from 2D Renderingscited by 23
- 2022Self-Supervised Representation Learning for CADcited by 22
- 2022Unsupervised 3D Pose Transfer with Cross Consistency and Dual Reconstructioncited by 21
- 2025Pippo: High-Resolution Multi-View Humans from a Single Imagecited by 20
- 2021GLASS: Geometric Latent Augmentation for Shape Spacescited by 16
- 2023TapMo: Shape-aware Motion Generation of Skeleton-free Characterscited by 15
- 2021Learning Feature Aggregation for Deep 3D Morphable Modelscited by 13
- 2024NeuSDFusion: A Spatial-Aware Generative Model for 3D Shape Completion, Reconstruction, and Generationcited by 13
- 2025Edit360: 2D Image Edits to 3D Assets from Any Anglecited by 13
- 2024PoNQ: a Neural QEM-based Mesh Representationcited by 12
- 2022Deep Structural Causal Shape Modelscited by 11
- 2023GenCorres: Consistent Shape Matching via Coupled Implicit-Explicit Shape Generative Modelscited by 11
- 2023Pushing the Limits of 3D Shape Generation at Scalecited by 11
- 2021A Deep Signed Directional Distance Function for Object Shape Representationcited by 10
- 2021Geometry-Contrastive Transformer for Generalized 3D Pose Transfercited by 10
- 2021Mesh Convolutional Autoencoder for Semi-Regular Meshes of Different Sizescited by 8
- 20223D Shape Sequence of Human Comparison and Classification using Current and Varifoldscited by 8
- 2022Controllable 3D Generative Adversarial Face Model via Disentangling Shape and Appearancecited by 8
- 2023MVControl: Adding Conditional Control to Multi-view Diffusion for Controllable Text-to-3D Generationcited by 8
- 2021Intuitive Shape Editing in Latent Spacecited by 7
- 2023Interactive Geometry Editing of Neural Radiance Fieldscited by 7
- 2024LAM3D: Large Image-Point-Cloud Alignment Model for 3D Reconstruction from Single Imagecited by 7
- 2021Neural Human Deformation Transfercited by 6
- 2023Variational Barycentric Coordinatescited by 6
- 2023ET3D: Efficient Text-to-3D Generation via Multi-View Distillationcited by 6
- 2024Multi-scale Latent Point Consistency Models for 3D Shape Generationcited by 6
- 2025PoissonNet: A Local-Global Approach for Learning on Surfacescited by 6
- 2021Deep Deformation Detail Synthesis for Thin Shell Modelscited by 5
- 2021Learning Mesh Representations via Binary Space Partitioning Tree Networkscited by 5
- 2021Active Learning of Neural Collision Handler for Complex 3D Mesh Deformationscited by 5
- 20233D-QAE: Fully Quantum Auto-Encoding of 3D Point Cloudscited by 5
- 2025Neural Face Skinning for Mesh-agnostic Facial Expression Cloningcited by 5
- 2022Leveraging Deepfakes to Close the Domain Gap between Real and Synthetic Images in Facial Capture Pipelinescited by 4
50 most cited of 69 All 69 (JSON)
- 2026Mat'ern Noise for Triangulation-Agnostic Flow Matching on Meshes19 May 2026
- 2026Velox: Learning Representations of 4D Geometry and Appearance6 May 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2025DiLO: Disentangled Latent Optimization for Learning Shape and Deformation in Grouped Deforming 3D Objects8 Nov 2025
- 2025PoissonNet: A Local-Global Approach for Learning on Surfaces15 Oct 2025
- 2025MeshMamba: State Space Models for Articulated 3D Mesh Generation and Reconstruction21 Jul 2025
- 2025Edit360: 2D Image Edits to 3D Assets from Any Angle12 Jun 2025
- 2025Neural Face Skinning for Mesh-agnostic Facial Expression Cloning28 May 2025
- 2025Disentangled Human Body Representation Based on Unsupervised Semantic-Aware Learning25 May 2025
- 2025TopoDiT-3D: Topology-Aware Diffusion Transformer with Bottleneck Structure for 3D Point Cloud Generation14 May 2025
- 2025ASMR: Adaptive Skeleton-Mesh Rigging and Skinning via 2D Generative Prior17 Mar 2025
- 2025Heuristics for AI-driven Graphical Asset Generation Tools in Game Design and Development Pipelines: A User-Centred Approach4 Mar 2025
38 more
- 2025Pippo: High-Resolution Multi-View Humans from a Single Image11 Feb 2025
- 2024Multi-scale Latent Point Consistency Models for 3D Shape Generation27 Dec 2024
- 2024PaNDaS: Learnable Deformation Modeling with Localized Control3 Dec 2024
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Pose27 Aug 2024
- 2024Tailor3D: Customized 3D Assets Editing and Generation with Dual-Side Images8 Jul 2024
- 2024DifAttack++: Query-Efficient Black-Box Adversarial Attack via Hierarchical Disentangled Feature Space in Cross-Domain5 Jun 2024
- 2024DualContrast: Unsupervised Disentangling of Content and Transformations with Implicit Parameterization27 May 2024
- 2024LAM3D: Large Image-Point-Cloud Alignment Model for 3D Reconstruction from Single Image24 May 2024
- 2024NeuSDFusion: A Spatial-Aware Generative Model for 3D Shape Completion, Reconstruction, and Generation27 Mar 2024
- 2024PoNQ: a Neural QEM-based Mesh Representation19 Mar 2024
- 2024VideoMV: Consistent Multi-View Generation Based on Large Video Generative Model18 Mar 2024
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generation15 Mar 2024
- 2024Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splatting15 Mar 2024
- 2024SPAD : Spatially Aware Multiview Diffusers7 Feb 2024
- 2023ET3D: Efficient Text-to-3D Generation via Multi-View Distillation27 Nov 2023
- 2023MVControl: Adding Conditional Control to Multi-view Diffusion for Controllable Text-to-3D Generation24 Nov 2023
- 2023Intelligent Generation of Graphical Game Assets: A Conceptual Framework and Systematic Review of the State of the Art16 Nov 2023
- 20233D-QAE: Fully Quantum Auto-Encoding of 3D Point Clouds9 Nov 2023
- 2023Unsupervised Representation Learning for Diverse Deformable Shape Collections27 Oct 2023
- 2023TapMo: Shape-aware Motion Generation of Skeleton-free Characters19 Oct 2023
- 2023Variational Barycentric Coordinates5 Oct 2023
- 2023Surface Geometry Processing: An Efficient Normal-based Detail Representation16 Jul 2023
- 2023Pushing the Limits of 3D Shape Generation at Scale20 Jun 2023
- 2023Neural Face Rigging for Animating and Retargeting Facial Meshes in the Wild15 May 2023
- 2023MAPConNet: Self-supervised 3D Pose Transfer with Mesh and Point Contrastive Learning26 Apr 2023
- 2023TextDeformer: Geometry Manipulation using Text Guidance26 Apr 2023
- 2023GenCorres: Consistent Shape Matching via Coupled Implicit-Explicit Shape Generative Models20 Apr 2023
- 2023Interactive Geometry Editing of Neural Radiance Fields21 Mar 2023
- 2023MeshDiffusion: Score-based Generative 3D Mesh Modeling14 Mar 2023
- 2022Unsupervised 3D Pose Transfer with Cross Consistency and Dual Reconstruction18 Nov 2022
- 2022Self-Supervised Representation Learning for CAD19 Oct 2022
- 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct 2022
- 2022Controllable 3D Generative Adversarial Face Model via Disentangling Shape and Appearance30 Aug 2022
- 2022Deep Structural Causal Shape Models23 Aug 2022
- 2022Skeleton-free Pose Transfer for Stylized 3D Characters28 Jul 2022
- 20223D Shape Sequence of Human Comparison and Classification using Current and Varifolds25 Jul 2022
- 2022Uncertainty Inspired Underwater Image Enhancement20 Jul 2022
- 2022NeRF-Editing: Geometry Editing of Neural Radiance Fields10 May 2022
50 newest of 69 All 69 (JSON)
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 2024Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splattingcited by 26
- 2025Edit360: 2D Image Edits to 3D Assets from Any Anglecited by 13
- 2023MVControl: Adding Conditional Control to Multi-view Diffusion for Controllable Text-to-3D Generationcited by 8
- 2023ET3D: Efficient Text-to-3D Generation via Multi-View Distillationcited by 6
- 2024Multi-scale Latent Point Consistency Models for 3D Shape Generationcited by 6
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Posecited by 2
- 2025TopoDiT-3D: Topology-Aware Diffusion Transformer with Bottleneck Structure for 3D Point Cloud Generationcited by 1
- 2026Mat'ern Noise for Triangulation-Agnostic Flow Matching on Meshescited by 0
- 2026Mat'ern Noise for Triangulation-Agnostic Flow Matching on Meshes19 May 2026
- 2025Edit360: 2D Image Edits to 3D Assets from Any Angle12 Jun 2025
- 2025TopoDiT-3D: Topology-Aware Diffusion Transformer with Bottleneck Structure for 3D Point Cloud Generation14 May 2025
- 2024Multi-scale Latent Point Consistency Models for 3D Shape Generation27 Dec 2024
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Pose27 Aug 2024
- 2024Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splatting15 Mar 2024
- 2023ET3D: Efficient Text-to-3D Generation via Multi-View Distillation27 Nov 2023
- 2023MVControl: Adding Conditional Control to Multi-view Diffusion for Controllable Text-to-3D Generation24 Nov 2023
- 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct 2022
- 2022Deep Structural Causal Shape Modelscited by 11
- 2022Deep Structural Causal Shape Models23 Aug 2022
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generationcited by 45
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generation15 Mar 2024
- 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 216
- 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 198
- 2023TextDeformer: Geometry Manipulation using Text Guidancecited by 94
- 2024SPAD : Spatially Aware Multiview Diffuserscited by 62
- 2022Uncertainty Inspired Underwater Image Enhancementcited by 53
- 2024VideoMV: Consistent Multi-View Generation Based on Large Video Generative Modelcited by 45
- 2021ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generatorscited by 40
- 2021DeepMetaHandles: Learning Deformation Meta-Handles of 3D Meshes with Biharmonic Coordinatescited by 36
- 2024Tailor3D: Customized 3D Assets Editing and Generation with Dual-Side Imagescited by 34
- 20213D Pose Transfer with Correspondence Learning and Mesh Refinementcited by 30
- 2022Skeleton-free Pose Transfer for Stylized 3D Characterscited by 29
- 2022SPAGHETTI: Editing Implicit Shapes Through Part Aware Generationcited by 28
12 most cited of 57 All 57 (JSON)
- 2026Velox: Learning Representations of 4D Geometry and Appearance6 May 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2025DiLO: Disentangled Latent Optimization for Learning Shape and Deformation in Grouped Deforming 3D Objects8 Nov 2025
- 2025PoissonNet: A Local-Global Approach for Learning on Surfaces15 Oct 2025
- 2025Neural Face Skinning for Mesh-agnostic Facial Expression Cloning28 May 2025
- 2025Disentangled Human Body Representation Based on Unsupervised Semantic-Aware Learning25 May 2025
- 2025ASMR: Adaptive Skeleton-Mesh Rigging and Skinning via 2D Generative Prior17 Mar 2025
- 2025Heuristics for AI-driven Graphical Asset Generation Tools in Game Design and Development Pipelines: A User-Centred Approach4 Mar 2025
- 2025Pippo: High-Resolution Multi-View Humans from a Single Image11 Feb 2025
- 2024PaNDaS: Learnable Deformation Modeling with Localized Control3 Dec 2024
- 2024Tailor3D: Customized 3D Assets Editing and Generation with Dual-Side Images8 Jul 2024
- 2024DifAttack++: Query-Efficient Black-Box Adversarial Attack via Hierarchical Disentangled Feature Space in Cross-Domain5 Jun 2024
12 newest of 57 All 57 (JSON)