Unsupervised Shape and Pose Disentanglement for 3D Meshes
Not on the map. Why?
Abstract (arXiv)
Parametric models of humans, faces, hands and animals have been widely used for a range of tasks such as image-based reconstruction, shape correspondence estimation, and animation. Their key strength is the ability to factor surface variations into shape and pose dependent components. Learning such models requires lots of expert knowledge and hand-defined object-specific constraints, making the learning approach unscalable to novel objects. In this paper, we present a simple yet effective approach to learn disentangled shape and pose representations in an unsupervised setting. We use a combination of self-consistency and cross-consistency constraints to learn pose and shape space from registered meshes. We additionally incorporate as-rigid-as-possible deformation(ARAP) into the training loop to avoid degenerate solutions. We demonstrate the usefulness of learned representations through a number of tasks including pose transfer and shape retrieval. The experiments on datasets of 3D humans, faces, hands and animals demonstrate the generality of our approach. Code is made available at https://virtualhumans.mpi-inf.mpg.de/unsup_shape_pose/.
Key facts. Cited by 61 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 21; 2022: 10; 2023: 7; 2024: 12; 2025: 7; 2026: 4.
61 papers.
Sort:
By area:
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
- 2021NPMs: Neural Parametric Models for 3D Deformable Shapescited by 89
- 2021Driving-Signal Aware Full-Body Avatarscited by 81
- 2022LISA: Learning Implicit Shape and Appearance of Handscited by 63
- 2021ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generatorscited by 40
- 2022Neural Systematic Bindercited by 37
- 2021DeepMetaHandles: Learning Deformation Meta-Handles of 3D Meshes with Biharmonic Coordinatescited by 36
- 2022Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshescited by 34
- 20213D Pose Transfer with Correspondence Learning and Mesh Refinementcited by 30
- 2022Skeleton-free Pose Transfer for Stylized 3D Characterscited by 29
38 more
- 2024Spectral Meets Spatial: Harmonising 3D Shape Matching and Interpolationcited by 26
- 2022Unsupervised 3D Pose Transfer with Cross Consistency and Dual Reconstructioncited by 21
- 2021Intrinsic-Extrinsic Preserved GANs for Unsupervised 3D Pose Transfercited by 20
- 2024HUMOS: Human Motion Model Conditioned on Body Shapecited by 20
- 2021View Generalization for Single Image Textured 3D Modelscited by 19
- 2023Zero-shot Pose Transfer for Unrigged Stylized 3D Characterscited by 12
- 2023Weakly-supervised 3D Pose Transfer with Keypointscited by 12
- 2025Shape My Moves: Text-Driven Shape-Aware Synthesis of Human Motionscited by 11
- 2021AniFormer: Data-driven 3D Animation with Transformercited by 10
- 2021Geometry-Contrastive Transformer for Generalized 3D Pose Transfercited by 10
- 20223D Shape Sequence of Human Comparison and Classification using Current and Varifoldscited by 8
- 2024A Survey on Computational Solutions for Reconstructing Complete Objects by Reassembling Their Fractured Partscited by 8
- 2025Category-Agnostic Neural Object Riggingcited by 8
- 2021A Riemannian Framework for Analysis of Human Body Surfacecited by 7
- 2021Intuitive Shape Editing in Latent Spacecited by 7
- 2024Dessie: Disentanglement for Articulated 3D Horse Shape and Pose Estimation from Imagescited by 7
- 2021Neural Human Deformation Transfercited by 6
- 2021LatentHuman: Shape-and-Pose Disentangled Latent Representation for Human Bodiescited by 6
- 2023Correspondence-free online human motion retargetingcited by 6
- 20233D Generative Model Latent Disentanglement via Local Eigenprojectioncited by 6
- 2024ShapeFusion: A 3D diffusion model for localized shape editingcited by 6
- 2024Neural Pose Representation Learning for Generating and Transferring Non-Rigid Object Posescited by 6
- 2024Temporal Residual Jacobians For Rig-free Motion Transfercited by 6
- 2021A structured latent space for human body motion generationcited by 5
- 2023HMC: Hierarchical Mesh Coarsening for Skeleton-free Motion Retargetingcited by 5
- 2025SMF: Template-free and Rig-free Animation Transfer using Kinetic Codescited by 5
- 2021Adjoint Rigid Transform Network: Task-conditioned Alignment of 3D Shapescited by 4
- 2024Towards Robust 3D Pose Transfer with Adversarial Learningcited by 4
- 2022Self-Supervised Feature Learning from Partial Point Clouds via Pose Disentanglementcited by 3
- 2021Disentangling Geometric Deformation Spaces in Generative Latent Shape Modelscited by 2
- 2021Identity-Disentangled Neural Deformation Model for Dynamic Meshescited by 2
- 2022Disentangling 3D Attributes from a Single 2D Image: Human Pose, Shape and Garmentcited by 2
- 2022Self-Supervised Contrastive Representation Learning for 3D Mesh Segmentationcited by 2
- 2023MAPConNet: Self-supervised 3D Pose Transfer with Mesh and Point Contrastive Learningcited by 2
- 2024DifAttack++: Query-Efficient Black-Box Adversarial Attack via Hierarchical Disentangled Feature Space in Cross-Domaincited by 2
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Posecited by 2
- 2024JADE: Joint-aware Latent Diffusion for 3D Human Generative Modelingcited by 2
- 2026NeuROK: Generative 4D Neural Object Kinematicscited by 2
50 most cited of 61 All 61 (JSON)
- 2026GenSP: Consistent Spherical Parameterization via Learning Shape Generative Models1 Jul 2026
- 2026ARAPDiffusion: ARAP Regularization for Diffusion-Based Deformable Shape Space Learning5 Jun 2026
- 2026NeuROK: Generative 4D Neural Object Kinematics28 May 2026
- 2026MorphGS: Morphology-Adaptive Articulated 3D Motion Transfer from Videos6 Jan 2026
- 2025MimiCAT: Mimic with Correspondence-Aware Cascade-Transformer for Category-Free 3D Pose Transfer23 Nov 2025
- 2025DiLO: Disentangled Latent Optimization for Learning Shape and Deformation in Grouped Deforming 3D Objects8 Nov 2025
- 2025MeshMamba: State Space Models for Articulated 3D Mesh Generation and Reconstruction21 Jul 2025
- 2025Category-Agnostic Neural Object Rigging26 May 2025
- 2025Disentangled Human Body Representation Based on Unsupervised Semantic-Aware Learning25 May 2025
- 2025SMF: Template-free and Rig-free Animation Transfer using Kinetic Codes7 Apr 2025
- 2025Shape My Moves: Text-Driven Shape-Aware Synthesis of Human Motions4 Apr 2025
- 2024JADE: Joint-aware Latent Diffusion for 3D Human Generative Modeling29 Dec 2024
38 more
- 2024A Survey on Computational Solutions for Reconstructing Complete Objects by Reassembling Their Fractured Parts18 Oct 2024
- 2024Dessie: Disentanglement for Articulated 3D Horse Shape and Pose Estimation from Images4 Oct 2024
- 2024HUMOS: Human Motion Model Conditioned on Body Shape5 Sep 2024
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Pose27 Aug 2024
- 2024Temporal Residual Jacobians For Rig-free Motion Transfer20 Jul 2024
- 2024Neural Pose Representation Learning for Generating and Transferring Non-Rigid Object Poses14 Jun 2024
- 2024DifAttack++: Query-Efficient Black-Box Adversarial Attack via Hierarchical Disentangled Feature Space in Cross-Domain5 Jun 2024
- 2024DualContrast: Unsupervised Disentangling of Content and Transformations with Implicit Parameterization27 May 2024
- 2024Towards Robust 3D Pose Transfer with Adversarial Learning2 Apr 2024
- 2024ShapeFusion: A 3D diffusion model for localized shape editing28 Mar 2024
- 2024Spectral Meets Spatial: Harmonising 3D Shape Matching and Interpolation29 Feb 2024
- 2023Weakly-supervised 3D Pose Transfer with Keypoints25 Jul 2023
- 2023Zero-shot Pose Transfer for Unrigged Stylized 3D Characters31 May 2023
- 2023DSFFNet: Dual-Side Feature Fusion Network for 3D Pose Transfer24 May 2023
- 2023MAPConNet: Self-supervised 3D Pose Transfer with Mesh and Point Contrastive Learning26 Apr 2023
- 2023HMC: Hierarchical Mesh Coarsening for Skeleton-free Motion Retargeting20 Mar 2023
- 20233D Generative Model Latent Disentanglement via Local Eigenprojection24 Feb 2023
- 2023Correspondence-free online human motion retargeting1 Feb 2023
- 2022Unsupervised 3D Pose Transfer with Cross Consistency and Dual Reconstruction18 Nov 2022
- 2022Neural Systematic Binder2 Nov 2022
- 2022Self-Supervised Contrastive Representation Learning for 3D Mesh Segmentation8 Aug 2022
- 2022Disentangling 3D Attributes from a Single 2D Image: Human Pose, Shape and Garment5 Aug 2022
- 2022Skeleton-free Pose Transfer for Stylized 3D Characters28 Jul 2022
- 20223D Shape Sequence of Human Comparison and Classification using Current and Varifolds25 Jul 2022
- 2022TAVA: Template-free Animatable Volumetric Actors17 Jun 2022
- 2022Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshes10 Jun 2022
- 2022LISA: Learning Implicit Shape and Appearance of Hands4 Apr 2022
- 2022Self-Supervised Feature Learning from Partial Point Clouds via Pose Disentanglement9 Jan 2022
- 2021Geometry-Contrastive Transformer for Generalized 3D Pose Transfer14 Dec 2021
- 2021LatentHuman: Shape-and-Pose Disentangled Latent Representation for Human Bodies30 Nov 2021
- 2021Intuitive Shape Editing in Latent Space24 Nov 2021
- 2021AniFormer: Data-driven 3D Animation with Transformer20 Oct 2021
- 2021Identity-Disentangled Neural Deformation Model for Dynamic Meshes30 Sep 2021
- 20213D Pose Transfer with Correspondence Learning and Mesh Refinement30 Sep 2021
- 2021Neural Human Deformation Transfer3 Sep 2021
- 20213D Human Shape Style Transfer3 Sep 2021
- 2021A Riemannian Framework for Analysis of Human Body Surface25 Aug 2021
- 2021ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generators21 Aug 2021
50 newest of 61 All 61 (JSON)
- 2024ShapeFusion: A 3D diffusion model for localized shape editingcited by 6
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Posecited by 2
- 2024JADE: Joint-aware Latent Diffusion for 3D Human Generative Modelingcited by 2
- 2026ARAPDiffusion: ARAP Regularization for Diffusion-Based Deformable Shape Space Learningcited by 0
- 2026ARAPDiffusion: ARAP Regularization for Diffusion-Based Deformable Shape Space Learning5 Jun 2026
- 2024JADE: Joint-aware Latent Diffusion for 3D Human Generative Modeling29 Dec 2024
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Pose27 Aug 2024
- 2024ShapeFusion: A 3D diffusion model for localized shape editing28 Mar 2024
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
- 2021NPMs: Neural Parametric Models for 3D Deformable Shapescited by 89
- 2021Driving-Signal Aware Full-Body Avatarscited by 81
- 2022LISA: Learning Implicit Shape and Appearance of Handscited by 63
- 2021ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generatorscited by 40
- 2022Neural Systematic Bindercited by 37
- 2021DeepMetaHandles: Learning Deformation Meta-Handles of 3D Meshes with Biharmonic Coordinatescited by 36
- 2022Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshescited by 34
- 20213D Pose Transfer with Correspondence Learning and Mesh Refinementcited by 30
- 2022Skeleton-free Pose Transfer for Stylized 3D Characterscited by 29
12 most cited of 56 All 56 (JSON)
- 2026GenSP: Consistent Spherical Parameterization via Learning Shape Generative Models1 Jul 2026
- 2026NeuROK: Generative 4D Neural Object Kinematics28 May 2026
- 2026MorphGS: Morphology-Adaptive Articulated 3D Motion Transfer from Videos6 Jan 2026
- 2025MimiCAT: Mimic with Correspondence-Aware Cascade-Transformer for Category-Free 3D Pose Transfer23 Nov 2025
- 2025DiLO: Disentangled Latent Optimization for Learning Shape and Deformation in Grouped Deforming 3D Objects8 Nov 2025
- 2025Category-Agnostic Neural Object Rigging26 May 2025
- 2025Disentangled Human Body Representation Based on Unsupervised Semantic-Aware Learning25 May 2025
- 2025SMF: Template-free and Rig-free Animation Transfer using Kinetic Codes7 Apr 2025
- 2025Shape My Moves: Text-Driven Shape-Aware Synthesis of Human Motions4 Apr 2025
- 2024A Survey on Computational Solutions for Reconstructing Complete Objects by Reassembling Their Fractured Parts18 Oct 2024
- 2024Dessie: Disentanglement for Articulated 3D Horse Shape and Pose Estimation from Images4 Oct 2024
- 2024HUMOS: Human Motion Model Conditioned on Body Shape5 Sep 2024
12 newest of 56 All 56 (JSON)