Disentangled Representation Learning for 3D Face Shape
Not on the map. Why?
Abstract (arXiv)
In this paper, we present a novel strategy to design disentangled 3D face shape representation. Specifically, a given 3D face shape is decomposed into identity part and expression part, which are both encoded and decoded in a nonlinear way. To solve this problem, we propose an attribute decomposition framework for 3D face mesh. To better represent face shapes which are usually nonlinear deformed between each other, the face shapes are represented by a vertex based deformation representation rather than Euclidean coordinates. The experimental results demonstrate that our method has better performance than existing methods on decomposing the identity and expression parts. Moreover, more natural expression transfer results can be achieved with our method than existing methods.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 8; 2023: 8; 2024: 9; 2025: 4; 2026: 2.
48 papers.
Sort:
By area:
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
- 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
- 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
- 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
- 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
- 2021StyleMeUp: Towards Style-Agnostic Sketch-Based Image Retrievalcited by 50
- 2022FFHQ-UV: Normalized Facial UV-Texture Dataset for 3D Face Reconstructioncited by 39
- 2021FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstructioncited by 34
- 2023Towards Practical Capture of High-Fidelity Relightable Avatarscited by 34
- 2021SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstructioncited by 27
- 2023Neural Face Rigging for Animating and Retargeting Facial Meshes in the Wildcited by 25
- 2021Self-Supervised Disentangled Representation Learning for Third-Person Imitation Learningcited by 23
36 more
- 2024Faces that Speak: Jointly Synthesising Talking Face and Speech from Textcited by 21
- 2021Learning Facial Representations from the Cycle-consistency of Facecited by 20
- 2021Voxel-based 3D Detection and Reconstruction of Multiple Objects from a Single Imagecited by 20
- 2021SketchLattice: Latticed Representation for Sketch Manipulationcited by 19
- 2024VRMM: A Volumetric Relightable Morphable Head Modelcited by 19
- 2021Inverting Generative Adversarial Renderer for Face Reconstructioncited by 17
- 2021Learning to Aggregate and Personalize 3D Face from In-the-Wild Photo Collectioncited by 16
- 20234D Facial Expression Diffusion Modelcited by 15
- 2022Deep Deformable 3D Caricatures with Learned Shape Controlcited by 10
- 2021FaceTuneGAN: Face Autoencoder for Convolutional Expression Transfer Using Neural Generative Adversarial Networkscited by 9
- 2024JoyVASA: Portrait and Animal Image Animation with Diffusion-Based Audio-Driven Facial Dynamics and Head Motion Generationcited by 9
- 2022Controllable 3D Generative Adversarial Face Model via Disentangling Shape and Appearancecited by 8
- 2023That's What I Said: Fully-Controllable Talking Face Generationcited by 8
- 2023ReliableSwap: Boosting General Face Swapping Via Reliable Supervisioncited by 8
- 2024Head360: Learning a Parametric 3D Full-Head for Free-View Synthesis in 360degcited by 8
- 20233D Generative Model Latent Disentanglement via Local Eigenprojectioncited by 6
- 2021Deep Deformation Detail Synthesis for Thin Shell Modelscited by 5
- 2024Towards Native Generative Model for 3D Head Avatarcited by 5
- 2025Neural Face Skinning for Mesh-agnostic Facial Expression Cloningcited by 5
- 2022Structure-aware Editable Morphable Model for 3D Facial Detail Animation and Manipulationcited by 4
- 2023INFAMOUS-NeRF: ImproviNg FAce MOdeling Using Semantically-Aligned Hypernetworks with Neural Radiance Fieldscited by 3
- 2021Improving Robot Localisation by Ignoring Visual Distractioncited by 2
- 2025Graph-Convolutional-Beta-VAE for Synthetic Abdominal Aorta Aneurysm Generationcited by 2
- 2025RigAnyFace: Scaling Neural Facial Mesh Auto-Rigging with Unlabeled Datacited by 2
- 2021Disentangled Face Identity Representations for joint 3D Face Recognition and Expression Neutralisationcited by 1
- 2021Sphere Face Model:A 3D Morphable Model with Hypersphere Manifold Latent Spacecited by 1
- 2022BabyNet: Reconstructing 3D faces of babies from uncalibrated photographscited by 1
- 20243D Face Modeling via Weakly-supervised Disentanglement Network joint Identity-consistency Priorcited by 1
- 2026EditEmoTalk: Controllable Speech-Driven 3D Facial Animation with Continuous Expression Editingcited by 1
- 2026OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologiescited by 1
- 2021Disentangling semantic features of macromolecules in Cryo-Electron Tomographycited by 0
- 2022Towards an objective characterization of an individual's facial movements using Self-Supervised Person-Specific-Modelscited by 0
- 20223DLatNav: Navigating Generative Latent Spaces for Semantic-Aware 3D Object Manipulationcited by 0
- 2024Deep Spectral Meshes: Multi-Frequency Facial Mesh Processing with Graph Neural Networkscited by 0
- 2024DrFER: Learning Disentangled Representations for 3D Facial Expression Recognitioncited by 0
- 2025Self-Attention Based Multi-Scale Graph Auto-Encoder Network of 3D Meshescited by 0
- 2026OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologies6 Jun 2026
- 2026EditEmoTalk: Controllable Speech-Driven 3D Facial Animation with Continuous Expression Editing15 Jan 2026
- 2025RigAnyFace: Scaling Neural Facial Mesh Auto-Rigging with Unlabeled Data23 Nov 2025
- 2025Self-Attention Based Multi-Scale Graph Auto-Encoder Network of 3D Meshes7 Jul 2025
- 2025Graph-Convolutional-Beta-VAE for Synthetic Abdominal Aorta Aneurysm Generation16 Jun 2025
- 2025Neural Face Skinning for Mesh-agnostic Facial Expression Cloning28 May 2025
- 2024JoyVASA: Portrait and Animal Image Animation with Diffusion-Based Audio-Driven Facial Dynamics and Head Motion Generation14 Nov 2024
- 2024Towards Native Generative Model for 3D Head Avatar2 Oct 2024
- 2024Head360: Learning a Parametric 3D Full-Head for Free-View Synthesis in 360deg1 Aug 2024
- 2024Faces that Speak: Jointly Synthesising Talking Face and Speech from Text16 May 2024
- 20243D Face Modeling via Weakly-supervised Disentanglement Network joint Identity-consistency Prior25 Apr 2024
- 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizer20 Mar 2024
36 more
- 2024DrFER: Learning Disentangled Representations for 3D Facial Expression Recognition13 Mar 2024
- 2024Deep Spectral Meshes: Multi-Frequency Facial Mesh Processing with Graph Neural Networks15 Feb 2024
- 2024VRMM: A Volumetric Relightable Morphable Head Model6 Feb 2024
- 2023INFAMOUS-NeRF: ImproviNg FAce MOdeling Using Semantically-Aligned Hypernetworks with Neural Radiance Fields23 Dec 2023
- 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Data30 Nov 2023
- 2023Towards Practical Capture of High-Fidelity Relightable Avatars8 Sep 2023
- 2023ReliableSwap: Boosting General Face Swapping Via Reliable Supervision8 Jun 2023
- 2023Neural Face Rigging for Animating and Retargeting Facial Meshes in the Wild15 May 2023
- 2023That's What I Said: Fully-Controllable Talking Face Generation6 Apr 2023
- 20234D Facial Expression Diffusion Model29 Mar 2023
- 20233D Generative Model Latent Disentanglement via Local Eigenprojection24 Feb 2023
- 2022FFHQ-UV: Normalized Facial UV-Texture Dataset for 3D Face Reconstruction25 Nov 2022
- 20223DLatNav: Navigating Generative Latent Spaces for Semantic-Aware 3D Object Manipulation17 Nov 2022
- 2022Towards an objective characterization of an individual's facial movements using Self-Supervised Person-Specific-Models15 Nov 2022
- 2022Controllable 3D Generative Adversarial Face Model via Disentangling Shape and Appearance30 Aug 2022
- 2022Deep Deformable 3D Caricatures with Learned Shape Control29 Jul 2022
- 2022Structure-aware Editable Morphable Model for 3D Facial Detail Animation and Manipulation19 Jul 2022
- 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Dataset26 Mar 2022
- 2022BabyNet: Reconstructing 3D faces of babies from uncalibrated photographs11 Mar 2022
- 2021MoFaNeRF: Morphable Facial Neural Radiance Field4 Dec 2021
- 2021Sphere Face Model:A 3D Morphable Model with Hypersphere Manifold Latent Space4 Dec 2021
- 2021FaceTuneGAN: Face Autoencoder for Convolutional Expression Transfer Using Neural Generative Adversarial Networks1 Dec 2021
- 2021Voxel-based 3D Detection and Reconstruction of Multiple Objects from a Single Image4 Nov 2021
- 2021FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstruction1 Nov 2021
- 2021SketchLattice: Latticed Representation for Sketch Manipulation26 Aug 2021
- 2021Learning Facial Representations from the Cycle-consistency of Face7 Aug 2021
- 2021Self-Supervised Disentangled Representation Learning for Third-Person Imitation Learning2 Aug 2021
- 2021Improving Robot Localisation by Ignoring Visual Distraction25 Jul 2021
- 2021Disentangling semantic features of macromolecules in Cryo-Electron Tomography27 Jun 2021
- 2021Learning to Aggregate and Personalize 3D Face from In-the-Wild Photo Collection15 Jun 2021
- 2021SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction6 Jun 2021
- 2021Inverting Generative Adversarial Renderer for Face Reconstruction6 May 2021
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation22 Apr 2021
- 2021Disentangled Face Identity Representations for joint 3D Face Recognition and Expression Neutralisation20 Apr 2021
- 2021StyleMeUp: Towards Style-Agnostic Sketch-Based Image Retrieval29 Mar 2021
- 2021Deep Deformation Detail Synthesis for Thin Shell Models23 Feb 2021
- 20234D Facial Expression Diffusion Modelcited by 15
- 20234D Facial Expression Diffusion Model29 Mar 2023
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
- 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
- 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
- 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
- 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
- 2021StyleMeUp: Towards Style-Agnostic Sketch-Based Image Retrievalcited by 50
- 2022FFHQ-UV: Normalized Facial UV-Texture Dataset for 3D Face Reconstructioncited by 39
- 2021FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstructioncited by 34
- 2023Towards Practical Capture of High-Fidelity Relightable Avatarscited by 34
- 2021SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstructioncited by 27
- 2023Neural Face Rigging for Animating and Retargeting Facial Meshes in the Wildcited by 25
- 2024Faces that Speak: Jointly Synthesising Talking Face and Speech from Textcited by 21
12 most cited of 46 All 46 (JSON)
- 2026OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologies6 Jun 2026
- 2026EditEmoTalk: Controllable Speech-Driven 3D Facial Animation with Continuous Expression Editing15 Jan 2026
- 2025RigAnyFace: Scaling Neural Facial Mesh Auto-Rigging with Unlabeled Data23 Nov 2025
- 2025Self-Attention Based Multi-Scale Graph Auto-Encoder Network of 3D Meshes7 Jul 2025
- 2025Graph-Convolutional-Beta-VAE for Synthetic Abdominal Aorta Aneurysm Generation16 Jun 2025
- 2025Neural Face Skinning for Mesh-agnostic Facial Expression Cloning28 May 2025
- 2024JoyVASA: Portrait and Animal Image Animation with Diffusion-Based Audio-Driven Facial Dynamics and Head Motion Generation14 Nov 2024
- 2024Towards Native Generative Model for 3D Head Avatar2 Oct 2024
- 2024Head360: Learning a Parametric 3D Full-Head for Free-View Synthesis in 360deg1 Aug 2024
- 2024Faces that Speak: Jointly Synthesising Talking Face and Speech from Text16 May 2024
- 20243D Face Modeling via Weakly-supervised Disentanglement Network joint Identity-consistency Prior25 Apr 2024
- 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizer20 Mar 2024
12 newest of 46 All 46 (JSON)