Learning Domain Agnostic Latent Embeddings of 3D Faces for Zero-shot Animal Expression Transfer
Not on the map. Why?
Abstract (arXiv)
We present a zero-shot framework for transferring human facial expressions to 3D animal face meshes. Our method combines intrinsic geometric descriptors (HKS/WKS) with a mesh-agnostic latent embedding that disentangles facial identity and expression. The ID latent space captures species-independent facial structure, while the expression latent space encodes deformation patterns that generalize across humans and animals. Trained only with human expression pairs, the model learns the embeddings, decoupling, and recoupling of cross-identity expressions, enabling expression transfer without requiring animal expression data. To enforce geometric consistency, we employ Jacobian loss together with vertex-position and Laplacian losses. Experiments show that our approach achieves plausible cross-species expression transfer, effectively narrowing the geometric gap between human and animal facial shapes.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 25 references that are in the map. First posted on arXiv 10 Jan 2026.
Builds on
14 of 25 references.
References · 14
- 2020First Order Motion Model for Image Animationcited by 704
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
- 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 312
- 2020DiffusionNet: Discretization Agnostic Learning on Surfacescited by 164
- 2020Learning Formation of Physically-Based Face Attributescited by 94
- 2016Learning Detailed Face Reconstruction from a Single Imagecited by 71
- 2022Neural Jacobian Fields: Learning Intrinsic Mappings of Arbitrary Meshescited by 28
- 2023Neural Face Rigging for Animating and Retargeting Facial Meshes in the Wildcited by 25
- 2020Facial Expression Retargeting from Human to Avatar Made Easycited by 13
- 2025OT-Talk: Animating 3D Talking Head with Optimal Transportationcited by 6
- 2024LeGO: Leveraging a Surface Deformation Network for Animatable Stylized Face Generation with One Examplecited by 4
- 2025Neural Geometry Image-Based Representations with Optimal Transport (OT)cited by 2
Built on by
Not cited yet.