RegHead: Non-Humanoid Head Blendshapes via Feed-Forward Registration
Not on the map. Why?
Abstract (arXiv)
We present RegHead, a framework for constructing semantic blendshape sets for animatable non-humanoid head avatars. With a fixed expression vocabulary, semantic blendshapes provide a low-dimensional and interpretable animation interface and support cross-identity retargeting. Building such blendshape sets remains expensive because (i) expression-consistent supervision is scarce, (ii) generated 4D assets typically lack correspondence, and (iii) facial motion is highly localized. We propose (1) a large-scale dataset of non-humanoid identities paired with a shared expression vocabulary, obtained by expanding a small artist-rigged library via fine-tuned image editing; (2) a dense stochastic anchor motion representation tailored to localized facial deformations; and (3) a fast feed-forward registration model that converts unregistered expression meshes into a corresponded blendshape basis by predicting anchor-based deformations from the neutral shape. Experiments show that our approach produces higher-fidelity expression meshes than baselines, while running orders of magnitude faster than optimization. We further demonstrate real-time retargeting from human face tracking signals to non-humanoid characters, capturing both head pose and localized facial motions. Our project page is available at https://snap-research.github.io/RegHead/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 52 references that are in the map. First posted on arXiv 13 Jul 2026.
Builds on
41 of 52 references.
References · 41
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
- 2025Native and Compact Structured Latents for 3D Generationcited by 175
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
- 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 144
29 more
- 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 144
- 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 125
- 20214DComplete: Non-Rigid Motion Estimation Beyond the Observable Surfacecited by 124
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
- 2024STAG4D: Spatial-Temporal Anchored Generative 4D Gaussianscited by 102
- 2024Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Modelscited by 100
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 97
- 2024DreamMesh4D: Video-to-4D Generation with Sparse-Controlled Gaussian-Mesh Hybrid Representationcited by 58
- 20254DGT: Learning a 4D Gaussian Transformer Using Real-World Monocular Videoscited by 49
- 2025SV4D 2.0: Enhancing Spatio-Temporal Consistency in Multi-View Video Diffusion for High-Quality 4D Generationcited by 48
- 2025RigAnything: Template-Free Autoregressive Rigging for Diverse 3D Assetscited by 47
- 2025One Model to Rig Them All: Diverse Skeleton Rigging with UniRigcited by 45
- 2025MagicArticulate: Make Your 3D Models Articulation-Readycited by 43
- 2025LAM: Large Avatar Model for One-shot Animatable Gaussian Headcited by 43
- 2025V2M4: 4D Mesh Animation Reconstruction from a Single Monocular Videocited by 33
- 2024TextToon: Real-Time Text Toonify Head Avatar from Single Videocited by 21
- 2026ActionMesh: Animated 3D Mesh Generation with Temporal 3D Diffusioncited by 16
- 2026Motion 3-to-4: 3D Motion Reconstruction for 4D Synthesiscited by 15
- 2025Drive Any Mesh: 4D Latent Diffusion for Mesh Deformation from Videocited by 12
- 2026Mesh4D: 4D Mesh Reconstruction and Tracking from Monocular Videocited by 12
- 2024HeadEvolver: Text to Head Avatars via Expressive and Attribute-Preserving Mesh Deformationcited by 11
- 2022AgileAvatar: Stylized 3D Avatar Creation via Cascaded Domain Bridgingcited by 10
- 2024SplatFace: Gaussian Splat Face Reconstruction Leveraging an Optimizable Surfacecited by 7
- 2025LIM: Large Interpolator Model for Dynamic Reconstructioncited by 5
- 2026RigMo: Unifying Rig and Motion Learning for Generative Animationcited by 5
- 2024LeGO: Leveraging a Surface Deformation Network for Animatable Stylized Face Generation with One Examplecited by 4
- 2025Snapmoji: Instant Generation of Animatable Dual-Stylized Avatarscited by 2
- 2025T2Bs: Text-to-Character Blendshapes via Video Generationcited by 2
- 2026FFAvatar: Few-Shot, Feed-Forward, and Generalizable Avatar Reconstructioncited by 1
Built on by
Not cited yet.