One-shot Compositional 3D Head Avatars with Deformable Hair
Not on the map. Why?
Abstract (arXiv)
We propose a compositional method for constructing a complete 3D head avatar from a single image. Prior one-shot holistic approaches frequently fail to produce realistic hair dynamics during animation, largely due to inadequate decoupling of hair from the facial region, resulting in entangled geometry and unnatural deformations. Our method explicitly decouples hair from the face, modeling these components using distinct deformation paradigms while integrating them into a unified rendering pipeline. Furthermore, by leveraging image-to-3D lifting techniques, we preserve fine-grained textures from the input image to the greatest extent possible, effectively mitigating the common issue of high-frequency information loss in generalized models. Specifically, given a frontal portrait image, we first perform hair removal to obtain a bald image. Both the original image and the bald image are then lifted to dense, detail-rich 3D Gaussian Splatting (3DGS) representations. For the bald 3DGS, we rig it to a FLAME mesh via non-rigid registration with a prior model, enabling natural deformation that follows the mesh triangles during animation. For the hair component, we employ semantic label supervision combined with a boundary-aware reassignment strategy to extract a clean and isolated set of hair Gaussians. To control hair deformation, we introduce a cage structure that supports Position-Based Dynamics (PBD) simulation, allowing realistic and physically plausible transformations of the hair Gaussian primitives under head motion, gravity, and inertial effects. Striking qualitative results, including dynamic animations under diverse head motions, gravity effects, and expressions, showcase substantially more realistic hair behavior alongside faithfully preserved facial details, outperforming state-of-the-art one-shot methods in perceptual realism.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 49 of its 109 references that are in the map. First posted on arXiv 16 Apr 2026.
Builds on
49 of 109 references.
References · 49
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 525
- 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 482
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
- 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 364
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
- 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
- 2022Towards Metrical Reconstruction of Human Facescited by 166
- 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 145
- 2021Pixel Codec Avatarscited by 127
- 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
37 more
- 2022Multiface: A Dataset for Neural Face Renderingcited by 87
- 2022SNUG: Self-Supervised Neural Dynamic Garmentscited by 83
- 2022HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamicscited by 78
- 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
- 2023OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Renderingcited by 67
- 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
- 2023NOFA: NeRF-based One-shot Facial Avatar Reconstructioncited by 53
- 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 53
- 2024GaussianHair: Hair Modeling and Rendering with Light-aware Gaussianscited by 48
- 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
- 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44
- 2025LAM: Large Avatar Model for One-shot Animatable Gaussian Headcited by 43
- 2022Non-rigid Point Cloud Registration with Neural Deformation Pyramidcited by 42
- 2024Human Hair Reconstruction with Strand-Aligned 3D Gaussianscited by 36
- 2024Stable-Hair: Real-World Hair Transfer via Diffusion Modelcited by 35
- 2023VOODOO 3D: Volumetric Portrait Disentanglement for One-Shot 3D Head Reenactmentcited by 33
- 2024GaussianHeads: End-to-End Learning of Drivable Gaussian Head Avatars from Coarse-to-fine Representationscited by 31
- 2023HAAR: Text-Conditioned Generative Model of 3D Strand-based Human Hairstylescited by 30
- 2024FaceLift: Learning Generalizable Single Image 3D Face Reconstruction from Synthetic Headscited by 22
- 2023InvertAvatar: Incremental GAN Inversion for Generalized Head Avatarscited by 19
- 2025MVP4D: Multi-View Portrait Video Diffusion for Animatable 4D Avatarscited by 17
- 2024PERSE: Personalized 3D Generative Avatars from A Single Portraitcited by 15
- 2025AvatarArtist: Open-Domain 4D Avatarizationcited by 15
- 20253D Gaussian Head Avatars with Expressive Dynamic Appearances by Compact Tensorial Representationscited by 14
- 2025ScaffoldAvatar: High-Fidelity Gaussian Avatars with Patch Expressionscited by 12
- 2025FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervisioncited by 10
- 2025Im2Haircut: Single-view Strand-based Hair Reconstruction for Human Avatarscited by 9
- 2020Complementary Dynamicscited by 8
- 20253DGH: 3D Head Generation with Composable Hair and Facecited by 8
- 2024GASP: Gaussian Avatars with Synthetic Priorscited by 7
- 2025HairCUP: Hair Compositional Universal Prior for 3D Gaussian Avatarscited by 7
- 2025Audio-Driven Universal Gaussian Head Avatarscited by 7
- 2025D3-Human: Dynamic Disentangled Digital Human from Monocular Videocited by 6
- 2025FaceCraft4D: Animated 3D Facial Avatar Generation from a Single Imagecited by 5
- 2026UIKA: Fast Universal Head Avatar from Pose-Free Imagescited by 5
- 2025CAGE-GS: High-fidelity Cage Based 3D Gaussian Splatting Deformationcited by 3
- 2025AGORA: Adversarial Generation Of Real-time Animatable 3D Gaussian Head Avatarscited by 3
Built on by
Not cited yet.