GaussianHead: High-fidelity Head Avatars with Learnable Gaussian Derivation
Not on the map. Why?
Abstract (arXiv)
Constructing vivid 3D head avatars for given subjects and realizing a series of animations on them is valuable yet challenging. This paper presents GaussianHead, which models the actional human head with anisotropic 3D Gaussians. In our framework, a motion deformation field and multi-resolution tri-plane are constructed respectively to deal with the head's dynamic geometry and complex texture. Notably, we impose an exclusive derivation scheme on each Gaussian, which generates its multiple doppelgangers through a set of learnable parameters for position transformation. With this design, we can compactly and accurately encode the appearance information of Gaussians, even those fitting the head's particular components with sophisticated structures. In addition, an inherited derivation strategy for newly added Gaussians is adopted to facilitate training acceleration. Extensive experiments show that our method can produce high-fidelity renderings, outperforming state-of-the-art approaches in reconstruction, cross-identity reenactment, and novel view synthesis tasks. Our code is available at: https://github.com/chiehwangs/gaussian-head.
Key facts. Cited by 46 papers in the map (data through 7 Oct 2026). Builds on 43 of its 67 references that are in the map. First posted on arXiv 4 Dec 2023.
Builds on
43 of 67 references.
References · 43
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2020Convolutional Occupancy Networkscited by 760
31 more
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
- 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 220
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
- 2018Riemannian Adaptive Optimization Methodscited by 187
- 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 183
- 2022Instant Volumetric Head Avatarscited by 157
- 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 151
- 2017Morphable Face Models - An Open Frameworkcited by 138
- 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
- 2020MODNet: Real-Time Trimap-Free Portrait Matting via Objective Decompositioncited by 127
- 2023GART: Gaussian Articulated Template Modelscited by 121
- 2023PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360circcited by 93
- 2023SyncTalk: The Devil is in the Synchronization for Talking Head Synthesiscited by 86
- 2022Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decompositioncited by 81
- 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
- 2023Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesiscited by 72
- 2023NOFA: NeRF-based One-shot Facial Avatar Reconstructioncited by 53
- 2023LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatarcited by 50
- 2021PU-Flow: a Point Cloud Upsampling Network with Normalizing Flowscited by 17
- 2021Learning to Aggregate and Personalize 3D Face from In-the-Wild Photo Collectioncited by 16
- 2023Single-Shot Implicit Morphable Faces with Consistent Texture Parameterizationcited by 16
- 2023HQ3DAvatar: High Quality Controllable 3D Head Avatarcited by 9
- 2023Canonical Factors for Hybrid Neural Fieldscited by 8
Built on by
Citing papers per year: 2023: 1; 2024: 20; 2025: 10; 2026: 15.
46 papers.
Sort:
By area:
- 2024Recent Advances in 3D Gaussian Splattingcited by 130
- 20243D Gaussian as a New Era: A Surveycited by 102
- 2023HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splattingcited by 60
- 2024TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splattingcited by 60
- 20243D Gaussian Blendshapes for Head Avatar Animationcited by 58
- 2024MeGA: Hybrid Mesh-Gaussian Head Avatar for High-Fidelity Rendering and Head Editingcited by 37
- 2025RGBAvatar: Reduced Gaussian Blendshapes for Online Modeling of Head Avatarscited by 27
- 2024GaussianTalker: Speaker-specific Talking Head Synthesis via 3D Gaussian Splattingcited by 24
- 2024GaussianTalker: Real-Time High-Fidelity Talking Head Synthesis with Audio-Driven 3D Gaussian Splattingcited by 17
- 2024Tri2-plane: Thinking Head Avatar via Feature Pyramidcited by 16
- 2024Portrait3D: Text-Guided High-Quality 3D Portrait Generation Using Pyramid Representation and GANs Priorcited by 15
- 2024Portrait Video Editing Empowered by Multimodal Generative Priorscited by 12
34 more
- 2025SOAP: Style-Omniscient Animatable Portraitscited by 11
- 2024GPHM: Gaussian Parametric Head Model for Monocular Head Avatar Reconstructioncited by 10
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlookcited by 10
- 2024EGGS: Edge Guided Gaussian Splatting for Radiance Fieldscited by 9
- 2025EVA: Expressive Virtual Avatars from Multi-view Videoscited by 7
- 2024GaussianStyle: Gaussian Head Avatar via StyleGANcited by 6
- 2025FastAvatar: Towards Unified and Fast 3D Avatar Reconstruction with Large Gaussian Reconstruction Transformerscited by 6
- 2024Towards Native Generative Model for 3D Head Avatarcited by 5
- 2024Gaussian Head & Shoulders: High Fidelity Neural Upper Body Avatars with Anchor Gaussian Guided Texture Warpingcited by 4
- 2024MI-NeRF: Learning a Single Face NeRF from Multiple Identitiescited by 3
- 2025GaussianAvatar-Editor: Photorealistic Animatable Gaussian Head Avatar Editorcited by 3
- 2024GS2Pose: Two-stage 6D Object Pose Estimation Guided by Gaussian Splattingcited by 2
- 2025GaussianHeadTalk: Wobble-Free 3D Talking Heads with Audio Driven Gaussian Splattingcited by 2
- 2026ESGaussianFace: Emotional and Stylized Audio-Driven Facial Animation via 3D Gaussian Splattingcited by 2
- 2025ArchitectHead: Continuous Level of Detail Control for 3D Gaussian Head Avatarscited by 1
- 2026MANGO:Natural Multi-speaker 3D Talking Head Generation via 2D-Lifted Enhancementcited by 1
- 2026Toward Fine-Grained Facial Control in 3D Talking Head Generationcited by 1
- 2026Face Anything: 4D Face Reconstruction from Any Image Sequencecited by 1
- 2024GDGS: Gradient Domain Gaussian Splatting for Sparse Representation of Radiance Fieldscited by 0
- 2024Towards More Accurate Fake Detection on Images Generated from Advanced Generative and Neural Rendering Modelscited by 0
- 2025Low-Rank Head Avatar Personalization with Registerscited by 0
- 2025MoGaFace: Momentum-Guided and Texture-Aware Gaussian Avatars for Consistent Facial Geometrycited by 0
- 2025Using Gaussian Splats to Create High-Fidelity Facial Geometry and Texturecited by 0
- 2026LiftAvatar: Kinematic-Space Completion for Expression-Controlled 3D Gaussian Avatar Animationcited by 0
- 2026Fast and Robust Deformable 3D Gaussian Splattingcited by 0
- 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Fieldcited by 0
- 2026FHAvatar: Fast and High-Fidelity Reconstruction of Face-and-Hair Composable 3D Head Avatar from Few Casual Capturescited by 0
- 2026Giving Faces Their Feelings Back: Explicit Emotion Control for Feedforward Single-Image 3D Head Avatarscited by 0
- 2026GazePrior: Zero-Shot AR/VR Eye Tracking via Learned 3D Gaze Reconstructioncited by 0
- 2026LentiAvatar: Pseudo-Multiview Reconstruction and Subpixel Prism Rendering for Real-Time Stereoscopic Communicationcited by 0
- 2026FFAvatar: Feed-Forward 4D Head Avatar Reconstruction from Sparse Portrait Imagescited by 0
- 2026Head Avatars with Dynamic Explicit Haircited by 0
- 2026PD-GS: Phoneme-Driven 3DGS for Audio-Driven Talking Headscited by 0
- 2026MGAvatar: Mesh-Bound Gaussians for Head Avatar Geometry and Appearance Modelingcited by 0
- 2026MGAvatar: Mesh-Bound Gaussians for Head Avatar Geometry and Appearance Modeling11 Sep 2026
- 2026PD-GS: Phoneme-Driven 3DGS for Audio-Driven Talking Heads5 Aug 2026
- 2026Head Avatars with Dynamic Explicit Hair26 Jul 2026
- 2026FFAvatar: Feed-Forward 4D Head Avatar Reconstruction from Sparse Portrait Images29 Jun 2026
- 2026LentiAvatar: Pseudo-Multiview Reconstruction and Subpixel Prism Rendering for Real-Time Stereoscopic Communication9 Jun 2026
- 2026GazePrior: Zero-Shot AR/VR Eye Tracking via Learned 3D Gaze Reconstruction21 May 2026
- 2026Face Anything: 4D Face Reconstruction from Any Image Sequence21 Apr 2026
- 2026Giving Faces Their Feelings Back: Explicit Emotion Control for Feedforward Single-Image 3D Head Avatars16 Apr 2026
- 2026FHAvatar: Fast and High-Fidelity Reconstruction of Face-and-Hair Composable 3D Head Avatar from Few Casual Captures24 Mar 2026
- 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Field24 Mar 2026
- 2026Fast and Robust Deformable 3D Gaussian Splatting21 Mar 2026
- 2026LiftAvatar: Kinematic-Space Completion for Expression-Controlled 3D Gaussian Avatar Animation2 Mar 2026
34 more
- 2026Toward Fine-Grained Facial Control in 3D Talking Head Generation10 Feb 2026
- 2026ESGaussianFace: Emotional and Stylized Audio-Driven Facial Animation via 3D Gaussian Splatting5 Jan 2026
- 2026MANGO:Natural Multi-speaker 3D Talking Head Generation via 2D-Lifted Enhancement5 Jan 2026
- 2025Using Gaussian Splats to Create High-Fidelity Facial Geometry and Texture18 Dec 2025
- 2025GaussianHeadTalk: Wobble-Free 3D Talking Heads with Audio Driven Gaussian Splatting11 Dec 2025
- 2025ArchitectHead: Continuous Level of Detail Control for 3D Gaussian Head Avatars7 Oct 2025
- 2025FastAvatar: Towards Unified and Fast 3D Avatar Reconstruction with Large Gaussian Reconstruction Transformers27 Aug 2025
- 2025MoGaFace: Momentum-Guided and Texture-Aware Gaussian Avatars for Consistent Facial Geometry2 Aug 2025
- 2025Low-Rank Head Avatar Personalization with Registers2 Jun 2025
- 2025EVA: Expressive Virtual Avatars from Multi-view Videos21 May 2025
- 2025SOAP: Style-Omniscient Animatable Portraits8 May 2025
- 2025RGBAvatar: Reduced Gaussian Blendshapes for Online Modeling of Head Avatars17 Mar 2025
- 2025GaussianAvatar-Editor: Photorealistic Animatable Gaussian Head Avatar Editor17 Jan 2025
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlook29 Nov 2024
- 2024Towards More Accurate Fake Detection on Images Generated from Advanced Generative and Neural Rendering Models13 Nov 2024
- 2024GS2Pose: Two-stage 6D Object Pose Estimation Guided by Gaussian Splatting6 Nov 2024
- 2024Towards Native Generative Model for 3D Head Avatar2 Oct 2024
- 2024Portrait Video Editing Empowered by Multimodal Generative Priors20 Sep 2024
- 2024GPHM: Gaussian Parametric Head Model for Monocular Head Avatar Reconstruction21 Jul 2024
- 2024Gaussian Head & Shoulders: High Fidelity Neural Upper Body Avatars with Anchor Gaussian Guided Texture Warping20 May 2024
- 2024GDGS: Gradient Domain Gaussian Splatting for Sparse Representation of Radiance Fields8 May 2024
- 20243D Gaussian Blendshapes for Head Avatar Animation30 Apr 2024
- 2024MeGA: Hybrid Mesh-Gaussian Head Avatar for High-Fidelity Rendering and Head Editing29 Apr 2024
- 2024GaussianTalker: Real-Time High-Fidelity Talking Head Synthesis with Audio-Driven 3D Gaussian Splatting24 Apr 2024
- 2024TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splatting23 Apr 2024
- 2024GaussianTalker: Speaker-specific Talking Head Synthesis via 3D Gaussian Splatting22 Apr 2024
- 2024Portrait3D: Text-Guided High-Quality 3D Portrait Generation Using Pyramid Representation and GANs Prior16 Apr 2024
- 2024EGGS: Edge Guided Gaussian Splatting for Radiance Fields14 Apr 2024
- 2024MI-NeRF: Learning a Single Face NeRF from Multiple Identities29 Mar 2024
- 2024Recent Advances in 3D Gaussian Splatting17 Mar 2024
- 20243D Gaussian as a New Era: A Survey11 Feb 2024
- 2024GaussianStyle: Gaussian Head Avatar via StyleGAN1 Feb 2024
- 2024Tri2-plane: Thinking Head Avatar via Feature Pyramid17 Jan 2024
- 2023HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splatting5 Dec 2023
- 2024Recent Advances in 3D Gaussian Splattingcited by 130
- 20243D Gaussian as a New Era: A Surveycited by 102
- 2023HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splattingcited by 60
- 2024TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splattingcited by 60
- 20243D Gaussian Blendshapes for Head Avatar Animationcited by 58
- 2024MeGA: Hybrid Mesh-Gaussian Head Avatar for High-Fidelity Rendering and Head Editingcited by 37
- 2025RGBAvatar: Reduced Gaussian Blendshapes for Online Modeling of Head Avatarscited by 27
- 2024GaussianTalker: Speaker-specific Talking Head Synthesis via 3D Gaussian Splattingcited by 24
- 2024GaussianTalker: Real-Time High-Fidelity Talking Head Synthesis with Audio-Driven 3D Gaussian Splattingcited by 17
- 2024Tri2-plane: Thinking Head Avatar via Feature Pyramidcited by 16
- 2024Portrait Video Editing Empowered by Multimodal Generative Priorscited by 12
- 2024GPHM: Gaussian Parametric Head Model for Monocular Head Avatar Reconstructioncited by 10
12 most cited of 43 All 43 (JSON)
- 2026MGAvatar: Mesh-Bound Gaussians for Head Avatar Geometry and Appearance Modeling11 Sep 2026
- 2026PD-GS: Phoneme-Driven 3DGS for Audio-Driven Talking Heads5 Aug 2026
- 2026Head Avatars with Dynamic Explicit Hair26 Jul 2026
- 2026FFAvatar: Feed-Forward 4D Head Avatar Reconstruction from Sparse Portrait Images29 Jun 2026
- 2026LentiAvatar: Pseudo-Multiview Reconstruction and Subpixel Prism Rendering for Real-Time Stereoscopic Communication9 Jun 2026
- 2026GazePrior: Zero-Shot AR/VR Eye Tracking via Learned 3D Gaze Reconstruction21 May 2026
- 2026Face Anything: 4D Face Reconstruction from Any Image Sequence21 Apr 2026
- 2026Giving Faces Their Feelings Back: Explicit Emotion Control for Feedforward Single-Image 3D Head Avatars16 Apr 2026
- 2026FHAvatar: Fast and High-Fidelity Reconstruction of Face-and-Hair Composable 3D Head Avatar from Few Casual Captures24 Mar 2026
- 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Field24 Mar 2026
- 2026Fast and Robust Deformable 3D Gaussian Splatting21 Mar 2026
- 2026LiftAvatar: Kinematic-Space Completion for Expression-Controlled 3D Gaussian Avatar Animation2 Mar 2026
12 newest of 43 All 43 (JSON)