mlsanityData to 7 Oct 2026

GaussianHead: High-fidelity Head Avatars with Learnable Gaussian Derivation

arXiv 2312.01632 ↗First posted 4 Dec 2023cs.CVcited by 46

Not on the map. Why?

Abstract (arXiv)

Constructing vivid 3D head avatars for given subjects and realizing a series of animations on them is valuable yet challenging. This paper presents GaussianHead, which models the actional human head with anisotropic 3D Gaussians. In our framework, a motion deformation field and multi-resolution tri-plane are constructed respectively to deal with the head's dynamic geometry and complex texture. Notably, we impose an exclusive derivation scheme on each Gaussian, which generates its multiple doppelgangers through a set of learnable parameters for position transformation. With this design, we can compactly and accurately encode the appearance information of Gaussians, even those fitting the head's particular components with sophisticated structures. In addition, an inherited derivation strategy for newly added Gaussians is adopted to facilitate training acceleration. Extensive experiments show that our method can produce high-fidelity renderings, outperforming state-of-the-art approaches in reconstruction, cross-identity reenactment, and novel view synthesis tasks. Our code is available at: https://github.com/chiehwangs/gaussian-head.

Key facts. Cited by 46 papers in the map (data through 7 Oct 2026). Builds on 43 of its 67 references that are in the map. First posted on arXiv 4 Dec 2023.

Builds on

43 of 67 references.

References · 43

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  5. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  6. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  7. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  8. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  9. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  10. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  11. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  12. 2020Convolutional Occupancy Networkscited by 760
31 more
  1. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  2. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  3. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
  4. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  5. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  6. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
  7. 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
  8. 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
  9. 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
  10. 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 220
  11. 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
  12. 2018Riemannian Adaptive Optimization Methodscited by 187
  13. 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 183
  14. 2022Instant Volumetric Head Avatarscited by 157
  15. 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 151
  16. 2017Morphable Face Models - An Open Frameworkcited by 138
  17. 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
  18. 2020MODNet: Real-Time Trimap-Free Portrait Matting via Objective Decompositioncited by 127
  19. 2023GART: Gaussian Articulated Template Modelscited by 121
  20. 2023PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360circcited by 93
  21. 2023SyncTalk: The Devil is in the Synchronization for Talking Head Synthesiscited by 86
  22. 2022Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decompositioncited by 81
  23. 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
  24. 2023Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesiscited by 72
  25. 2023NOFA: NeRF-based One-shot Facial Avatar Reconstructioncited by 53
  26. 2023LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatarcited by 50
  27. 2021PU-Flow: a Point Cloud Upsampling Network with Normalizing Flowscited by 17
  28. 2021Learning to Aggregate and Personalize 3D Face from In-the-Wild Photo Collectioncited by 16
  29. 2023Single-Shot Implicit Morphable Faces with Consistent Texture Parameterizationcited by 16
  30. 2023HQ3DAvatar: High Quality Controllable 3D Head Avatarcited by 9
  31. 2023Canonical Factors for Hybrid Neural Fieldscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 20; 2025: 10; 2026: 15.

46 papers.

Sort:

By area:

  1. 2024Recent Advances in 3D Gaussian Splattingcited by 130
  2. 20243D Gaussian as a New Era: A Surveycited by 102
  3. 2023HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splattingcited by 60
  4. 2024TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splattingcited by 60
  5. 20243D Gaussian Blendshapes for Head Avatar Animationcited by 58
  6. 2024MeGA: Hybrid Mesh-Gaussian Head Avatar for High-Fidelity Rendering and Head Editingcited by 37
  7. 2025RGBAvatar: Reduced Gaussian Blendshapes for Online Modeling of Head Avatarscited by 27
  8. 2024GaussianTalker: Speaker-specific Talking Head Synthesis via 3D Gaussian Splattingcited by 24
  9. 2024GaussianTalker: Real-Time High-Fidelity Talking Head Synthesis with Audio-Driven 3D Gaussian Splattingcited by 17
  10. 2024Tri2-plane: Thinking Head Avatar via Feature Pyramidcited by 16
  11. 2024Portrait3D: Text-Guided High-Quality 3D Portrait Generation Using Pyramid Representation and GANs Priorcited by 15
  12. 2024Portrait Video Editing Empowered by Multimodal Generative Priorscited by 12
34 more
  1. 2025SOAP: Style-Omniscient Animatable Portraitscited by 11
  2. 2024GPHM: Gaussian Parametric Head Model for Monocular Head Avatar Reconstructioncited by 10
  3. 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlookcited by 10
  4. 2024EGGS: Edge Guided Gaussian Splatting for Radiance Fieldscited by 9
  5. 2025EVA: Expressive Virtual Avatars from Multi-view Videoscited by 7
  6. 2024GaussianStyle: Gaussian Head Avatar via StyleGANcited by 6
  7. 2025FastAvatar: Towards Unified and Fast 3D Avatar Reconstruction with Large Gaussian Reconstruction Transformerscited by 6
  8. 2024Towards Native Generative Model for 3D Head Avatarcited by 5
  9. 2024Gaussian Head & Shoulders: High Fidelity Neural Upper Body Avatars with Anchor Gaussian Guided Texture Warpingcited by 4
  10. 2024MI-NeRF: Learning a Single Face NeRF from Multiple Identitiescited by 3
  11. 2025GaussianAvatar-Editor: Photorealistic Animatable Gaussian Head Avatar Editorcited by 3
  12. 2024GS2Pose: Two-stage 6D Object Pose Estimation Guided by Gaussian Splattingcited by 2
  13. 2025GaussianHeadTalk: Wobble-Free 3D Talking Heads with Audio Driven Gaussian Splattingcited by 2
  14. 2026ESGaussianFace: Emotional and Stylized Audio-Driven Facial Animation via 3D Gaussian Splattingcited by 2
  15. 2025ArchitectHead: Continuous Level of Detail Control for 3D Gaussian Head Avatarscited by 1
  16. 2026MANGO:Natural Multi-speaker 3D Talking Head Generation via 2D-Lifted Enhancementcited by 1
  17. 2026Toward Fine-Grained Facial Control in 3D Talking Head Generationcited by 1
  18. 2026Face Anything: 4D Face Reconstruction from Any Image Sequencecited by 1
  19. 2024GDGS: Gradient Domain Gaussian Splatting for Sparse Representation of Radiance Fieldscited by 0
  20. 2024Towards More Accurate Fake Detection on Images Generated from Advanced Generative and Neural Rendering Modelscited by 0
  21. 2025Low-Rank Head Avatar Personalization with Registerscited by 0
  22. 2025MoGaFace: Momentum-Guided and Texture-Aware Gaussian Avatars for Consistent Facial Geometrycited by 0
  23. 2025Using Gaussian Splats to Create High-Fidelity Facial Geometry and Texturecited by 0
  24. 2026LiftAvatar: Kinematic-Space Completion for Expression-Controlled 3D Gaussian Avatar Animationcited by 0
  25. 2026Fast and Robust Deformable 3D Gaussian Splattingcited by 0
  26. 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Fieldcited by 0
  27. 2026FHAvatar: Fast and High-Fidelity Reconstruction of Face-and-Hair Composable 3D Head Avatar from Few Casual Capturescited by 0
  28. 2026Giving Faces Their Feelings Back: Explicit Emotion Control for Feedforward Single-Image 3D Head Avatarscited by 0
  29. 2026GazePrior: Zero-Shot AR/VR Eye Tracking via Learned 3D Gaze Reconstructioncited by 0
  30. 2026LentiAvatar: Pseudo-Multiview Reconstruction and Subpixel Prism Rendering for Real-Time Stereoscopic Communicationcited by 0
  31. 2026FFAvatar: Feed-Forward 4D Head Avatar Reconstruction from Sparse Portrait Imagescited by 0
  32. 2026Head Avatars with Dynamic Explicit Haircited by 0
  33. 2026PD-GS: Phoneme-Driven 3DGS for Audio-Driven Talking Headscited by 0
  34. 2026MGAvatar: Mesh-Bound Gaussians for Head Avatar Geometry and Appearance Modelingcited by 0