HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
3D head animation has seen major quality and runtime improvements over the last few years, particularly empowered by the advances in differentiable rendering and neural radiance fields. Real-time rendering is a highly desirable goal for real-world applications. We propose HeadGaS, a model that uses 3D Gaussian Splats (3DGS) for 3D head reconstruction and animation. In this paper we introduce a hybrid model that extends the explicit 3DGS representation with a base of learnable latent features, which can be linearly blended with low-dimensional parameters from parametric head models to obtain expression-dependent color and opacity values. We demonstrate that HeadGaS delivers state-of-the-art results in real-time inference frame rates, surpassing baselines by up to 2dB, while accelerating rendering speed by over x10.
Key facts. Cited by 60 papers in the map (data through 14 Oct 2026). Builds on 50 of its 63 references that are in the map. First posted on arXiv 5 Dec 2023.
Builds on
50 of 63 references.
References · 50
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
38 more
- 2016An overview of gradient descent optimization algorithmscited by 1,033
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 671
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
- 2015Empirical Evaluation of Rectified Activations in Convolutional Networkcited by 519
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2020BiSeNet V2: Bilateral Network with Guided Aggregation for Real-time Semantic Segmentationcited by 294
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
- 2018Deep Video Portraitscited by 267
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
- 2019Differentiable Surface Splatting for Point-based Geometry Processingcited by 239
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 231
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2021Neural Head Avatars from Monocular RGB Videoscited by 213
- 2022SPARF: Neural Radiance Fields from Sparse and Noisy Posescited by 195
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 194
- 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 184
- 2018Deep Appearance Models for Face Renderingcited by 164
- 2022Instant Volumetric Head Avatarscited by 159
- 2023HUGS: Human Gaussian Splatscited by 154
- 2021Robust High-Resolution Video Matting with Temporal Guidancecited by 137
- 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
- 2021Animatable Neural Radiance Fields from Monocular RGB Videoscited by 109
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
- 2023Human Gaussian Splatting: Real-time Rendering of Animatable Avatarscited by 105
- 2022KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of Keypointscited by 77
- 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
- 2023GaussianHead: High-fidelity Head Avatars with Learnable Gaussian Derivationcited by 46
- 2016Automatic Face Reenactmentcited by 43
- 2023FLARE: Fast Learning of Animatable and Relightable Mesh Avatarscited by 39
Built on by
Citing papers per year: 2023: 1; 2024: 17; 2025: 21; 2026: 21.
60 papers.
Sort:
By area:
- 2024A Survey on 3D Gaussian Splattingcited by 224
- 2024Recent Advances in 3D Gaussian Splattingcited by 131
- 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 113
- 20243D Gaussian as a New Era: A Surveycited by 104
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 78
- 2023SWinGS: Sliding Windows for Dynamic 3D Gaussian Splattingcited by 46
- 2024Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Reviewcited by 41
- 2024MeGA: Hybrid Mesh-Gaussian Head Avatar for High-Fidelity Rendering and Head Editingcited by 38
- 2024Human Hair Reconstruction with Strand-Aligned 3D Gaussianscited by 36
- 2025ArticulatedGS: Self-supervised Digital Twin Modeling of Articulated Objects using 3D Gaussian Splattingcited by 35
- 2024HAHA: Highly Articulated Gaussian Human Avatars with Textured Mesh Priorcited by 31
- 2025RGBAvatar: Reduced Gaussian Blendshapes for Online Modeling of Head Avatarscited by 29
38 more
- 2024PSAvatar: A Point-based Shape Model for Real-Time Head Avatar Animation with 3D Gaussian Splattingcited by 17
- 2024Advancing Extended Reality with 3D Gaussian Splatting: Innovations and Prospectscited by 17
- 20253D Gaussian Head Avatars with Expressive Dynamic Appearances by Compact Tensorial Representationscited by 14
- 2025TaoAvatar: Real-Time Lifelike Full-Body Talking Avatars for Augmented Reality via 3D Gaussian Splattingcited by 11
- 2024Gaussian Deja-vu: Creating Controllable 3D Gaussian Head-Avatars with Enhanced Generalization and Personalization Abilitiescited by 10
- 2024GazeGaussian: High-Fidelity Gaze Redirection with 3D Gaussian Splattingcited by 9
- 2024SplatFace: Gaussian Splat Face Reconstruction Leveraging an Optimizable Surfacecited by 7
- 2025FastAvatar: Instant 3D Gaussian Splatting for Faces from Single Unconstrained Posescited by 7
- 2025PanoLAM: Large Avatar Model for Gaussian Full-Head Synthesis from One-shot Unposed Imagecited by 7
- 2025GaussianAvatar-Editor: Photorealistic Animatable Gaussian Head Avatar Editorcited by 5
- 2025GASPACHO: Gaussian Splatting for Controllable Humans and Objectscited by 5
- 2024Gaussian Head & Shoulders: High Fidelity Neural Upper Body Avatars with Anchor Gaussian Guided Texture Warpingcited by 4
- 2025AHA! Animating Human Avatars in Diverse Scenes with Gaussian Splattingcited by 4
- 2026FastGHA: Generalized Few-Shot 3D Gaussian Head Avatars with Real-Time Animationcited by 4
- 2024Generalizable Neural Human Renderercited by 3
- 2025AvatarMakeup: Realistic Makeup Transfer for 3D Animatable Head Avatarscited by 3
- 2025HyperGaussians: High-Dimensional Gaussian Splatting for High-Fidelity Animatable Face Avatarscited by 3
- 2025GeoAvatar: Adaptive Geometrical Gaussian Splatting for 3D Head Avatarcited by 3
- 2025AGORA: Adversarial Generation Of Real-time Animatable 3D Gaussian Head Avatarscited by 3
- 2024RoGUENeRF: A Robust Geometry-Consistent Universal Enhancer for NeRFcited by 2
- 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentationcited by 2
- 2025DGH: Dynamic Gaussian Haircited by 2
- 2025TexAvatars : Hybrid Texel-3D Representations for Stable Rigging of Photorealistic Gaussian Head Avatarscited by 2
- 2026ESGaussianFace: Emotional and Stylized Audio-Driven Facial Animation via 3D Gaussian Splattingcited by 2
- 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priorscited by 2
- 2026Face Anything: 4D Face Reconstruction from Any Image Sequencecited by 2
- 2025Hybrid Mesh-Gaussian Representation for Efficient Indoor Scene Reconstructioncited by 1
- 2025Few-Shot Identity Adaptation for 3D Talking Heads via Global Gaussian Fieldcited by 1
- 2025ArchitectHead: Continuous Level of Detail Control for 3D Gaussian Head Avatarscited by 1
- 2026ICo3D: An Interactive Conversational 3D Virtual Humancited by 1
- 2026From Blurry to Believable: Enhancing Low-quality Talking Heads with 3D Generative Priorscited by 1
- 2026Multi-view Consistent 3D Gaussian Head Avatars 'without' Multi-view Generationcited by 1
- 2026OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologiescited by 1
- 2025Low-Rank Head Avatar Personalization with Registerscited by 0
- 2025GLVD: Guided Learned Vertex Descentcited by 0
- 2026CaricatureGS: Exaggerating 3D Gaussian Splatting Faces With Gaussian Curvaturecited by 0
- 2026Splat-Portrait: Generalizing Talking Heads with Gaussian Splattingcited by 0
- 2026Lightweight High-Fidelity Low-Bitrate Talking Face Compression for 3D Video Conferencecited by 0
50 most cited of 60 All 60 (JSON)
- 2026One Basis to Animate Them All: Gaussian Blendshape Distillation for Real-Time Avatars1 Oct 2026
- 2026Relightable 3D Avatar Reconstruction with Semantic-Adaptive Motion-Illumination Responses21 Sep 2026
- 2026MGAvatar: Mesh-Bound Gaussians for Head Avatar Geometry and Appearance Modeling11 Sep 2026
- 2026TongueReenact: Geometry-Anchored Tongue Synthesis for Face Reenactment30 Jul 2026
- 2026AugSplat: Radiance Field-Informed Gaussian Splatting for Sparse-View Settings30 Jun 2026
- 2026OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologies6 Jun 2026
- 2026Self-Learning Expression Deformations for Data-Efficient Gaussian Avatars4 Jun 2026
- 2026Splatshot: 3D Face Avatar Generation from a Single Unconstrained Photo31 May 2026
- 2026Multi-view Consistent 3D Gaussian Head Avatars 'without' Multi-view Generation24 May 2026
- 2026Face Anything: 4D Face Reconstruction from Any Image Sequence21 Apr 2026
- 2026Giving Faces Their Feelings Back: Explicit Emotion Control for Feedforward Single-Image 3D Head Avatars16 Apr 2026
- 2026FHAvatar: Fast and High-Fidelity Reconstruction of Face-and-Hair Composable 3D Head Avatar from Few Casual Captures24 Mar 2026
38 more
- 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Field24 Mar 2026
- 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priors18 Mar 2026
- 2026From Blurry to Believable: Enhancing Low-quality Talking Heads with 3D Generative Priors5 Feb 2026
- 2026Lightweight High-Fidelity Low-Bitrate Talking Face Compression for 3D Video Conference29 Jan 2026
- 2026Splat-Portrait: Generalizing Talking Heads with Gaussian Splatting26 Jan 2026
- 2026FastGHA: Generalized Few-Shot 3D Gaussian Head Avatars with Real-Time Animation20 Jan 2026
- 2026ICo3D: An Interactive Conversational 3D Virtual Human19 Jan 2026
- 2026CaricatureGS: Exaggerating 3D Gaussian Splatting Faces With Gaussian Curvature6 Jan 2026
- 2026ESGaussianFace: Emotional and Stylized Audio-Driven Facial Animation via 3D Gaussian Splatting5 Jan 2026
- 2025TexAvatars : Hybrid Texel-3D Representations for Stable Rigging of Photorealistic Gaussian Head Avatars24 Dec 2025
- 2025DGH: Dynamic Gaussian Hair18 Dec 2025
- 2025AGORA: Adversarial Generation Of Real-time Animatable 3D Gaussian Head Avatars6 Dec 2025
- 2025AHA! Animating Human Avatars in Diverse Scenes with Gaussian Splatting13 Nov 2025
- 2025GLVD: Guided Learned Vertex Descent7 Oct 2025
- 2025ArchitectHead: Continuous Level of Detail Control for 3D Gaussian Head Avatars7 Oct 2025
- 2025PanoLAM: Large Avatar Model for Gaussian Full-Head Synthesis from One-shot Unposed Image9 Sep 2025
- 2025FastAvatar: Instant 3D Gaussian Splatting for Faces from Single Unconstrained Poses25 Aug 2025
- 2025GeoAvatar: Adaptive Geometrical Gaussian Splatting for 3D Head Avatar24 Jul 2025
- 2025HyperGaussians: High-Dimensional Gaussian Splatting for High-Fidelity Animatable Face Avatars3 Jul 2025
- 2025AvatarMakeup: Realistic Makeup Transfer for 3D Animatable Head Avatars3 Jul 2025
- 2025Few-Shot Identity Adaptation for 3D Talking Heads via Global Gaussian Field27 Jun 2025
- 2025Hybrid Mesh-Gaussian Representation for Efficient Indoor Scene Reconstruction8 Jun 2025
- 2025Low-Rank Head Avatar Personalization with Registers2 Jun 2025
- 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentation8 May 2025
- 20253D Gaussian Head Avatars with Expressive Dynamic Appearances by Compact Tensorial Representations21 Apr 2025
- 2025TaoAvatar: Real-Time Lifelike Full-Body Talking Avatars for Augmented Reality via 3D Gaussian Splatting21 Mar 2025
- 2025RGBAvatar: Reduced Gaussian Blendshapes for Online Modeling of Head Avatars17 Mar 2025
- 2025GASPACHO: Gaussian Splatting for Controllable Humans and Objects12 Mar 2025
- 2025ArticulatedGS: Self-supervised Digital Twin Modeling of Articulated Objects using 3D Gaussian Splatting11 Mar 2025
- 2025GaussianAvatar-Editor: Photorealistic Animatable Gaussian Head Avatar Editor17 Jan 2025
- 2024Advancing Extended Reality with 3D Gaussian Splatting: Innovations and Prospects9 Dec 2024
- 2024GazeGaussian: High-Fidelity Gaze Redirection with 3D Gaussian Splatting20 Nov 2024
- 2024Gaussian Deja-vu: Creating Controllable 3D Gaussian Head-Avatars with Enhanced Generalization and Personalization Abilities23 Sep 2024
- 2024Human Hair Reconstruction with Strand-Aligned 3D Gaussians23 Sep 2024
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunities24 Jul 2024
- 2024Gaussian Head & Shoulders: High Fidelity Neural Upper Body Avatars with Anchor Gaussian Guided Texture Warping20 May 2024
- 2024Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Review6 May 2024
- 2024MeGA: Hybrid Mesh-Gaussian Head Avatar for High-Fidelity Rendering and Head Editing29 Apr 2024
50 newest of 60 All 60 (JSON)
- 2025AvatarMakeup: Realistic Makeup Transfer for 3D Animatable Head Avatarscited by 3
- 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentationcited by 2
- 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priorscited by 2
- 2026Splatshot: 3D Face Avatar Generation from a Single Unconstrained Photocited by 0
- 2026Splatshot: 3D Face Avatar Generation from a Single Unconstrained Photo31 May 2026
- 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priors18 Mar 2026
- 2025AvatarMakeup: Realistic Makeup Transfer for 3D Animatable Head Avatars3 Jul 2025
- 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentation8 May 2025
- 2024A Survey on 3D Gaussian Splattingcited by 224
- 2024Recent Advances in 3D Gaussian Splattingcited by 131
- 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 113
- 20243D Gaussian as a New Era: A Surveycited by 104
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 78
- 2023SWinGS: Sliding Windows for Dynamic 3D Gaussian Splattingcited by 46
- 2024Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Reviewcited by 41
- 2024MeGA: Hybrid Mesh-Gaussian Head Avatar for High-Fidelity Rendering and Head Editingcited by 38
- 2024Human Hair Reconstruction with Strand-Aligned 3D Gaussianscited by 36
- 2025ArticulatedGS: Self-supervised Digital Twin Modeling of Articulated Objects using 3D Gaussian Splattingcited by 35
- 2024HAHA: Highly Articulated Gaussian Human Avatars with Textured Mesh Priorcited by 31
- 2025RGBAvatar: Reduced Gaussian Blendshapes for Online Modeling of Head Avatarscited by 29
12 most cited of 56 All 56 (JSON)
- 2026One Basis to Animate Them All: Gaussian Blendshape Distillation for Real-Time Avatars1 Oct 2026
- 2026Relightable 3D Avatar Reconstruction with Semantic-Adaptive Motion-Illumination Responses21 Sep 2026
- 2026MGAvatar: Mesh-Bound Gaussians for Head Avatar Geometry and Appearance Modeling11 Sep 2026
- 2026TongueReenact: Geometry-Anchored Tongue Synthesis for Face Reenactment30 Jul 2026
- 2026AugSplat: Radiance Field-Informed Gaussian Splatting for Sparse-View Settings30 Jun 2026
- 2026OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologies6 Jun 2026
- 2026Self-Learning Expression Deformations for Data-Efficient Gaussian Avatars4 Jun 2026
- 2026Multi-view Consistent 3D Gaussian Head Avatars 'without' Multi-view Generation24 May 2026
- 2026Face Anything: 4D Face Reconstruction from Any Image Sequence21 Apr 2026
- 2026Giving Faces Their Feelings Back: Explicit Emotion Control for Feedforward Single-Image 3D Head Avatars16 Apr 2026
- 2026FHAvatar: Fast and High-Fidelity Reconstruction of Face-and-Hair Composable 3D Head Avatar from Few Casual Captures24 Mar 2026
- 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Field24 Mar 2026
12 newest of 56 All 56 (JSON)