HRAvatar: High-Quality and Relightable Gaussian Head Avatar
Not on the map. Why?
Abstract (arXiv)
Reconstructing animatable and high-quality 3D head avatars from monocular videos, especially with realistic relighting, is a valuable task. However, the limited information from single-view input, combined with the complex head poses and facial movements, makes this challenging. Previous methods achieve real-time performance by combining 3D Gaussian Splatting with a parametric head model, but the resulting head quality suffers from inaccurate face tracking and limited expressiveness of the deformation model. These methods also fail to produce realistic effects under novel lighting conditions. To address these issues, we propose HRAvatar, a 3DGS-based method that reconstructs high-fidelity, relightable 3D head avatars. HRAvatar reduces tracking errors through end-to-end optimization and better captures individual facial deformations using learnable blendshapes and learnable linear blend skinning. Additionally, it decomposes head appearance into several physical properties and incorporates physically-based shading to account for environmental lighting. Extensive experiments demonstrate that HRAvatar not only reconstructs superior-quality heads but also achieves realistic visual effects under varying lighting conditions.
Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Builds on 68 of its 89 references that are in the map. First posted on arXiv 11 Mar 2025.
Builds on
68 of 89 references.
References · 68
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
38 more
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
- 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 449
- 2023LangSplat: 3D Language Gaussian Splattingcited by 415
- 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 335
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
- 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 252
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 231
- 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 184
- 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 172
- 2022Modeling Indirect Illumination for Inverse Renderingcited by 168
- 2023TensoIR: Tensorial Inverse Renderingcited by 168
- 2022Towards Metrical Reconstruction of Human Facescited by 166
- 2022Instant Volumetric Head Avatarscited by 159
- 2021Robust High-Resolution Video Matting with Temporal Guidancecited by 137
- 2021NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illuminationcited by 135
- 2023Relightable Gaussian Codec Avatarscited by 127
- 2024Gaussian in the Wild: 3D Gaussian Splatting for Unconstrained Image Collectionscited by 117
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
- 2020AvatarMe: Realistically Renderable 3D Facial Reconstruction "in-the-wild"cited by 91
- 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
- 2024SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesiscited by 84
- 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
- 2020Neural Light Transport for Relighting and View Synthesiscited by 73
- 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
- 2024SwitchLight: Co-design of Physics-driven Architecture and Pre-training Framework for Human Portrait Relightingcited by 67
- 2024IntrinsicAnything: Learning Diffusion Priors for Inverse Rendering Under Unknown Illuminationcited by 67
- 20243D Gaussian Splatting with Deferred Reflectioncited by 63
- 20243D Gaussian Blendshapes for Head Avatar Animationcited by 58
- 2024GGHead: Fast and Generalizable 3D Gaussian Headscited by 51
- 2023PoseVocab: Learning Joint-structured Pose Embeddings for Human Avatar Modelingcited by 50
- 2023LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatarcited by 50
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2025: 10; 2026: 15.
25 papers.
Sort:
By area:
- 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatarcited by 22
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2025FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervisioncited by 10
- 2025HyPlaneHead: Rethinking Tri-plane-like Representations in Full-Head Image Synthesiscited by 6
- 2025STAvatar: Soft Binding and Temporal Density Control for Monocular 3D Head Avatars Reconstructioncited by 4
- 2025FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed Deformationcited by 2
- 2025AvatarBack: Back-Head Generation for Complete 3D Avatars from Front-View Imagescited by 1
- 2025ArchitectHead: Continuous Level of Detail Control for 3D Gaussian Head Avatarscited by 1
- 2025GTAvatar: Bridging Gaussian Splatting and Texture Mapping for Relightable and Editable Gaussian Avatarscited by 1
- 2025POLAR: A Portrait OLAT Dataset and Generative Framework for Illumination-Aware Face Modelingcited by 1
- 2026Multi-view Consistent 3D Gaussian Head Avatars 'without' Multi-view Generationcited by 1
- 2026RelightAnyone: A Generalized Relightable 3D Gaussian Head Modelcited by 0
13 more
- 2026Light Up Your Face: A Physically Consistent Dataset and Diffusion Model for Face Fill-Light Enhancementcited by 0
- 2026GeoDiff4D: Geometry-Aware Diffusion for 4D Head Avatar Reconstructioncited by 0
- 2026Giving Faces Their Feelings Back: Explicit Emotion Control for Feedforward Single-Image 3D Head Avatarscited by 0
- 2026LentiAvatar: Pseudo-Multiview Reconstruction and Subpixel Prism Rendering for Real-Time Stereoscopic Communicationcited by 0
- 2026SpatialAvatar-0: High-Quality 4D Head Avatar with Multi-Stage Reconstructioncited by 0
- 2026EMOSH: Expressive Motion and Shape Disentanglement for Human Animationcited by 0
- 20263D FaceShell: Attribute Transfer in 3D Face Avatars as a VLM Defense Mechanismcited by 0
- 2026FlexiAvatar: Unified 3D Gaussian Human Avatars Under Arbitrary Body Visibilitycited by 0
- 2026S-Avatar: Diffusion-Guided Gaussian Head Avatars from a Single Imagecited by 0
- 2026Unwarping the Lens: A Physics-Grounded Approach to Video Glasses Removalcited by 0
- 2026Relightable 3D Avatar Reconstruction with Semantic-Adaptive Motion-Illumination Responsescited by 0
- 2026Heartian: Physiology-Aware Relightable Gaussian Head Avatarcited by 0
- 2026ManifoldSplat: Language-Guided Semantic Shape Editing of 3D Gaussian Head Avatarscited by 0
- 2026ManifoldSplat: Language-Guided Semantic Shape Editing of 3D Gaussian Head Avatars2 Oct 2026
- 2026Heartian: Physiology-Aware Relightable Gaussian Head Avatar22 Sep 2026
- 2026Relightable 3D Avatar Reconstruction with Semantic-Adaptive Motion-Illumination Responses21 Sep 2026
- 2026Unwarping the Lens: A Physics-Grounded Approach to Video Glasses Removal20 Aug 2026
- 2026S-Avatar: Diffusion-Guided Gaussian Head Avatars from a Single Image30 Jul 2026
- 2026FlexiAvatar: Unified 3D Gaussian Human Avatars Under Arbitrary Body Visibility21 Jul 2026
- 20263D FaceShell: Attribute Transfer in 3D Face Avatars as a VLM Defense Mechanism9 Jul 2026
- 2026EMOSH: Expressive Motion and Shape Disentanglement for Human Animation26 Jun 2026
- 2026SpatialAvatar-0: High-Quality 4D Head Avatar with Multi-Stage Reconstruction14 Jun 2026
- 2026LentiAvatar: Pseudo-Multiview Reconstruction and Subpixel Prism Rendering for Real-Time Stereoscopic Communication9 Jun 2026
- 2026Multi-view Consistent 3D Gaussian Head Avatars 'without' Multi-view Generation24 May 2026
- 2026Giving Faces Their Feelings Back: Explicit Emotion Control for Feedforward Single-Image 3D Head Avatars16 Apr 2026
13 more
- 2026GeoDiff4D: Geometry-Aware Diffusion for 4D Head Avatar Reconstruction27 Feb 2026
- 2026Light Up Your Face: A Physically Consistent Dataset and Diffusion Model for Face Fill-Light Enhancement4 Feb 2026
- 2026RelightAnyone: A Generalized Relightable 3D Gaussian Head Model6 Jan 2026
- 2025FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed Deformation19 Dec 2025
- 2025FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervision17 Dec 2025
- 2025POLAR: A Portrait OLAT Dataset and Generative Framework for Illumination-Aware Face Modeling15 Dec 2025
- 2025GTAvatar: Bridging Gaussian Splatting and Texture Mapping for Relightable and Editable Gaussian Avatars9 Dec 2025
- 2025STAvatar: Soft Binding and Temporal Density Control for Monocular 3D Head Avatars Reconstruction25 Nov 2025
- 2025ArchitectHead: Continuous Level of Detail Control for 3D Gaussian Head Avatars7 Oct 2025
- 2025HyPlaneHead: Rethinking Tri-plane-like Representations in Full-Head Image Synthesis20 Sep 2025
- 2025AvatarBack: Back-Head Generation for Complete 3D Avatars from Front-View Images28 Aug 2025
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation13 Aug 2025
- 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatar6 May 2025
- 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatarcited by 22
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2025FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervisioncited by 10
- 2025HyPlaneHead: Rethinking Tri-plane-like Representations in Full-Head Image Synthesiscited by 6
- 2025STAvatar: Soft Binding and Temporal Density Control for Monocular 3D Head Avatars Reconstructioncited by 4
- 2025FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed Deformationcited by 2
- 2025AvatarBack: Back-Head Generation for Complete 3D Avatars from Front-View Imagescited by 1
- 2025ArchitectHead: Continuous Level of Detail Control for 3D Gaussian Head Avatarscited by 1
- 2025GTAvatar: Bridging Gaussian Splatting and Texture Mapping for Relightable and Editable Gaussian Avatarscited by 1
- 2025POLAR: A Portrait OLAT Dataset and Generative Framework for Illumination-Aware Face Modelingcited by 1
- 2026Multi-view Consistent 3D Gaussian Head Avatars 'without' Multi-view Generationcited by 1
- 2026RelightAnyone: A Generalized Relightable 3D Gaussian Head Modelcited by 0
12 most cited of 24 All 24 (JSON)
- 2026ManifoldSplat: Language-Guided Semantic Shape Editing of 3D Gaussian Head Avatars2 Oct 2026
- 2026Heartian: Physiology-Aware Relightable Gaussian Head Avatar22 Sep 2026
- 2026Relightable 3D Avatar Reconstruction with Semantic-Adaptive Motion-Illumination Responses21 Sep 2026
- 2026Unwarping the Lens: A Physics-Grounded Approach to Video Glasses Removal20 Aug 2026
- 2026S-Avatar: Diffusion-Guided Gaussian Head Avatars from a Single Image30 Jul 2026
- 2026FlexiAvatar: Unified 3D Gaussian Human Avatars Under Arbitrary Body Visibility21 Jul 2026
- 20263D FaceShell: Attribute Transfer in 3D Face Avatars as a VLM Defense Mechanism9 Jul 2026
- 2026EMOSH: Expressive Motion and Shape Disentanglement for Human Animation26 Jun 2026
- 2026SpatialAvatar-0: High-Quality 4D Head Avatar with Multi-Stage Reconstruction14 Jun 2026
- 2026LentiAvatar: Pseudo-Multiview Reconstruction and Subpixel Prism Rendering for Real-Time Stereoscopic Communication9 Jun 2026
- 2026Multi-view Consistent 3D Gaussian Head Avatars 'without' Multi-view Generation24 May 2026
- 2026Giving Faces Their Feelings Back: Explicit Emotion Control for Feedforward Single-Image 3D Head Avatars16 Apr 2026
12 newest of 24 All 24 (JSON)