SEGA: Drivable 3D Gaussian Head Avatar from a Single Image
Not on the map. Why?
Abstract (arXiv)
Creating photorealistic 3D head avatars from limited input has become increasingly important for applications in virtual reality, telepresence, and digital entertainment. While recent advances like neural rendering and 3D Gaussian splatting have enabled high-quality digital human avatar creation and animation, most methods rely on multiple images or multi-view inputs, limiting their practicality for real-world use. In this paper, we propose SEGA, a novel approach for Single-imagE-based 3D drivable Gaussian head Avatar creation that combines generalized prior models with a new hierarchical UV-space Gaussian Splatting framework. SEGA seamlessly combines priors derived from large-scale 2D datasets with 3D priors learned from multi-view, multi-expression, and multi-ID data, achieving robust generalization to unseen identities while ensuring 3D consistency across novel viewpoints and expressions. We further present a hierarchical UV-space Gaussian Splatting framework that leverages FLAME-based structural priors and employs a dual-branch architecture to disentangle dynamic and static facial components effectively. The dynamic branch encodes expression-driven fine details, while the static branch focuses on expression-invariant regions, enabling efficient parameter inference and precomputation. This design maximizes the utility of limited 3D data and achieves real-time performance for animation and rendering. Additionally, SEGA performs person-specific fine-tuning to further enhance the fidelity and realism of the generated avatars. Experiments show our method outperforms state-of-the-art approaches in generalization ability, identity preservation, and expression realism, advancing one-shot avatar creation for practical applications.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 70 of its 92 references that are in the map. First posted on arXiv 19 Apr 2025.
Builds on
70 of 92 references.
References · 70
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
- 2020First Order Motion Model for Image Animationcited by 704
- 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 525
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
- 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 285
38 more
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 231
- 2022Towards Robust Blind Face Restoration with Codebook Lookup Transformercited by 231
- 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 203
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 194
- 2018X2Face: A network for controlling face generation by using images, audio, and pose codescited by 189
- 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 184
- 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 178
- 2022Towards Metrical Reconstruction of Human Facescited by 166
- 2018Deep Appearance Models for Face Renderingcited by 164
- 2022Instant Volumetric Head Avatarscited by 159
- 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
- 2020MODNet: Real-Time Trimap-Free Portrait Matting via Objective Decompositioncited by 127
- 2021Pixel Codec Avatarscited by 127
- 2023Relightable Gaussian Codec Avatarscited by 127
- 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
- 2024Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformercited by 122
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
- 2023ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Renderingcited by 104
- 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 97
- 2023SyncTalk: The Devil is in the Synchronization for Talking Head Synthesiscited by 86
- 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
- 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
- 2023HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splattingcited by 70
- 2022MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptationcited by 69
- 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
- 2024TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splattingcited by 60
- 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 59
- 20243D Gaussian Blendshapes for Head Avatar Animationcited by 58
- 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
- 2024IDOL: Instant Photorealistic 3D Human Creation from a Single Imagecited by 55
- 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 53
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
- 2023LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatarcited by 50
- 2022NeuralHOFusion: Neural Volumetric Rendering under Human-object Interactionscited by 44
- 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44
50 most cited of 70 All 70 (JSON)
Built on by
Citing papers per year: 2025: 4; 2026: 7.
11 papers.
- 2025FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervisioncited by 10
- 2025Parametric Gaussian Human Model: Generalizable Prior for Efficient and Realistic Human Avatar Modelingcited by 3
- 2025Bringing Your Portrait to 3D Presencecited by 3
- 2025FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed Deformationcited by 2
- 2026One-Shot Feed-Forward 360circ Animatable Avatar via Inpainted UV-Space Gaussian Modelingcited by 0
- 2026GeoDiff4D: Geometry-Aware Diffusion for 4D Head Avatar Reconstructioncited by 0
- 2026Retrieval-Augmented Gaussian Avatars: Improving Expression Generalizationcited by 0
- 2026DipGuava: Disentangling Personalized Gaussian Features for 3D Head Avatars from Monocular Videocited by 0
- 2026SpatialAvatar-0: High-Quality 4D Head Avatar with Multi-Stage Reconstructioncited by 0
- 2026Split and Drive: Dual-Axis Disentanglement for Real-Time Gaussian Head Avatarscited by 0
- 2026S-Avatar: Diffusion-Guided Gaussian Head Avatars from a Single Imagecited by 0
- 2026S-Avatar: Diffusion-Guided Gaussian Head Avatars from a Single Image30 Jul 2026
- 2026Split and Drive: Dual-Axis Disentanglement for Real-Time Gaussian Head Avatars30 Jul 2026
- 2026SpatialAvatar-0: High-Quality 4D Head Avatar with Multi-Stage Reconstruction14 Jun 2026
- 2026DipGuava: Disentangling Personalized Gaussian Features for 3D Head Avatars from Monocular Video30 Mar 2026
- 2026Retrieval-Augmented Gaussian Avatars: Improving Expression Generalization9 Mar 2026
- 2026GeoDiff4D: Geometry-Aware Diffusion for 4D Head Avatar Reconstruction27 Feb 2026
- 2026One-Shot Feed-Forward 360circ Animatable Avatar via Inpainted UV-Space Gaussian Modeling19 Jan 2026
- 2025FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed Deformation19 Dec 2025
- 2025FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervision17 Dec 2025
- 2025Bringing Your Portrait to 3D Presence27 Nov 2025
- 2025Parametric Gaussian Human Model: Generalizable Prior for Efficient and Realistic Human Avatar Modeling7 Jun 2025