mlsanityData to 14 Oct 2026

SEGA: Drivable 3D Gaussian Head Avatar from a Single Image

arXiv 2504.14373 ↗First posted 19 Apr 2025cs.GR cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

Creating photorealistic 3D head avatars from limited input has become increasingly important for applications in virtual reality, telepresence, and digital entertainment. While recent advances like neural rendering and 3D Gaussian splatting have enabled high-quality digital human avatar creation and animation, most methods rely on multiple images or multi-view inputs, limiting their practicality for real-world use. In this paper, we propose SEGA, a novel approach for Single-imagE-based 3D drivable Gaussian head Avatar creation that combines generalized prior models with a new hierarchical UV-space Gaussian Splatting framework. SEGA seamlessly combines priors derived from large-scale 2D datasets with 3D priors learned from multi-view, multi-expression, and multi-ID data, achieving robust generalization to unseen identities while ensuring 3D consistency across novel viewpoints and expressions. We further present a hierarchical UV-space Gaussian Splatting framework that leverages FLAME-based structural priors and employs a dual-branch architecture to disentangle dynamic and static facial components effectively. The dynamic branch encodes expression-driven fine details, while the static branch focuses on expression-invariant regions, enabling efficient parameter inference and precomputation. This design maximizes the utility of limited 3D data and achieves real-time performance for animation and rendering. Additionally, SEGA performs person-specific fine-tuning to further enhance the fidelity and realism of the generated avatars. Experiments show our method outperforms state-of-the-art approaches in generalization ability, identity preservation, and expression realism, advancing one-shot avatar creation for practical applications.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 70 of its 92 references that are in the map. First posted on arXiv 19 Apr 2025.

Builds on

70 of 92 references.

References · 70

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  7. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  8. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
  9. 2020First Order Motion Model for Image Animationcited by 704
  10. 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 525
  11. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
  12. 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 285
38 more
  1. 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
  2. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
  3. 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 231
  4. 2022Towards Robust Blind Face Restoration with Codebook Lookup Transformercited by 231
  5. 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 203
  6. 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 194
  7. 2018X2Face: A network for controlling face generation by using images, audio, and pose codescited by 189
  8. 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 184
  9. 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 178
  10. 2022Towards Metrical Reconstruction of Human Facescited by 166
  11. 2018Deep Appearance Models for Face Renderingcited by 164
  12. 2022Instant Volumetric Head Avatarscited by 159
  13. 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
  14. 2020MODNet: Real-Time Trimap-Free Portrait Matting via Objective Decompositioncited by 127
  15. 2021Pixel Codec Avatarscited by 127
  16. 2023Relightable Gaussian Codec Avatarscited by 127
  17. 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
  18. 2024Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformercited by 122
  19. 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
  20. 2023ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Renderingcited by 104
  21. 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
  22. 2024Generalizable and Animatable Gaussian Head Avatarcited by 97
  23. 2023SyncTalk: The Devil is in the Synchronization for Talking Head Synthesiscited by 86
  24. 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
  25. 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
  26. 2023HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splattingcited by 70
  27. 2022MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptationcited by 69
  28. 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
  29. 2024TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splattingcited by 60
  30. 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 59
  31. 20243D Gaussian Blendshapes for Head Avatar Animationcited by 58
  32. 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
  33. 2024IDOL: Instant Photorealistic 3D Human Creation from a Single Imagecited by 55
  34. 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 53
  35. 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
  36. 2023LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatarcited by 50
  37. 2022NeuralHOFusion: Neural Volumetric Rendering under Human-object Interactionscited by 44
  38. 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44

50 most cited of 70 All 70 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 7.

11 papers.