GPAvatar: Generalizable and Precise Head Avatar from Image(s)
Not on the map. Why?
Abstract (arXiv)
Head avatar reconstruction, crucial for applications in virtual reality, online meetings, gaming, and film industries, has garnered substantial attention within the computer vision community. The fundamental objective of this field is to faithfully recreate the head avatar and precisely control expressions and postures. Existing methods, categorized into 2D-based warping, mesh-based, and neural rendering approaches, present challenges in maintaining multi-view consistency, incorporating non-facial information, and generalizing to new identities. In this paper, we propose a framework named GPAvatar that reconstructs 3D head avatars from one or several images in a single forward pass. The key idea of this work is to introduce a dynamic point-based expression field driven by a point cloud to precisely and effectively capture expressions. Furthermore, we use a Multi Tri-planes Attention (MTA) fusion module in the tri-planes canonical field to leverage information from multiple input images. The proposed method achieves faithful identity reconstruction, precise expression control, and multi-view consistency, demonstrating promising results for free-viewpoint rendering and novel view synthesis.
Key facts. Cited by 74 papers in the map (data through 7 Oct 2026). Builds on 38 of its 49 references that are in the map. First posted on arXiv 18 Jan 2024.
Builds on
38 of 49 references.
References · 38
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 2020First Order Motion Model for Image Animationcited by 698
- 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 524
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
- 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
26 more
- 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 380
- 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 347
- 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 202
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 174
- 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
- 2022Instant Volumetric Head Avatarscited by 157
- 2017Morphable Face Models - An Open Frameworkcited by 138
- 2022MegaPortraits: One-shot Megapixel Neural Head Avatarscited by 131
- 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
- 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 2020Fast Bi-layer Neural Synthesis of One-Shot Realistic Head Avatarscited by 116
- 2022Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decompositioncited by 81
- 2023One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Fieldcited by 68
- 2023OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Renderingcited by 67
- 2023Real-Time Radiance Fields for Single-Image Portrait View Synthesiscited by 64
- 2023NOFA: NeRF-based One-shot Facial Avatar Reconstructioncited by 53
- 2023LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatarcited by 50
- 2023Learning Personalized High Quality Volumetric Head Avatars from Monocular RGB Videoscited by 44
- 2021FLAME-in-NeRF : Neural control of Radiance Fields for Free View Face Animationcited by 33
- 2023Generalizable One-shot Neural Head Avatarcited by 21
- 2022CoNFies: Controllable Neural Face Avatarscited by 4
Built on by
Citing papers per year: 2024: 10; 2025: 29; 2026: 35.
74 papers.
Sort:
By area:
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 95
- 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
- 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 52
- 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44
- 2025LAM: Large Avatar Model for One-shot Animatable Gaussian Headcited by 43
- 2025ARTalk: Speech-Driven 3D Head Animation via Autoregressive Modelcited by 28
- 2025HRAvatar: High-Quality and Relightable Gaussian Head Avatarcited by 24
- 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatarcited by 22
- 2024VOODOO XP: Expressive One-Shot Head Reenactment for VR Telepresencecited by 19
- 2024MimicTalk: Mimicking a personalized and expressive 3D talking face in minutescited by 16
- 2025AvatarArtist: Open-Domain 4D Avatarizationcited by 15
- 2025SEGA: Drivable 3D Gaussian Head Avatar from a Single Imagecited by 11
38 more
- 2024Gaussian Deja-vu: Creating Controllable 3D Gaussian Head-Avatars with Enhanced Generalization and Personalization Abilitiescited by 10
- 2025Monocular and Generalizable Gaussian Talking Head Animationcited by 10
- 2025UniLS: End-to-End Audio-Driven Avatars for Unified Listening and Speakingcited by 10
- 2025FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervisioncited by 10
- 2025Zero-1-to-A: Zero-Shot One Image to Animatable Head Avatars Using Video Diffusioncited by 9
- 2025SyncTalk++: High-Fidelity and Efficient Synchronized Talking Heads Synthesis Using Gaussian Splattingcited by 9
- 2024DH-FaceVid-1K: A Large-Scale High-Quality Dataset for Face Video Generationcited by 8
- 2025FastAvatar: Instant 3D Gaussian Splatting for Faces from Single Unconstrained Posescited by 7
- 2025PanoLAM: Large Avatar Model for Gaussian Full-Head Synthesis from One-shot Unposed Imagecited by 7
- 2025FastAvatar: Towards Unified and Fast 3D Avatar Reconstruction with Large Gaussian Reconstruction Transformerscited by 6
- 2025FaceCraft4D: Animated 3D Facial Avatar Generation from a Single Imagecited by 5
- 2026UIKA: Fast Universal Head Avatar from Pose-Free Imagescited by 5
- 2025GHOST 2.0: generative high-fidelity one shot transfer of headscited by 4
- 2026FastGHA: Generalized Few-Shot 3D Gaussian Head Avatars with Real-Time Animationcited by 4
- 2024Coherent 3D Portrait Video Reconstruction via Triplane Fusioncited by 3
- 2025Controlling Avatar Diffusion with Learnable Gaussian Embeddingcited by 3
- 2025VASA-3D: Lifelike Audio-Driven Gaussian Head Avatars from a Single Imagecited by 3
- 2025Text-based Animatable 3D Avatars with Morphable Model Alignmentcited by 2
- 2025Total-Editing: Head Avatar with Editable Appearance, Motion, and Lightingcited by 2
- 2025FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed Deformationcited by 2
- 2025Mask-Free Audio-driven Talking Face Generation for Enhanced Visual Quality and Identity Preservationcited by 1
- 2026From Blurry to Believable: Enhancing Low-quality Talking Heads with 3D Generative Priorscited by 1
- 2026OMG-Avatar: One-shot Multi-LOD Gaussian Head Avatarcited by 1
- 2026Feed-forward Gaussian Registration for Head Avatar Creation and Editingcited by 1
- 2026AvatarPointillist: AutoRegressive 4D Gaussian Avatarizationcited by 1
- 2026Any3DAvatar: Fast and High-Quality Full-Head 3D Avatar Reconstruction from Single Portrait Imagecited by 1
- 2026MeshLAM: Feed-Forward One-Shot Animatable Textured Mesh Avatar Reconstructioncited by 1
- 2026FFAvatar: Few-Shot, Feed-Forward, and Generalizable Avatar Reconstructioncited by 1
- 2026Multi-view Consistent 3D Gaussian Head Avatars 'without' Multi-view Generationcited by 1
- 2026FreqFLD: Towards All-in-One Facial Landmark Detection via Frequency Modulationcited by 1
- 2024TimeWalker: Personalized Neural Space for Lifelong Head Avatarscited by 0
- 2024Coherent3D: Coherent 3D Portrait Video Reconstruction via Triplane Fusioncited by 0
- 2025High-Quality 3D Head Reconstruction from Any Single Portrait Imagecited by 0
- 2025Low-Rank Head Avatar Personalization with Registerscited by 0
- 2025Reconstruction and Reenactment Separated Method for Realistic Gaussian Headcited by 0
- 2025SIE3D: Single-Image Expressive 3D Avatar Generation via Semantic Embedding and Perceptual Expression Losscited by 0
- 2025TurboPortrait3D: Single-step diffusion-based fast portrait novel-view synthesiscited by 0
- 2025Instant Expressive Gaussian Head Avatars at Over 100 FPScited by 0
50 most cited of 74 All 74 (JSON)
- 2026GHARP: Real-time Gaussian Head Animation from Large-scale Reconstruction Prior7 Oct 2026
- 2026One Basis to Animate Them All: Gaussian Blendshape Distillation for Real-Time Avatars1 Oct 2026
- 2026Learning Semantic Inpainting for Animatable Gaussian Head Avatars29 Sep 2026
- 2026FreqFLD: Towards All-in-One Facial Landmark Detection via Frequency Modulation9 Sep 2026
- 2026S-Avatar: Diffusion-Guided Gaussian Head Avatars from a Single Image30 Jul 2026
- 2026TongueReenact: Geometry-Anchored Tongue Synthesis for Face Reenactment30 Jul 2026
- 2026Split and Drive: Dual-Axis Disentanglement for Real-Time Gaussian Head Avatars30 Jul 2026
- 2026fMRI2Face: A Full-HD fMRI-Video Dataset and Geometry-Guided Neural Decoding Framework for Dynamic Human Face Reconstruction24 Jul 2026
- 2026FA-LAM: Focus-Aware Large Avatar Model for One-Shot 4D Animatable Gaussian Head23 Jul 2026
- 2026Enhancing Facial Expression Recognition in Head-Mounted Displays with Synthetic Data5 Jul 2026
- 2026FFAvatar: Feed-Forward 4D Head Avatar Reconstruction from Sparse Portrait Images29 Jun 2026
- 2026FiCA: Feed-forward instant Gaussian Codec Avatars from a Single Portrait Image23 Jun 2026
38 more
- 2026SpatialAvatar-0: High-Quality 4D Head Avatar with Multi-Stage Reconstruction14 Jun 2026
- 2026Self-Learning Expression Deformations for Data-Efficient Gaussian Avatars4 Jun 2026
- 2026HumanNOVA: Photorealistic, Universal and Rapid 3D Human Avatar Modeling from a Single Image1 Jun 2026
- 2026Splatshot: 3D Face Avatar Generation from a Single Unconstrained Photo31 May 2026
- 2026CapTalk: Text-Guided Stylization and Speech-Driven 3D Head Animation28 May 2026
- 2026SplitAvatar: One-shot Head Avatar with Autoregressive Gaussian Splitting25 May 2026
- 2026Multi-view Consistent 3D Gaussian Head Avatars 'without' Multi-view Generation24 May 2026
- 2026FFAvatar: Few-Shot, Feed-Forward, and Generalizable Avatar Reconstruction14 May 2026
- 2026Large-Scale High-Quality 3D Gaussian Head Reconstruction from Multi-View Captures5 May 2026
- 2026Personalizing Causal Audio-Driven Facial Motion via Dynamic Multi-modal Retrieval26 Apr 2026
- 2026MeshLAM: Feed-Forward One-Shot Animatable Textured Mesh Avatar Reconstruction23 Apr 2026
- 2026One-shot Compositional 3D Head Avatars with Deformable Hair16 Apr 2026
- 2026Giving Faces Their Feelings Back: Explicit Emotion Control for Feedforward Single-Image 3D Head Avatars16 Apr 2026
- 2026Any3DAvatar: Fast and High-Quality Full-Head 3D Avatar Reconstruction from Single Portrait Image15 Apr 2026
- 2026AvatarPointillist: AutoRegressive 4D Gaussian Avatarization6 Apr 2026
- 2026DipGuava: Disentangling Personalized Gaussian Features for 3D Head Avatars from Monocular Video30 Mar 2026
- 2026Feed-forward Gaussian Registration for Head Avatar Creation and Editing16 Mar 2026
- 2026OMG-Avatar: One-shot Multi-LOD Gaussian Head Avatar2 Mar 2026
- 2026GeoDiff4D: Geometry-Aware Diffusion for 4D Head Avatar Reconstruction27 Feb 2026
- 2026OMEGA-Avatar: One-shot Modeling of 360deg Gaussian Avatars12 Feb 2026
- 2026From Blurry to Believable: Enhancing Low-quality Talking Heads with 3D Generative Priors5 Feb 2026
- 2026FastGHA: Generalized Few-Shot 3D Gaussian Head Avatars with Real-Time Animation20 Jan 2026
- 2026UIKA: Fast Universal Head Avatar from Pose-Free Images12 Jan 2026
- 2025FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed Deformation19 Dec 2025
- 2025Instant Expressive Gaussian Head Avatars at Over 100 FPS18 Dec 2025
- 2025FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervision17 Dec 2025
- 2025VASA-3D: Lifelike Audio-Driven Gaussian Head Avatars from a Single Image16 Dec 2025
- 2025UniLS: End-to-End Audio-Driven Avatars for Unified Listening and Speaking10 Dec 2025
- 2025TurboPortrait3D: Single-step diffusion-based fast portrait novel-view synthesis27 Oct 2025
- 2025SIE3D: Single-Image Expressive 3D Avatar Generation via Semantic Embedding and Perceptual Expression Loss28 Sep 2025
- 2025PanoLAM: Large Avatar Model for Gaussian Full-Head Synthesis from One-shot Unposed Image9 Sep 2025
- 2025Reconstruction and Reenactment Separated Method for Realistic Gaussian Head6 Sep 2025
- 2025FastAvatar: Towards Unified and Fast 3D Avatar Reconstruction with Large Gaussian Reconstruction Transformers27 Aug 2025
- 2025FastAvatar: Instant 3D Gaussian Splatting for Faces from Single Unconstrained Poses25 Aug 2025
- 2025Mask-Free Audio-driven Talking Face Generation for Enhanced Visual Quality and Identity Preservation28 Jul 2025
- 2025SyncTalk++: High-Fidelity and Efficient Synchronized Talking Heads Synthesis Using Gaussian Splatting17 Jun 2025
- 2025Low-Rank Head Avatar Personalization with Registers2 Jun 2025
- 2025Total-Editing: Head Avatar with Editable Appearance, Motion, and Lighting26 May 2025
50 newest of 74 All 74 (JSON)
- 2025AvatarArtist: Open-Domain 4D Avatarizationcited by 15
- 2025Zero-1-to-A: Zero-Shot One Image to Animatable Head Avatars Using Video Diffusioncited by 9
- 2025Controlling Avatar Diffusion with Learnable Gaussian Embeddingcited by 3
- 2025Text-based Animatable 3D Avatars with Morphable Model Alignmentcited by 2
- 2025TurboPortrait3D: Single-step diffusion-based fast portrait novel-view synthesiscited by 0
- 2025Instant Expressive Gaussian Head Avatars at Over 100 FPScited by 0
- 2026Splatshot: 3D Face Avatar Generation from a Single Unconstrained Photocited by 0
- 2026FiCA: Feed-forward instant Gaussian Codec Avatars from a Single Portrait Imagecited by 0
- 2026FiCA: Feed-forward instant Gaussian Codec Avatars from a Single Portrait Image23 Jun 2026
- 2026Splatshot: 3D Face Avatar Generation from a Single Unconstrained Photo31 May 2026
- 2025Instant Expressive Gaussian Head Avatars at Over 100 FPS18 Dec 2025
- 2025TurboPortrait3D: Single-step diffusion-based fast portrait novel-view synthesis27 Oct 2025
- 2025Text-based Animatable 3D Avatars with Morphable Model Alignment22 Apr 2025
- 2025AvatarArtist: Open-Domain 4D Avatarization25 Mar 2025
- 2025Zero-1-to-A: Zero-Shot One Image to Animatable Head Avatars Using Video Diffusion20 Mar 2025
- 2025Controlling Avatar Diffusion with Learnable Gaussian Embedding20 Mar 2025
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 95
- 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
- 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 52
- 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44
- 2025LAM: Large Avatar Model for One-shot Animatable Gaussian Headcited by 43
- 2025ARTalk: Speech-Driven 3D Head Animation via Autoregressive Modelcited by 28
- 2025HRAvatar: High-Quality and Relightable Gaussian Head Avatarcited by 24
- 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatarcited by 22
- 2024VOODOO XP: Expressive One-Shot Head Reenactment for VR Telepresencecited by 19
- 2024MimicTalk: Mimicking a personalized and expressive 3D talking face in minutescited by 16
- 2025SEGA: Drivable 3D Gaussian Head Avatar from a Single Imagecited by 11
- 2024Gaussian Deja-vu: Creating Controllable 3D Gaussian Head-Avatars with Enhanced Generalization and Personalization Abilitiescited by 10
12 most cited of 66 All 66 (JSON)
- 2026GHARP: Real-time Gaussian Head Animation from Large-scale Reconstruction Prior7 Oct 2026
- 2026One Basis to Animate Them All: Gaussian Blendshape Distillation for Real-Time Avatars1 Oct 2026
- 2026Learning Semantic Inpainting for Animatable Gaussian Head Avatars29 Sep 2026
- 2026FreqFLD: Towards All-in-One Facial Landmark Detection via Frequency Modulation9 Sep 2026
- 2026S-Avatar: Diffusion-Guided Gaussian Head Avatars from a Single Image30 Jul 2026
- 2026TongueReenact: Geometry-Anchored Tongue Synthesis for Face Reenactment30 Jul 2026
- 2026Split and Drive: Dual-Axis Disentanglement for Real-Time Gaussian Head Avatars30 Jul 2026
- 2026fMRI2Face: A Full-HD fMRI-Video Dataset and Geometry-Guided Neural Decoding Framework for Dynamic Human Face Reconstruction24 Jul 2026
- 2026FA-LAM: Focus-Aware Large Avatar Model for One-Shot 4D Animatable Gaussian Head23 Jul 2026
- 2026Enhancing Facial Expression Recognition in Head-Mounted Displays with Synthetic Data5 Jul 2026
- 2026FFAvatar: Feed-Forward 4D Head Avatar Reconstruction from Sparse Portrait Images29 Jun 2026
- 2026SpatialAvatar-0: High-Quality 4D Head Avatar with Multi-Stage Reconstruction14 Jun 2026
12 newest of 66 All 66 (JSON)