GeoDiff4D: Geometry-Aware Diffusion for 4D Head Avatar Reconstruction
Not on the map. Why?
Abstract (arXiv)
Reconstructing photorealistic and animatable 4D head avatars from a single portrait image remains a fundamental challenge in computer vision. While diffusion models have enabled remarkable progress in image and video generation for avatar reconstruction, existing methods primarily rely on 2D priors and struggle to achieve consistent 3D geometry. We propose a novel framework that leverages geometry-aware diffusion to learn strong geometry priors for high-fidelity head avatar reconstruction. Our approach jointly synthesizes portrait images and corresponding surface normals, while a pose-free expression encoder captures implicit expression representations. Both synthesized images and expression latents are incorporated into 3D Gaussian-based avatars, enabling photorealistic rendering with accurate geometry. Extensive experiments demonstrate that our method substantially outperforms state-of-the-art approaches in visual quality, expression fidelity, and cross-identity generalization, while supporting real-time rendering.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 49 of its 62 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
49 of 62 references.
References · 49
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
37 more
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
- 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 249
- 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
- 2021Neural Head Avatars from Monocular RGB Videoscited by 212
- 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
- 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 186
- 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 183
- 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 171
- 2017Morphable Face Models - An Open Frameworkcited by 138
- 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
- 2025VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Modelscited by 112
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 107
- 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 95
- 2022Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesiscited by 93
- 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
- 2024X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attentioncited by 88
- 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
- 2024EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatarscited by 65
- 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
- 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
- 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44
- 2023High-Fidelity and Freely Controllable Talking Head Video Generationcited by 42
- 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
- 2023VOODOO 3D: Volumetric Portrait Disentanglement for One-Shot 3D Head Reenactmentcited by 33
- 2025X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attentioncited by 26
- 2025HRAvatar: High-Quality and Relightable Gaussian Head Avatarcited by 24
- 2023JointNet: Extending Text-to-Image Diffusion for Dense Distribution Modelingcited by 23
- 2025Pixel3DMM: Versatile Screen-Space Priors for Single-Image 3D Face Reconstructioncited by 20
- 2024VOODOO XP: Expressive One-Shot Head Reenactment for VR Telepresencecited by 19
- 2025MVP4D: Multi-View Portrait Video Diffusion for Animatable 4D Avatarscited by 17
- 2024SurFhead: Affine Rig Blending for Geometrically Accurate 2D Gaussian Surfel Head Avatarscited by 15
- 2025SEGA: Drivable 3D Gaussian Head Avatar from a Single Imagecited by 11
- 2025DAViD: Data-efficient and Accurate Vision Models from Synthetic Datacited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusion
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models
- 2024AnimateMe: 4D Facial Expressions via Diffusion Models
- 2023Gaussian3Diff: 3D Gaussian Diffusion for 3D Full Head Synthesis and Editing
- 2023FitDiff: Robust monocular 3D facial shape and reflectance estimation using Diffusion Models
- 2024RodinHD: High-Fidelity 3D Avatar Generation with Diffusion Models
- 2025IM-Portrait: Learning 3D-aware Video Diffusion for Photorealistic Talking Heads from Monocular Videos
- 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creation