mlsanityData to 7 Oct 2026

GeoDiff4D: Geometry-Aware Diffusion for 4D Head Avatar Reconstruction

arXiv 2602.24161 ↗First posted 27 Feb 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Reconstructing photorealistic and animatable 4D head avatars from a single portrait image remains a fundamental challenge in computer vision. While diffusion models have enabled remarkable progress in image and video generation for avatar reconstruction, existing methods primarily rely on 2D priors and struggle to achieve consistent 3D geometry. We propose a novel framework that leverages geometry-aware diffusion to learn strong geometry priors for high-fidelity head avatar reconstruction. Our approach jointly synthesizes portrait images and corresponding surface normals, while a pose-free expression encoder captures implicit expression representations. Both synthesized images and expression latents are incorporated into 3D Gaussian-based avatars, enabling photorealistic rendering with accurate geometry. Extensive experiments demonstrate that our method substantially outperforms state-of-the-art approaches in visual quality, expression fidelity, and cross-identity generalization, while supporting real-time rendering.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 49 of its 62 references that are in the map. First posted on arXiv 27 Feb 2026.

Builds on

49 of 62 references.

References · 49

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  6. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  7. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  8. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  9. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  10. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  11. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
  12. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
37 more
  1. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
  2. 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 249
  3. 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
  4. 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
  5. 2021Neural Head Avatars from Monocular RGB Videoscited by 212
  6. 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
  7. 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
  8. 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 186
  9. 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 183
  10. 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 171
  11. 2017Morphable Face Models - An Open Frameworkcited by 138
  12. 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
  13. 2025VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Modelscited by 112
  14. 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 107
  15. 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
  16. 2024Generalizable and Animatable Gaussian Head Avatarcited by 95
  17. 2022Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesiscited by 93
  18. 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
  19. 2024X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attentioncited by 88
  20. 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
  21. 2024EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatarscited by 65
  22. 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
  23. 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
  24. 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
  25. 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44
  26. 2023High-Fidelity and Freely Controllable Talking Head Video Generationcited by 42
  27. 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
  28. 2023VOODOO 3D: Volumetric Portrait Disentanglement for One-Shot 3D Head Reenactmentcited by 33
  29. 2025X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attentioncited by 26
  30. 2025HRAvatar: High-Quality and Relightable Gaussian Head Avatarcited by 24
  31. 2023JointNet: Extending Text-to-Image Diffusion for Dense Distribution Modelingcited by 23
  32. 2025Pixel3DMM: Versatile Screen-Space Priors for Single-Image 3D Face Reconstructioncited by 20
  33. 2024VOODOO XP: Expressive One-Shot Head Reenactment for VR Telepresencecited by 19
  34. 2025MVP4D: Multi-View Portrait Video Diffusion for Animatable 4D Avatarscited by 17
  35. 2024SurFhead: Affine Rig Blending for Geometrically Accurate 2D Gaussian Surfel Head Avatarscited by 15
  36. 2025SEGA: Drivable 3D Gaussian Head Avatar from a Single Imagecited by 11
  37. 2025DAViD: Data-efficient and Accurate Vision Models from Synthetic Datacited by 11

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusion
  2. 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models
  3. 2024AnimateMe: 4D Facial Expressions via Diffusion Models
  4. 2023Gaussian3Diff: 3D Gaussian Diffusion for 3D Full Head Synthesis and Editing
  5. 2023FitDiff: Robust monocular 3D facial shape and reflectance estimation using Diffusion Models
  6. 2024RodinHD: High-Fidelity 3D Avatar Generation with Diffusion Models
  7. 2025IM-Portrait: Learning 3D-aware Video Diffusion for Photorealistic Talking Heads from Monocular Videos
  8. 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creation