mlsanityData to 14 Oct 2026

Gaussian3Diff: 3D Gaussian Diffusion for 3D Full Head Synthesis and Editing

arXiv 2312.03763 ↗First posted 5 Dec 2023cs.CV cs.GR cs.LGcited by 22

Not on the map. Why?

Abstract (arXiv)

We present a novel framework for generating photorealistic 3D human head and subsequently manipulating and reposing them with remarkable flexibility. The proposed approach leverages an implicit function representation of 3D human heads, employing 3D Gaussians anchored on a parametric face model. To enhance representational capabilities and encode spatial information, we embed a lightweight tri-plane payload within each Gaussian rather than directly storing color and opacity. Additionally, we parameterize the Gaussians in a 2D UV space via a 3DMM, enabling effective utilization of the diffusion model for 3D head avatar generation. Our method facilitates the creation of diverse and realistic 3D human heads with fine-grained editing over facial features and expressions. Extensive experiments demonstrate the effectiveness of our method.

Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Builds on 64 of its 78 references that are in the map. First posted on arXiv 5 Dec 2023.

Builds on

64 of 78 references.

References · 64

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  8. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  9. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  11. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  12. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
38 more
  1. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  2. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  3. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  4. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  5. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  6. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  7. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
  8. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  9. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  10. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
  11. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
  12. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  13. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
  14. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  15. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
  16. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
  17. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  18. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  19. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
  20. 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 349
  21. 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
  22. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  23. 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
  24. 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
  25. 20223D Neural Field Generation using Triplane Diffusioncited by 274
  26. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 274
  27. 2021DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effortcited by 264
  28. 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 231
  29. 2020Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulationcited by 225
  30. 2021Neural Head Avatars from Monocular RGB Videoscited by 213
  31. 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
  32. 2022From data to functa: Your data point is a function and you can treat it like onecited by 187
  33. 2018Escaping Plato's Cave: 3D Shape From Adversarial Renderingcited by 170
  34. 2018Deep Appearance Models for Face Renderingcited by 164
  35. 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generationcited by 162
  36. 2017Optimizing the Latent Space of Generative Networkscited by 157
  37. 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
  38. 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 9; 2025: 10; 2026: 3.

22 papers.

Sort:

By area:

  1. 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 92
  2. 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformercited by 82
  3. 2025Amodal3R: Amodal 3D Reconstruction from Occluded 2D Imagescited by 54
  4. 2024GaussianHeads: End-to-End Learning of Drivable Gaussian Head Avatars from Coarse-to-fine Representationscited by 31
  5. 2024Gaussian Splatting Decoder for 3D-aware Generative Adversarial Networkscited by 14
  6. 2025Synthetic Prior for Few-Shot Drivable Head Avatar Inversioncited by 14
  7. 2024GaussianAnything: Interactive Point Cloud Flow Matching For 3D Object Generationcited by 12
  8. 2025SEGA: Drivable 3D Gaussian Head Avatar from a Single Imagecited by 11
  9. 2024Gaussian Deja-vu: Creating Controllable 3D Gaussian Head-Avatars with Enhanced Generalization and Personalization Abilitiescited by 10
  10. 2025CGS-GAN: 3D Consistent Gaussian Splatting GANs for High Resolution Human Head Synthesiscited by 6
  11. 2024Towards Native Generative Model for 3D Head Avatarcited by 5
  12. 2025Generative Human Geometry Distributioncited by 5
10 more
  1. 2024Single Image, Any Face: Generalisable 3D Face Generationcited by 4
  2. 2025FRIDU: Functional Map Refinement with Guided Image Diffusioncited by 4
  3. 2024Generalizable Neural Human Renderercited by 3
  4. 2025Controlling Avatar Diffusion with Learnable Gaussian Embeddingcited by 3
  5. 2025SpinMeRound: Consistent Multi-View Identity Generation Using Diffusion Modelscited by 3
  6. 2024Pomo3D: 3D-Aware Portrait Accessorizing and Morecited by 0
  7. 2025Disentangling 3D from Large Vision-Language Models for Controlled Portrait Generationcited by 0
  8. 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Fieldcited by 0
  9. 20263DRealHead: Few-Shot Detailed Head Avatarcited by 0
  10. 2026COSY: Compositional 3DGS Synthesis for Disentangled Human Head Editingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Edit3DGS: Unified Framework for Dynamic Head Editing via 2D Instruction-Guided Diffusion and 3D Gaussian Splatting
  2. 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models
  3. 2026GeoDiff4D: Geometry-Aware Diffusion for 4D Head Avatar Reconstruction
  4. 2026FastGHA: Generalized Few-Shot 3D Gaussian Head Avatars with Real-Time Animation
  5. 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusion
  6. 2026FiCA: Feed-forward instant Gaussian Codec Avatars from a Single Portrait Image
  7. 2023Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Models
  8. 2024HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splatting