mlsanityData to 14 Oct 2026

Identity Preserving 3D Head Stylization with Multiview Score Distillation

arXiv 2411.13536 ↗First posted 20 Nov 2024cs.CV cs.AI cs.GRcited by 2

Not on the map. Why?

Abstract (arXiv)

3D head stylization transforms realistic facial features into artistic representations, enhancing user engagement across gaming and virtual reality applications. While 3D-aware generators have made significant advancements, many 3D stylization methods primarily provide near-frontal views and struggle to preserve the unique identities of original subjects, often resulting in outputs that lack diversity and individuality. This paper addresses these challenges by leveraging the PanoHead model, synthesizing images from a comprehensive 360-degree perspective. We propose a novel framework that employs negative log-likelihood distillation (LD) to enhance identity preservation and improve stylization quality. By integrating multi-view grid score and mirror gradients within the 3D GAN architecture and introducing a score rank weighing technique, our approach achieves substantial qualitative and quantitative improvements. Our findings not only advance the state of 3D head stylization but also provide valuable insights into effective distillation processes between diffusion models and GANs, focusing on the critical issue of identity preservation. Please visit the https://three-bee.github.io/head_stylization for more visuals.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 55 of its 70 references that are in the map. First posted on arXiv 20 Nov 2024.

Builds on

55 of 70 references.

References · 55

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  5. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  8. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  9. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  10. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  11. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  12. 2024Depth Anything V2cited by 1,422
38 more
  1. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  2. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  3. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  4. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
  5. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  6. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  7. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  8. 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
  9. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  10. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  11. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
  12. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  13. 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
  14. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  15. 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
  16. 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
  17. 2021Few-shot Image Generation via Cross-domain Correspondencecited by 207
  18. 2021Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image Synthesiscited by 140
  19. 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
  20. 2020Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domainscited by 96
  21. 2023PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360circcited by 93
  22. 2020Leveraging 2D Data to Learn Textured 3D Mesh Generationcited by 69
  23. 2022Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfercited by 66
  24. 2022High-fidelity 3D GAN Inversion by Pseudo-multi-view Optimizationcited by 65
  25. 2020Convolutional Generation of Textured 3D Meshescited by 52
  26. 2023TriPlaneNet: An Encoder for EG3D Inversioncited by 41
  27. 20233DAvatarGAN: Bridging Domains for Personalized Editable Avatarscited by 38
  28. 2022Diffusion Guided Domain Adaptation of Image Generatorscited by 35
  29. 2023Make Encoder Great Again in 3D GAN Inversion through Geometry and Occlusion-Aware Encodingcited by 35
  30. 2022DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Modelcited by 32
  31. 2024Grid Diffusion Models for Text-to-Video Generationcited by 21
  32. 2023Diverse Inpainting and Editing with GAN Inversioncited by 20
  33. 2023DiffusionGAN3D: Boosting Text-guided 3D Generation and Domain Adaptation by Combining 3D GANs and Diffusion Priorscited by 19
  34. 2023DreamComposer: Controllable 3D Object Generation via Multi-View Conditionscited by 18
  35. 2022Fine Detailed Texture Learning for 3D Meshes with Generative Modelscited by 15
  36. 2023PODIA-3D: Domain Adaptation of 3D Generative Model Across Large Domain Gap Using Pose-Preserved Text-to-Image Diffusioncited by 12
  37. 2023Progressive Learning of 3D Reconstruction Network from 2D GAN Datacited by 10
  38. 2024Real-time 3D-aware Portrait Editing from a Single Imagecited by 10

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Head3D: Complete 3D Head Generation via Tri-plane Feature Distillation
  2. 2024ID-to-3D: Expressive ID-guided 3D Heads via Score Distillation Sampling
  3. 2025SpinMeRound: Consistent Multi-View Identity Generation Using Diffusion Models
  4. 2024ID-Sculpt: ID-aware 3D Head Generation from Single In-the-wild Portrait Image
  5. 2026Structured 3D Latents Are Surprisingly Powerful: Unleashing Generalizable Style with 2D Diffusion
  6. 2025FantasyStyle: Controllable Stylized Distillation for 3D Gaussian Splatting
  7. 2025Data Synthesis with Diverse Styles for Face Recognition via 3DMM-Guided Diffusion
  8. 2025InstaFace: Identity-Preserving Facial Editing with Single Image Inference