mlsanityData to 7 Oct 2026

Head3D: Complete 3D Head Generation via Tri-plane Feature Distillation

arXiv 2303.15892 ↗First posted 28 Mar 2023cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Head generation with diverse identities is an important task in computer vision and computer graphics, widely used in multimedia applications. However, current full head generation methods require a large number of 3D scans or multi-view images to train the model, resulting in expensive data acquisition cost. To address this issue, we propose Head3D, a method to generate full 3D heads with limited multi-view images. Specifically, our approach first extracts facial priors represented by tri-planes learned in EG3D, a 3D-aware generative model, and then proposes feature distillation to deliver the 3D frontal faces into complete heads without compromising head integrity. To mitigate the domain gap between the face and head models, we present dual-discriminators to guide the frontal and back head generation, respectively. Our model achieves cost-efficient and diverse complete head generation with photo-realistic renderings and high-quality geometry representations. Extensive experiments demonstrate the effectiveness of our proposed Head3D, both qualitatively and quantitatively.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 52 of its 78 references that are in the map. First posted on arXiv 28 Mar 2023.

Builds on

52 of 78 references.

References · 52

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  5. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  6. 2022Generative Adversarial Networkscited by 5,603
  7. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  8. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  9. 2014FitNets: Hints for Thin Deep Netscited by 1,619
  10. 2018Demystifying MMD GANscited by 1,268
  11. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  12. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
38 more
  1. 2019Relational Knowledge Distillationcited by 873
  2. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  3. 2019Contrastive Representation Distillationcited by 734
  4. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  5. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  6. 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
  7. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
  8. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  9. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
  10. 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
  11. 2019On the Efficacy of Knowledge Distillationcited by 377
  12. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  13. 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
  14. 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
  15. 2021Neural Head Avatars from Monocular RGB Videoscited by 212
  16. 2021GNeRF: GAN-based Neural Radiance Field without Posed Cameracited by 153
  17. 2021CIPS-3D: A 3D-Aware Generator of GANs Based on Conditionally-Independent Pixel Synthesiscited by 149
  18. 2020Knowledge Distillation Meets Self-Supervisioncited by 142
  19. 2017Morphable Face Models - An Open Frameworkcited by 138
  20. 2021FENeRF: Face Editing in Neural Radiance Fieldscited by 112
  21. 2020i3DMM: Deep Implicit 3D Morphable Model of Human Headscited by 109
  22. 20213D-aware Image Synthesis via Learning Structural and Textural Representationscited by 109
  23. 2022EpiGRAF: Rethinking training of 3D GANscited by 108
  24. 2019Towards High-fidelity Nonlinear 3D Face Morphable Modelcited by 91
  25. 2022GIRAFFE HD: A High-Resolution 3D-aware Generative Modelcited by 86
  26. 2021H3D-Net: Few-Shot High-Fidelity 3D Head Reconstructioncited by 81
  27. 2022GRAM-HD: 3D-Consistent Image Generation at High Resolution with Generative Radiance Manifoldscited by 73
  28. 2022Learning Neural Parametric Head Modelscited by 73
  29. 2019Towards a complete 3D morphable model of the human headcited by 63
  30. 2019Combining 3D Morphable Models: A Large scale Face-and-Head Modelcited by 49
  31. 20173D Face Morphable Models "In-the-Wild"cited by 44
  32. 2020GAN Slimming: All-in-One GAN Compression by A Unified Optimization Frameworkcited by 44
  33. 2022Multi-View Consistent Generative Adversarial Networks for 3D-aware Image Synthesiscited by 43
  34. 2020Distilling portable Generative Adversarial Networks for Image Translationcited by 36
  35. 2021Content-Aware GAN Compressioncited by 28
  36. 2020Prime-Aware Adaptive Distillationcited by 27
  37. 2020Slimmable Generative Adversarial Networkscited by 27
  38. 2023LPFF: A Portrait Dataset for Face Generators Across Large Posescited by 22

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year

Citing papers per year: 2023: 3.

3 papers.