mlsanityData to 14 Oct 2026

Dr.3D: Adapting 3D GANs to Artistic Drawings

arXiv 2211.16798 ↗First posted 30 Nov 2022cs.CV cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

While 3D GANs have recently demonstrated the high-quality synthesis of multi-view consistent images and 3D shapes, they are mainly restricted to photo-realistic human portraits. This paper aims to extend 3D GANs to a different, but meaningful visual form: artistic portrait drawings. However, extending existing 3D GANs to drawings is challenging due to the inevitable geometric ambiguity present in drawings. To tackle this, we present Dr.3D, a novel adaptation approach that adapts an existing 3D GAN to artistic drawings. Dr.3D is equipped with three novel components to handle the geometric ambiguity: a deformation-aware 3D synthesis network, an alternating adaptation of pose estimation and image synthesis, and geometric priors. Experiments show that our approach can successfully adapt 3D GANs to drawings and enable multi-view consistent semantic editing of drawings.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 38 of its 52 references that are in the map. First posted on arXiv 30 Nov 2022.

Builds on

38 of 52 references.

References · 38

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  4. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  5. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  6. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  7. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  8. 2018Demystifying MMD GANscited by 1,293
  9. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  10. 2020Training Generative Adversarial Networks with Limited Datacited by 1,186
  11. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
  12. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
26 more
  1. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  2. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
  3. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 695
  4. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
  5. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  6. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 482
  7. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
  8. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  9. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  10. 2020Closed-Form Factorization of Latent Semantics in GANscited by 408
  11. 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
  12. 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 332
  13. 2020StyleRig: Rigging StyleGAN for 3D Control over Portrait Imagescited by 268
  14. 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
  15. 2021Few-shot Image Generation via Cross-domain Correspondencecited by 207
  16. 2019Unsupervised Learning of Probably Symmetric Deformable 3D Objects from Images in the Wildcited by 180
  17. 2021CIPS-3D: A 3D-Aware Generator of GANs Based on Conditionally-Independent Pixel Synthesiscited by 149
  18. 2020Freeze the Discriminator: a Simple Baseline for Fine-Tuning GANscited by 132
  19. 2019Towards Unsupervised Learning of Generative Models for 3D Controllable Image Synthesiscited by 104
  20. 2020Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Renderingcited by 101
  21. 2020Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domainscited by 96
  22. 2022Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfercited by 66
  23. 2020Do 2D GANs Know 3D Shape? Unsupervised 3D shape reconstruction from 2D Image GANscited by 63
  24. 2019Unsupervised Generative 3D Shape Learning from Natural Imagescited by 57
  25. 2021StyleAlign: Analysis and Applications of Aligned StyleGAN Modelscited by 48
  26. 20213DCaricShop: A Dataset and A Baseline Method for Single-view 3D Caricature Face Reconstructioncited by 16

Built on by

Cited by year

Citing papers per year: 2023: 4; 2024: 3; 2025: 1.

8 papers.

  1. 2023LPFF: A Portrait Dataset for Face Generators Across Large Posescited by 22
  2. 2023DiffusionGAN3D: Boosting Text-guided 3D Generation and Domain Adaptation by Combining 3D GANs and Diffusion Priorscited by 19
  3. 2024Real-time 3D-aware Portrait Editing from a Single Imagecited by 10
  4. 2023DeformToon3D: Deformable 3D Toonification from Neural Radiance Fieldscited by 9
  5. 20233DPortraitGAN: Learning One-Quarter Headshot 3D GANs from a Single-View Portrait Dataset with Diverse Body Posescited by 8
  6. 2024LeGO: Leveraging a Surface Deformation Network for Animatable Stylized Face Generation with One Examplecited by 4
  7. 2024GCA-3D: Towards Generalized and Consistent Domain Adaptation of 3D Generatorscited by 4
  8. 2025ToonifyGB: StyleGAN-based Gaussian Blendshapes for 3D Stylized Head Avatarscited by 2