mlsanityData to 7 Oct 2026

GIRAFFE HD: A High-Resolution 3D-aware Generative Model

arXiv 2203.14954 ↗First posted 28 Mar 2022cs.CV cs.AI cs.LGcited by 86

Not on the map. Why?

Abstract (arXiv)

3D-aware generative models have shown that the introduction of 3D information can lead to more controllable image generation. In particular, the current state-of-the-art model GIRAFFE can control each object's rotation, translation, scale, and scene camera pose without corresponding supervision. However, GIRAFFE only operates well when the image resolution is low. We propose GIRAFFE HD, a high-resolution 3D-aware generative model that inherits all of GIRAFFE's controllable features while generating high-quality, high-resolution images (5122 resolution and above). The key idea is to leverage a style-based neural renderer, and to independently generate the foreground and background to force their disentanglement while imposing consistency constraints to stitch them together to composite a coherent final image. We demonstrate state-of-the-art 3D controllable high-resolution image generation on multiple natural image datasets.

Key facts. Cited by 86 papers in the map (data through 7 Oct 2026). Builds on 40 of its 52 references that are in the map. First posted on arXiv 28 Mar 2022.

Builds on

40 of 52 references.

References · 40

  1. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  2. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  3. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  4. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  5. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  6. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  7. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
  8. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  9. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  10. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  11. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  12. 2021Alias-Free Generative Adversarial Networkscited by 1,181
28 more
  1. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
  2. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  3. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
  4. 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 858
  5. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
  6. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  7. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  8. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  9. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  10. 2018Which Training Methods for GANs do actually Converge?cited by 672
  11. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
  12. 2020Local Implicit Grid Representations for 3D Scenescited by 372
  13. 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 348
  14. 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 331
  15. 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
  16. 2019Learning Shape Templates with Structured Implicit Functionscited by 242
  17. 2018Escaping Plato's Cave: 3D Shape From Adversarial Renderingcited by 170
  18. 2020BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Imagescited by 166
  19. 2017Unsupervised Learning of Disentangled Representations from Videocited by 138
  20. 2015A Large-Scale Car Dataset for Fine-Grained Categorization and Verificationcited by 129
  21. 2020The Hessian Penalty: A Weak Prior for Unsupervised Disentanglementcited by 90
  22. 2018FineGAN: Unsupervised Hierarchical Disentanglement for Fine-Grained Object Generation and Discoverycited by 58
  23. 2019Emergence of Object Segmentation in Perturbed Generative Modelscited by 57
  24. 2017LR-GAN: Layered Recursive Generative Adversarial Networks for Image Generationcited by 36
  25. 2019MixNMatch: Multifactor Disentanglement and Encoding for Conditional Image Generationcited by 29
  26. 2021Collaging Class-specific GANs for Semantic Image Synthesiscited by 25
  27. 2020High-Fidelity Synthesis with Disentangled Representationcited by 23
  28. 2017Disentangling Factors of Variation by Mixing Themcited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 17; 2023: 39; 2024: 19; 2025: 7; 2026: 4.

86 papers.

Sort:

By area:

  1. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 273
  2. 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
  3. 2022VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Gridscited by 133
  4. 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
  5. 2022EpiGRAF: Rethinking training of 3D GANscited by 108
  6. 2023PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360circcited by 93
  7. 2023CityDreamer: Compositional Generative Model of Unbounded 3D Citiescited by 75
  8. 2023SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collectionscited by 72
  9. 2022Unifying Diffusion Models' Latent Space, with Applications to CycleDiffusion and Guidancecited by 67
  10. 2022DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesiscited by 61
  11. 2022AvatarGen: A 3D Generative Model for Animatable Human Avatarscited by 59
  12. 2023CC3D: Layout-Conditioned Generation of Compositional 3D Scenescited by 58
38 more
  1. 2024GGHead: Fast and Generalizable 3D Gaussian Headscited by 51
  2. 2023AutoDecoding Latent 3D Diffusion Modelscited by 50
  3. 20233D generation on ImageNetcited by 47
  4. 20223D GAN Inversion with Facial Symmetry Priorcited by 39
  5. 2023PartNeRF: Generating Part-Aware Editable 3D Shapes without 3D Supervisioncited by 36
  6. 2023OmniAvatar: Geometry-Guided Controllable 3D Head Synthesiscited by 34
  7. 2024A survey of synthetic data augmentation methods in computer visioncited by 34
  8. 2022HumanGen: Generating Human Radiance Fields with Explicit Priorscited by 33
  9. 2023VOODOO 3D: Volumetric Portrait Disentanglement for One-Shot 3D Head Reenactmentcited by 33
  10. 2023VQ3D: Learning a 3D-Aware Generative Model on ImageNetcited by 32
  11. 2022Shape, Pose, and Appearance from a Single Image via Bootstrapped Radiance Field Inversioncited by 30
  12. 2024SphereHead: Stable 3D Full-head Synthesis with Spherical Tri-plane Representationcited by 30
  13. 2023UrbanGIRAFFE: Representing Urban Scenes as Compositional Generative Neural Feature Fieldscited by 26
  14. 2023DiffPortrait3D: Controllable Diffusion for Zero-Shot Portrait View Synthesiscited by 26
  15. 2023Interactive Segment Anything NeRF with Feature Imitationcited by 24
  16. 2023LPFF: A Portrait Dataset for Face Generators Across Large Posescited by 22
  17. 2024Real-time 3D-aware Portrait Video Relightingcited by 21
  18. 2024VOODOO XP: Expressive One-Shot Head Reenactment for VR Telepresencecited by 19
  19. 2023Unsupervised Volumetric Animationcited by 18
  20. 2023Mimic3D: Thriving 3D-Aware GANs via 3D-to-2D Imitationcited by 18
  21. 2023NCHO: Unsupervised Learning for Neural 3D Composition of Humans and Objectscited by 17
  22. 2024A personalized time-resolved 3D mesh generative model for unveiling normal heart dynamicscited by 17
  23. 2022A Survey on Deep Generative 3D-aware Image Synthesiscited by 16
  24. 2023PAniC-3D: Stylized Single-view 3D Reconstruction from Portraits of Anime Characterscited by 16
  25. 2023Single-Shot Implicit Morphable Faces with Consistent Texture Parameterizationcited by 16
  26. 2024Improving Physics-Augmented Continuum Neural Radiance Field-Based Geometry-Agnostic System Identification with Lagrangian Particle Optimizationcited by 16
  27. 2025Compositional Generative Model of Unbounded 4D Citiescited by 16
  28. 2023Lift3D: Synthesize 3D Training Data by Lifting 2D GAN to 3D Generative Radiance Fieldcited by 15
  29. 2023LumiGAN: Unconditional Generation of Relightable 3D Human Facescited by 14
  30. 2024En3D: An Enhanced Generative Model for Sculpting 3D Humans from 2D Synthetic Datacited by 14
  31. 2023Efficient 3D Articulated Human Generation with Layered Surface Volumescited by 13
  32. 2024Isotropic3D: Image-to-3D Generation Based on a Single CLIP Embeddingcited by 13
  33. 2024What You See is What You GAN: Rendering Every Pixel for High-Fidelity Geometry in 3D GANscited by 12
  34. 2025DiffPortrait360: Consistent Portrait Diffusion for 360 View Synthesiscited by 12
  35. 2022Injecting 3D Perception of Controllable NeRF-GAN into StyleGAN for Editable Portrait Image Synthesiscited by 11
  36. 2022SinGRAF: Learning a 3D Generative Radiance Field for a Single Scenecited by 11
  37. 2023NVS-Adapter: Plug-and-Play Novel View Synthesis from a Single Imagecited by 11
  38. 2025Compass Control: Multi Object Orientation Control for Text-to-Image Generationcited by 11

50 most cited of 86 All 86 (JSON)