mlsanityData to 7 Oct 2026

A Survey on Deep Generative 3D-aware Image Synthesis

arXiv 2210.14267 ↗First posted 25 Oct 2022cs.CV cs.AI cs.GRcited by 16

Not on the map. Why?

Abstract (arXiv)

Recent years have seen remarkable progress in deep learning powered visual content creation. This includes deep generative 3D-aware image synthesis, which produces high-idelity images in a 3D-consistent manner while simultaneously capturing compact surfaces of objects from pure image collections without the need for any 3D supervision, thus bridging the gap between 2D imagery and 3D reality. The ield of computer vision has been recently captivated by the task of deep generative 3D-aware image synthesis, with hundreds of papers appearing in top-tier journals and conferences over the past few years (mainly the past two years), but there lacks a comprehensive survey of this remarkable and swift progress. Our survey aims to introduce new researchers to this topic, provide a useful reference for related works, and stimulate future research directions through our discussion section. Apart from the presented papers, we aim to constantly update the latest relevant papers along with corresponding implementations at https://weihaox.github.io/3D-aware-Gen.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 114 of its 155 references that are in the map. First posted on arXiv 25 Oct 2022.

Builds on

114 of 155 references.

References · 114

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  5. 2022Generative Adversarial Networkscited by 5,603
  6. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  7. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  8. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  9. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  10. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  11. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  12. 2016Improved Techniques for Training GANscited by 2,938
38 more
  1. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  2. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  3. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  4. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  5. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  6. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  7. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  8. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
  9. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  10. 2018Demystifying MMD GANscited by 1,268
  11. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  12. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  13. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  14. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
  15. 2020Neural Sparse Voxel Fieldscited by 959
  16. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  17. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
  18. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  19. 2020Convolutional Occupancy Networkscited by 760
  20. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
  21. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  22. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
  23. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
  24. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  25. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  26. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
  27. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
  28. 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
  29. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  30. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  31. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  32. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
  33. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  34. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  35. 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
  36. 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 401
  37. 2021GAN Inversion: A Surveycited by 366
  38. 2021Advances in Neural Renderingcited by 365

50 most cited of 114 All 114 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 8; 2025: 4; 2026: 1.

16 papers.

Sort:

By area:

  1. 2024Advances in 3D Generation: A Surveycited by 62
  2. 2023Generative AI meets 3D: A Survey on Text-to-3D in AIGC Eracited by 61
  3. 2024GaussianCube: A Structured and Explicit Radiance Representation for 3D Generative Modelingcited by 44
  4. 2024RodinHD: High-Fidelity 3D Avatar Generation with Diffusion Modelscited by 36
  5. 2024Alignment of Diffusion Models: Fundamentals, Challenges, and Futurecited by 34
  6. 2023VIVE3D: Viewpoint-Independent Video Editing using 3D-Aware GANscited by 16
  7. 2024Real-time 3D-aware Portrait Editing from a Single Imagecited by 10
  8. 2024Efficient Domain Augmentation for Autonomous Driving Testing Using Diffusion Modelscited by 10
  9. 2024Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Reviewcited by 9
  10. 2024Fast Text-to-3D-Aware Face Generation and Manipulation via Direct Cross-modal Mapping and Geometric Regularizationcited by 8
  11. 2026Deep Sketch-Based 3D Modeling: A Surveycited by 3
  12. 2025Confident Splatting: Confidence-Based Compression of 3D Gaussian Splatting via Learnable Beta Distributionscited by 1
4 more
  1. 2023Towards AI-Architecture Liberty: A Comprehensive Survey on Design and Generation of Virtual Architecture by Deep Learningcited by 0
  2. 2025A Survey on Text-Driven 360-Degree Panorama Generationcited by 0
  3. 20253D Shape Generation: A Surveycited by 0
  4. 2025SAGS: Self-Adaptive Alias-Free Gaussian Splatting for Dynamic Surgical Endoscopic Reconstructioncited by 0