mlsanityData to 14 Oct 2026

GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis

arXiv 2007.02442 ↗First posted 5 Jul 2020cs.CVcited by 689

Not on the map. Why?

Cited by 78 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

While 2D generative adversarial networks have enabled high-resolution image synthesis, they largely lack an understanding of the 3D world and the image formation process. Thus, they do not provide precise control over camera viewpoint or object pose. To address this problem, several recent approaches leverage intermediate voxel-based representations in combination with differentiable rendering. However, existing methods either produce low image resolution or fall short in disentangling camera and scene properties, e.g., the object identity may vary with the viewpoint. In this paper, we propose a generative model for radiance fields which have recently proven successful for novel view synthesis of a single scene. In contrast to voxel-based representations, radiance fields are not confined to a coarse discretization of the 3D space, yet allow for disentangling camera and scene properties while degrading gracefully in the presence of reconstruction ambiguity. By introducing a multi-scale patch-based discriminator, we demonstrate synthesis of high-resolution images while training our model from unposed 2D images alone. We systematically analyze our approach on several challenging synthetic and real-world datasets. Our experiments reveal that radiance fields are a powerful representation for generative image synthesis, leading to 3D consistent models that render with high fidelity.

Key facts. Cited by 689 papers in the map (data through 14 Oct 2026). First posted on arXiv 5 Jul 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 103; 2022: 180; 2023: 227; 2024: 115; 2025: 38; 2026: 26.

689 papers.

Sort:

By area:

  1. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  2. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  3. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  4. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  5. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
  6. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
  7. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
  8. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
  9. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  10. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
  11. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
  12. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
38 more
  1. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  2. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 642
  3. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
  4. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  5. 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 589
  6. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
  7. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
  8. 2021Neural Fields in Visual Computing and Beyondcited by 540
  9. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  10. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  11. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  12. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  13. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 468
  14. 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
  15. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  16. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  17. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
  18. 2021Advances in Neural Renderingcited by 365
  19. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
  20. 2021Neural RGB-D Surface Reconstructioncited by 313
  21. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  22. 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 301
  23. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
  24. 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
  25. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 288
  26. 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
  27. 20223D Neural Field Generation using Triplane Diffusioncited by 274
  28. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 274
  29. 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
  30. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 235
  31. 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
  32. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
  33. 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
  34. 2021Editing Conditional Radiance Fieldscited by 222
  35. 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 219
  36. 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
  37. 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
  38. 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 214

50 most cited of 689 All 689 (JSON)