mlsanityData to 14 Oct 2026

Generative Neural Articulated Radiance Fields

arXiv 2206.14314 ↗First posted 28 Jun 2022cs.CV cs.GRcited by 101

Not on the map. Why?

Abstract (arXiv)

Unsupervised learning of 3D-aware generative adversarial networks (GANs) using only collections of single-view 2D photographs has very recently made much progress. These 3D GANs, however, have not been demonstrated for human bodies and the generated radiance fields of existing frameworks are not directly editable, limiting their applicability in downstream tasks. We propose a solution to these challenges by developing a 3D GAN framework that learns to generate radiance fields of human bodies or faces in a canonical pose and warp them using an explicit deformation field into a desired body pose or facial expression. Using our framework, we demonstrate the first high-quality radiance field generation results for human bodies. Moreover, we show that our deformation-aware training procedure significantly improves the quality of generated bodies or faces when editing their poses or facial expressions compared to a 3D GAN that is not trained with explicit deformations.

Key facts. Cited by 101 papers in the map (data through 14 Oct 2026). Builds on 111 of its 147 references that are in the map. First posted on arXiv 28 Jun 2022.

Builds on

111 of 147 references.

References · 111

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  5. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  6. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  7. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  8. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  9. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  10. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  11. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
  12. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
38 more
  1. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  2. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  3. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
  4. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
  5. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  6. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  7. 2020Neural Sparse Voxel Fieldscited by 959
  8. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
  9. 2017End-to-end Recovery of Human Shape and Posecited by 885
  10. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  11. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
  12. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  13. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
  14. 2020Convolutional Occupancy Networkscited by 761
  15. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
  16. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 724
  17. 2018Open3D: A Modern Library for 3D Data Processingcited by 721
  18. 2020Implicit Geometric Regularization for Learning Shapescited by 710
  19. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  20. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
  21. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
  22. 2018Which Training Methods for GANs do actually Converge?cited by 679
  23. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
  24. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
  25. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  26. 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 627
  27. 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
  28. 2021Neural Fields in Visual Computing and Beyondcited by 540
  29. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  30. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 511
  31. 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 496
  32. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 485
  33. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  34. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
  35. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  36. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
  37. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 468
  38. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467

50 most cited of 111 All 111 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 11; 2023: 55; 2024: 15; 2025: 15; 2026: 5.

101 papers.

Sort:

By area:

  1. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
  2. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 274
  3. 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 184
  4. 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
  5. 2023HUGS: Human Gaussian Splatscited by 154
  6. 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
  7. 2023State of the Art on Diffusion Models for Visual Computingcited by 127
  8. 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
  9. 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
  10. 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
  11. 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
  12. 2023ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Renderingcited by 104
38 more
  1. 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
  2. 2023One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Fieldcited by 68
  3. 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
  4. 2024Advances in 3D Generation: A Surveycited by 63
  5. 2023Gaussian Shell Maps for Efficient 3D Human Generationcited by 61
  6. 2022Fast-SNARF: A Fast Deformer for Articulated Neural Fieldscited by 55
  7. 2023AG3D: Learning to Generate 3D Avatars from 2D Image Collectionscited by 55
  8. 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
  9. 2023Learning Locally Editable Virtual Humanscited by 54
  10. 2023NOFA: NeRF-based One-shot Facial Avatar Reconstructioncited by 53
  11. 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 53
  12. 2024PhysAvatar: Learning the Physics of Dressed 3D Avatars from Visual Observationscited by 51
  13. 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44
  14. 2023Global-correlated 3D-decoupling Transformer for Clothed Avatar Reconstructioncited by 42
  15. 2023DiffusionAvatars: Deferred Diffusion for High-fidelity 3D Head Avatarscited by 42
  16. 2023TriPlaneNet: An Encoder for EG3D Inversioncited by 41
  17. 2023LEO: Generative Latent Image Animator for Human Video Synthesiscited by 40
  18. 2023AvatarBooth: High-Quality and Customizable 3D Human Avatar Generationcited by 37
  19. 2023MonoNPHM: Dynamic Head Reconstruction from Monocular Videoscited by 35
  20. 2023OmniAvatar: Geometry-Guided Controllable 3D Head Synthesiscited by 34
  21. 2023PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generationcited by 34
  22. 2022HumanGen: Generating Human Radiance Fields with Explicit Priorscited by 33
  23. 2023Disentangled Clothed Avatar Generation from Text Descriptionscited by 33
  24. 2023Human101: Training 100+FPS Human Gaussians in 100s from 1 Viewcited by 32
  25. 2023Animatable 3D Gaussian: Fast and High-Quality Reconstruction of Multiple Human Avatarscited by 30
  26. 2023TriHuman : A Real-time and Controllable Tri-plane Representation for Detailed Human Geometry and Appearance Synthesiscited by 28
  27. 2023Control3Diff: Learning Controllable 3D Diffusion Models from Single-view Imagescited by 27
  28. 2023GETAvatar: Generative Textured Meshes for Animatable Human Avatarscited by 27
  29. 2023UrbanGIRAFFE: Representing Urban Scenes as Compositional Generative Neural Feature Fieldscited by 26
  30. 2023HumanLiff: Layer-wise 3D Human Generation with Diffusion Modelcited by 23
  31. 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creationcited by 23
  32. 20223DFaceShop: Explicitly Controllable 3D-Aware Portrait Generationcited by 22
  33. 2023Chupa: Carving 3D Clothed Humans from Skinned Shape Priors using 2D Diffusion Probabilistic Modelscited by 20
  34. 20223DHumanGAN: 3D-Aware Human Image Generation with 3D Pose Mappingcited by 17
  35. 2023XAGen: 3D Expressive Human Avatars Generationcited by 17
  36. 2024StructLDM: Structured Latent Diffusion for 3D Human Generationcited by 17
  37. 2022A Survey on Deep Generative 3D-aware Image Synthesiscited by 16
  38. 2023AniPortraitGAN: Animatable 3D Portrait Generation from 2D Image Collectionscited by 16

50 most cited of 101 All 101 (JSON)