mlsanityData to 7 Oct 2026

VeRi3D: Generative Vertex-based Radiance Fields for 3D Controllable Human Image Synthesis

arXiv 2309.04800 ↗First posted 9 Sep 2023cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Unsupervised learning of 3D-aware generative adversarial networks has lately made much progress. Some recent work demonstrates promising results of learning human generative models using neural articulated radiance fields, yet their generalization ability and controllability lag behind parametric human models, i.e., they do not perform well when generalizing to novel pose/shape and are not part controllable. To solve these problems, we propose VeRi3D, a generative human vertex-based radiance field parameterized by vertices of the parametric human template, SMPL. We map each 3D point to the local coordinate system defined on its neighboring vertices, and use the corresponding vertex feature and local coordinates for mapping it to color and density values. We demonstrate that our simple approach allows for generating photorealistic human images with free control over camera pose, human pose, shape, as well as enabling part-level editing.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 53 of its 67 references that are in the map. First posted on arXiv 9 Sep 2023.

Builds on

53 of 67 references.

References · 53

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  3. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  4. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  5. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  6. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  7. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  8. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  9. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  10. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
  11. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  12. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
38 more
  1. 2018Which Training Methods for GANs do actually Converge?cited by 672
  2. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
  3. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  4. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  5. 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 489
  6. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  7. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  8. 2017Learning from Synthetic Humanscited by 358
  9. 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
  10. 2017Pose Guided Person Image Generationcited by 251
  11. 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
  12. 2021Neural Articulated Radiance Fieldcited by 196
  13. 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
  14. 2018Escaping Plato's Cave: 3D Shape From Adversarial Renderingcited by 170
  15. 2017Deformable GANs for Pose-based Human Image Generationcited by 166
  16. 2019Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesiscited by 161
  17. 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 154
  18. 2021CIPS-3D: A 3D-Aware Generator of GANs Based on Conditionally-Independent Pixel Synthesiscited by 149
  19. 2022VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Gridscited by 133
  20. 2018A Variational U-Net for Conditional Appearance and Shape Generationcited by 124
  21. 2021HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputscited by 112
  22. 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
  23. 20213D-aware Image Synthesis via Learning Structural and Textural Representationscited by 109
  24. 2019Towards Unsupervised Learning of Generative Models for 3D Controllable Image Synthesiscited by 104
  25. 2022Generative Neural Articulated Radiance Fieldscited by 101
  26. 2021The Power of Points for Modeling Humans in Clothingcited by 90
  27. 2020XingGAN for Person Image Generationcited by 81
  28. 2021A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesiscited by 72
  29. 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
  30. 2022Unsupervised Learning of Efficient Geometry-Aware Neural Articulated Representationscited by 65
  31. 2021StylePeople: A Generative Model of Fullbody Human Avatarscited by 62
  32. 2018Soft-Gated Warping-GAN for Pose-Guided Person Image Synthesiscited by 59
  33. 2022AvatarGen: A 3D Generative Model for Animatable Human Avatarscited by 59
  34. 2021Generative Occupancy Fields for 3D Surface-Aware Image Synthesiscited by 51
  35. 2021HumanGAN: A Generative Model of Humans Imagescited by 47
  36. 2022InsetGAN for Full-Body Image Generationcited by 45
  37. 2022Surface-Aligned Neural Radiance Fields for Controllable 3D Human Synthesiscited by 41
  38. 2017A Generative Model of People in Clothingcited by 37

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 6; 2025: 1.

8 papers.

  1. 2024Advances in 3D Generation: A Surveycited by 62
  2. 2023Gaussian Shell Maps for Efficient 3D Human Generationcited by 61
  3. 2024E3Gen: Efficient, Expressive and Editable Avatars Generationcited by 10
  4. 2024Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Reviewcited by 9
  5. 2024SemanticHuman-HD: High-Resolution Semantic Disentangled 3D Human Generationcited by 3
  6. 2024Learning 3D-Aware GANs from Unposed Images with Template Feature Fieldcited by 3
  7. 2024ID-NeRF: Indirect Diffusion-guided Neural Radiance Fields for Generalizable View Synthesiscited by 2
  8. 2025SuperNeRF-GAN: A Universal 3D-Consistent Super-Resolution Framework for Efficient and Enhanced 3D-Aware Image Synthesiscited by 2