3DHumanGAN: 3D-Aware Human Image Generation with 3D Pose Mapping
Not on the map. Why?
Abstract (arXiv)
We present 3DHumanGAN, a 3D-aware generative adversarial network that synthesizes photorealistic images of full-body humans with consistent appearances under different view-angles and body-poses. To tackle the representational and computational challenges in synthesizing the articulated structure of human bodies, we propose a novel generator architecture in which a 2D convolutional backbone is modulated by a 3D pose mapping network. The 3D pose mapping network is formulated as a renderable implicit function conditioned on a posed 3D human mesh. This design has several merits: i) it leverages the strength of 2D GANs to produce high-quality images; ii) it generates consistent images under varying view-angles and poses; iii) the model can incorporate the 3D human prior and enable pose conditioning. Project page: https://3dhumangan.github.io/.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 57 of its 69 references that are in the map. First posted on arXiv 14 Dec 2022.
Builds on
57 of 69 references.
References · 57
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2018Demystifying MMD GANscited by 1,268
38 more
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2020Neural Sparse Voxel Fieldscited by 959
- 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
- 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
- 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
- 2018Which Training Methods for GANs do actually Converge?cited by 672
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
- 2019Making Convolutional Networks Shift-Invariant Againcited by 390
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
- 2017VITON: An Image-based Virtual Try-on Networkcited by 285
- 2020State of the Art on Neural Renderingcited by 276
- 2017Pose Guided Person Image Generationcited by 251
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2018Escaping Plato's Cave: 3D Shape From Adversarial Renderingcited by 170
- 2019Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesiscited by 161
- 2021CIPS-3D: A 3D-Aware Generator of GANs Based on Conditionally-Independent Pixel Synthesiscited by 149
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
- 2019Progressive Pose Attention Transfer for Person Image Generationcited by 138
- 2020You Only Need Adversarial Supervision for Semantic Image Synthesiscited by 129
- 2018Visual Object Networks: Image Generation with Disentangled 3D Representationcited by 124
- 20163D Shape Induction from 2D Views of Multiple Objectscited by 121
- 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
- 2021LEAP: Learning Articulated Occupancy of Peoplecited by 107
- 2019Dense Intrinsic Appearance Flow for Human Pose Transfercited by 104
- 2019Towards Unsupervised Learning of Generative Models for 3D Controllable Image Synthesiscited by 104
- 2022Generative Neural Articulated Radiance Fieldscited by 101
- 2020Deep Image Spatial Transformation for Person Image Generationcited by 100
- 2017Disentangled Person Image Generationcited by 98
- 2021GANcraft: Unsupervised 3D Neural Rendering of Minecraft Worldscited by 98
- 2022Unsupervised Learning of Efficient Geometry-Aware Neural Articulated Representationscited by 65
- 2021StylePeople: A Generative Model of Fullbody Human Avatarscited by 62
- 2018Soft-Gated Warping-GAN for Pose-Guided Person Image Synthesiscited by 59
- 2022AvatarGen: A 3D Generative Model for Animatable Human Avatarscited by 59
- 2019Unsupervised Generative 3D Shape Learning from Natural Imagescited by 57
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 8; 2025: 3; 2026: 1.
17 papers.
Sort:
By area:
- 2024MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modelingcited by 63
- 2023Gaussian Shell Maps for Efficient 3D Human Generationcited by 61
- 2024AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstructioncited by 36
- 2024Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Imagecited by 32
- 2024CosmicMan: A Text-to-Image Foundation Model for Humanscited by 30
- 2024En3D: An Enhanced Generative Model for Sculpting 3D Humans from 2D Synthetic Datacited by 14
- 2022Human Image Generation: A Comprehensive Surveycited by 11
- 20233DPortraitGAN: Learning One-Quarter Headshot 3D GANs from a Single-View Portrait Dataset with Diverse Body Posescited by 8
- 2023Total Selfie: Generating Full-Body Selfiescited by 5
- 2024Diversifying Human Pose in Synthetic Data for Aerial-view Human Detectioncited by 5
- 2024Are Pose Estimators Ready for the Open World? STAGE: A GenAI Toolkit for Auditing 3D Human Pose Estimatorscited by 1
- 2023InceptionHuman: Controllable Prompt-to-NeRF for Photorealistic 3D Human Generationcited by 0
5 more
- 2024An End-to-End Depth-Based Pipeline for Selfie Image Rectificationcited by 0
- 2025Fine-Grained Controllable Apparel Showcase Image Generation via Garment-Centric Outpaintingcited by 0
- 2025FashionMAC: Deformation-Free Fashion Image Generation with Fine-Grained Model Appearance Customizationcited by 0
- 2025Pro-Pose: Unpaired Full-Body Portrait Synthesis via Canonical UV Mapscited by 0
- 2026GenLCA: 3D Diffusion for Full-Body Avatars from In-the-Wild Videoscited by 0
- 2026GenLCA: 3D Diffusion for Full-Body Avatars from In-the-Wild Videos8 Apr 2026
- 2025Pro-Pose: Unpaired Full-Body Portrait Synthesis via Canonical UV Maps19 Dec 2025
- 2025FashionMAC: Deformation-Free Fashion Image Generation with Fine-Grained Model Appearance Customization18 Nov 2025
- 2025Fine-Grained Controllable Apparel Showcase Image Generation via Garment-Centric Outpainting3 Mar 2025
- 2024An End-to-End Depth-Based Pipeline for Selfie Image Rectification26 Dec 2024
- 2024AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstruction3 Dec 2024
- 2024MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modeling24 Sep 2024
- 2024Are Pose Estimators Ready for the Open World? STAGE: A GenAI Toolkit for Auditing 3D Human Pose Estimators28 Aug 2024
- 2024Diversifying Human Pose in Synthetic Data for Aerial-view Human Detection24 May 2024
- 2024CosmicMan: A Text-to-Image Foundation Model for Humans1 Apr 2024
- 2024Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Image14 Mar 2024
- 2024En3D: An Enhanced Generative Model for Sculpting 3D Humans from 2D Synthetic Data2 Jan 2024
5 more
- 2023Gaussian Shell Maps for Efficient 3D Human Generation29 Nov 2023
- 2023InceptionHuman: Controllable Prompt-to-NeRF for Photorealistic 3D Human Generation27 Nov 2023
- 2023Total Selfie: Generating Full-Body Selfies28 Aug 2023
- 20233DPortraitGAN: Learning One-Quarter Headshot 3D GANs from a Single-View Portrait Dataset with Diverse Body Poses27 Jul 2023
- 2022Human Image Generation: A Comprehensive Survey17 Dec 2022
- 2024MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modelingcited by 63
- 2023Gaussian Shell Maps for Efficient 3D Human Generationcited by 61
- 2024AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstructioncited by 36
- 2024Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Imagecited by 32
- 2024CosmicMan: A Text-to-Image Foundation Model for Humanscited by 30
- 2024En3D: An Enhanced Generative Model for Sculpting 3D Humans from 2D Synthetic Datacited by 14
- 2022Human Image Generation: A Comprehensive Surveycited by 11
- 20233DPortraitGAN: Learning One-Quarter Headshot 3D GANs from a Single-View Portrait Dataset with Diverse Body Posescited by 8
- 2023Total Selfie: Generating Full-Body Selfiescited by 5
- 2024Diversifying Human Pose in Synthetic Data for Aerial-view Human Detectioncited by 5
- 2024Are Pose Estimators Ready for the Open World? STAGE: A GenAI Toolkit for Auditing 3D Human Pose Estimatorscited by 1
- 2023InceptionHuman: Controllable Prompt-to-NeRF for Photorealistic 3D Human Generationcited by 0
12 most cited of 15 All 15 (JSON)
- 2025Pro-Pose: Unpaired Full-Body Portrait Synthesis via Canonical UV Maps19 Dec 2025
- 2025FashionMAC: Deformation-Free Fashion Image Generation with Fine-Grained Model Appearance Customization18 Nov 2025
- 2024An End-to-End Depth-Based Pipeline for Selfie Image Rectification26 Dec 2024
- 2024AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstruction3 Dec 2024
- 2024MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modeling24 Sep 2024
- 2024Are Pose Estimators Ready for the Open World? STAGE: A GenAI Toolkit for Auditing 3D Human Pose Estimators28 Aug 2024
- 2024Diversifying Human Pose in Synthetic Data for Aerial-view Human Detection24 May 2024
- 2024CosmicMan: A Text-to-Image Foundation Model for Humans1 Apr 2024
- 2024Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Image14 Mar 2024
- 2024En3D: An Enhanced Generative Model for Sculpting 3D Humans from 2D Synthetic Data2 Jan 2024
- 2023Gaussian Shell Maps for Efficient 3D Human Generation29 Nov 2023
- 2023InceptionHuman: Controllable Prompt-to-NeRF for Photorealistic 3D Human Generation27 Nov 2023
12 newest of 15 All 15 (JSON)