HumanGAN: A Generative Model of Humans Images
Not on the map. Why?
Abstract (arXiv)
Generative adversarial networks achieve great performance in photorealistic image synthesis in various domains, including human images. However, they usually employ latent vectors that encode the sampled outputs globally. This does not allow convenient control of semantically-relevant individual parts of the image, and is not able to draw samples that only differ in partial aspects, such as clothing style. We address these limitations and present a generative model for images of dressed humans offering control over pose, local body part appearance and garment style. This is the first method to solve various aspects of human image generation such as global appearance sampling, pose transfer, parts and garment transfer, and parts sampling jointly in a unified framework. As our model encodes part-based latent appearance vectors in a normalized pose-independent space and warps them to different poses, it preserves body and clothing appearance under varying posture. Experiments show that our flexible and general generative method outperforms task-specific baselines for pose-conditioned image generation, pose transfer and part sampling in terms of realism and output resolution.
Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). Builds on 44 of its 56 references that are in the map. First posted on arXiv 11 Mar 2021.
Builds on
44 of 56 references.
References · 44
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
32 more
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2017SphereFace: Deep Hypersphere Embedding for Face Recognitioncited by 733
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
- 2016Conditional Image Synthesis With Auxiliary Classifier GANscited by 562
- 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
- 2018Video-to-Video Synthesiscited by 388
- 2017Learning from Synthetic Humanscited by 358
- 2018Everybody Dance Nowcited by 313
- 2017Toward Multimodal Image-to-Image Translationcited by 295
- 2020StyleRig: Rigging StyleGAN for 3D Control over Portrait Imagescited by 267
- 2018cGANs with Projection Discriminatorcited by 253
- 2017Pose Guided Person Image Generationcited by 251
- 2017Deformable GANs for Pose-based Human Image Generationcited by 166
- 2019Progressive Pose Attention Transfer for Person Image Generationcited by 138
- 2018A Variational U-Net for Conditional Appearance and Shape Generationcited by 124
- 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 114
- 2017Disentangled Person Image Generationcited by 98
- 2018Recycle-GAN: Unsupervised Video Retargetingcited by 89
- 2018Dense Pose Transfercited by 83
- 2016Generative Multi-Adversarial Networkscited by 60
- 2021Neural Re-Rendering of Humans from a Single Imagecited by 59
- 2018Unsupervised Person Image Synthesis in Arbitrary Posescited by 55
- 2020Pose-Guided Human Animation from a Single Image in the Wildcited by 53
- 2017A Generative Model of People in Clothingcited by 37
- 2018Deep Video-Based Performance Cloningcited by 32
- 2019Appearance and Pose-Conditioned Human Image Generation using Deformable GANscited by 24
- 2018Dropout-GAN: Learning from a Dynamic Ensemble of Discriminatorscited by 15
- 2018On-line Adaptative Curriculum Learning for GANscited by 14
- 2017Improving Video Generation for Multi-functional Applicationscited by 9
Built on by
Citing papers per year: 2021: 6; 2022: 14; 2023: 12; 2024: 8; 2025: 6; 2026: 1.
47 papers.
Sort:
By area:
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
- 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
- 2021Animatable Neural Radiance Fields from Monocular RGB Videoscited by 109
- 2021Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Controlcited by 106
- 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
- 2023Text2Performer: Text-Driven Human Video Generationcited by 53
- 2021Towards Scalable Unpaired Virtual Try-On via Patch-Routed Spatially-Adaptive GANcited by 40
- 2024Large Language Models for Medicine: A Surveycited by 38
- 2022HumanGen: Generating Human Radiance Fields with Explicit Priorscited by 33
- 2023Towards Garment Sewing Pattern Reconstruction from a Single Imagecited by 33
35 more
- 2023PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generationcited by 33
- 20213D-Aware Semantic-Guided Generative Model for Human Synthesiscited by 31
- 2022Underwater Light Field Retention : Neural Rendering for Underwater Imagingcited by 22
- 2022Dressing in the Wild by Watching Dance Videoscited by 20
- 2023Get3DHuman: Lifting StyleGAN-Human into a 3D Generative Model using Pixel-aligned Reconstruction Priorscited by 19
- 20223DHumanGAN: 3D-Aware Human Image Generation with 3D Pose Mappingcited by 17
- 2024StructLDM: Structured Latent Diffusion for 3D Human Generationcited by 17
- 2021AnonySIGN: Novel Human Appearance Synthesis for Sign Language Video Anonymisationcited by 16
- 2022PASTA-GAN++: A Versatile Framework for High-Resolution Unpaired Virtual Try-oncited by 15
- 2022HumanDiffusion: a Coarse-to-Fine Alignment Diffusion Framework for Controllable Text-Driven Person Image Generationcited by 11
- 2022Relightable Neural Human Assets from Multi-view Gradient Illuminationscited by 11
- 2022Human Image Generation: A Comprehensive Surveycited by 11
- 2023A Two-stage Personalized Virtual Try-on Framework with Shape Control and Texture Guidancecited by 10
- 2022GAN2X: Non-Lambertian Inverse Rendering of Image GANscited by 8
- 2023Generating Texture for 3D Human Avatar from a Single Image using Sampling and Refinement Networkscited by 8
- 2023VeRi3D: Generative Vertex-based Radiance Fields for 3D Controllable Human Image Synthesiscited by 8
- 2023SCULPT: Shape-Conditioned Unpaired Learning of Pose-dependent Clothed and Textured Human Meshescited by 7
- 2024Global-Local Image Perceptual Score (GLIPS): Evaluating Photorealistic Quality of AI-Generated Imagescited by 7
- 2025HumanGif: Single-View Human Diffusion with Generative Priorcited by 7
- 20223D Magic Mirror: Clothing Reconstruction from a Single Image via a Causal Perspectivecited by 5
- 2022DeepPortraitDrawing: Generating Human Body Images from Freehand Sketchescited by 5
- 2025AnimateAnywhere: Rouse the Background in Human Image Animationcited by 5
- 2021Controllable Person Image Synthesis with Spatially-Adaptive Warped Normalizationcited by 4
- 2023Synthesizing Environment-Specific People in Photographscited by 4
- 2025Deep Generative Models: Complexity, Dimensionality, and Approximationcited by 4
- 2023Animatable Virtual Humans: Learning pose-dependent human representations in UV space for interactive performance synthesiscited by 3
- 2023Bidirectional Temporal Diffusion Model for Temporally Consistent Human Animationcited by 2
- 2024One-shot Human Motion Transfer via Occlusion-Robust Flow Prediction and Neural Texturingcited by 2
- 2024Sketch2Human: Deep Human Generation with Disentangled Geometry and Appearance Controlcited by 1
- 2024Pattern Guided UV Recovery for Realistic Video Garment Texturingcited by 1
- 2024Visual Verity in AI-Generated Imagery: Computational Metrics and Human-Centric Analysiscited by 0
- 2025ComposeAnyone: Controllable Layout-to-Human Generation with Decoupled Multimodal Conditionscited by 0
- 2025Exploring Disentangled and Controllable Human Image Synthesis: From End-to-End to Stage-by-Stagecited by 0
- 2025DANCER: Dance ANimation via Condition Enhancement and Rendering with diffusion modelcited by 0
- 2026ReImagine: Rethinking Controllable High-Quality Human Video Generation via Image-First Synthesiscited by 0
- 2026ReImagine: Rethinking Controllable High-Quality Human Video Generation via Image-First Synthesis21 Apr 2026
- 2025DANCER: Dance ANimation via Condition Enhancement and Rendering with diffusion model31 Oct 2025
- 2025AnimateAnywhere: Rouse the Background in Human Image Animation28 Apr 2025
- 2025Deep Generative Models: Complexity, Dimensionality, and Approximation1 Apr 2025
- 2025Exploring Disentangled and Controllable Human Image Synthesis: From End-to-End to Stage-by-Stage25 Mar 2025
- 2025HumanGif: Single-View Human Diffusion with Generative Prior17 Feb 2025
- 2025ComposeAnyone: Controllable Layout-to-Human Generation with Decoupled Multimodal Conditions21 Jan 2025
- 2024One-shot Human Motion Transfer via Occlusion-Robust Flow Prediction and Neural Texturing9 Dec 2024
- 2024Visual Verity in AI-Generated Imagery: Computational Metrics and Human-Centric Analysis22 Aug 2024
- 2024Pattern Guided UV Recovery for Realistic Video Garment Texturing14 Jul 2024
- 2024Large Language Models for Medicine: A Survey20 May 2024
- 2024Global-Local Image Perceptual Score (GLIPS): Evaluating Photorealistic Quality of AI-Generated Images15 May 2024
35 more
- 2024Sketch2Human: Deep Human Generation with Disentangled Geometry and Appearance Control24 Apr 2024
- 2024StructLDM: Structured Latent Diffusion for 3D Human Generation1 Apr 2024
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance21 Mar 2024
- 2023A Two-stage Personalized Virtual Try-on Framework with Shape Control and Texture Guidance24 Dec 2023
- 2023Synthesizing Environment-Specific People in Photographs22 Dec 2023
- 2023PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generation7 Dec 2023
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videos5 Dec 2023
- 2023Towards Garment Sewing Pattern Reconstruction from a Single Image7 Nov 2023
- 2023Animatable Virtual Humans: Learning pose-dependent human representations in UV space for interactive performance synthesis5 Oct 2023
- 2023VeRi3D: Generative Vertex-based Radiance Fields for 3D Controllable Human Image Synthesis9 Sep 2023
- 2023SCULPT: Shape-Conditioned Unpaired Learning of Pose-dependent Clothed and Textured Human Meshes21 Aug 2023
- 2023Bidirectional Temporal Diffusion Model for Temporally Consistent Human Animation2 Jul 2023
- 2023Generating Texture for 3D Human Avatar from a Single Image using Sampling and Refinement Networks1 May 2023
- 2023Text2Performer: Text-Driven Human Video Generation17 Apr 2023
- 2023Get3DHuman: Lifting StyleGAN-Human into a 3D Generative Model using Pixel-aligned Reconstruction Priors2 Feb 2023
- 2022Human Image Generation: A Comprehensive Survey17 Dec 2022
- 2022Relightable Neural Human Assets from Multi-view Gradient Illuminations15 Dec 2022
- 20223DHumanGAN: 3D-Aware Human Image Generation with 3D Pose Mapping14 Dec 2022
- 2022HumanGen: Generating Human Radiance Fields with Explicit Priors10 Dec 2022
- 2022HumanDiffusion: a Coarse-to-Fine Alignment Diffusion Framework for Controllable Text-Driven Person Image Generation11 Nov 2022
- 2022EVA3D: Compositional 3D Human Generation from 2D Image Collections10 Oct 2022
- 2022PASTA-GAN++: A Versatile Framework for High-Resolution Unpaired Virtual Try-on27 Jul 2022
- 2022GAN2X: Non-Lambertian Inverse Rendering of Image GANs18 Jun 2022
- 2022DeepPortraitDrawing: Generating Human Body Images from Freehand Sketches4 May 2022
- 20223D Magic Mirror: Clothing Reconstruction from a Single Image via a Causal Perspective27 Apr 2022
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generation25 Apr 2022
- 2022Dressing in the Wild by Watching Dance Videos29 Mar 2022
- 2022Underwater Light Field Retention : Neural Rendering for Underwater Imaging21 Mar 2022
- 2022gDNA: Towards Generative Detailed Neural Avatars11 Jan 2022
- 20213D-Aware Semantic-Guided Generative Model for Human Synthesis2 Dec 2021
- 2021Towards Scalable Unpaired Virtual Try-On via Patch-Routed Spatially-Adaptive GAN20 Nov 2021
- 2021AnonySIGN: Novel Human Appearance Synthesis for Sign Language Video Anonymisation22 Jul 2021
- 2021Animatable Neural Radiance Fields from Monocular RGB Videos25 Jun 2021
- 2021Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Control3 Jun 2021
- 2021Controllable Person Image Synthesis with Spatially-Adaptive Warped Normalization31 May 2021
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
- 2023PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generationcited by 33
- 2024StructLDM: Structured Latent Diffusion for 3D Human Generationcited by 17
- 2025HumanGif: Single-View Human Diffusion with Generative Priorcited by 7
- 2023Bidirectional Temporal Diffusion Model for Temporally Consistent Human Animationcited by 2
- 2025ComposeAnyone: Controllable Layout-to-Human Generation with Decoupled Multimodal Conditionscited by 0
- 2025DANCER: Dance ANimation via Condition Enhancement and Rendering with diffusion modelcited by 0
- 2025DANCER: Dance ANimation via Condition Enhancement and Rendering with diffusion model31 Oct 2025
- 2025HumanGif: Single-View Human Diffusion with Generative Prior17 Feb 2025
- 2025ComposeAnyone: Controllable Layout-to-Human Generation with Decoupled Multimodal Conditions21 Jan 2025
- 2024StructLDM: Structured Latent Diffusion for 3D Human Generation1 Apr 2024
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance21 Mar 2024
- 2023PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generation7 Dec 2023
- 2023Bidirectional Temporal Diffusion Model for Temporally Consistent Human Animation2 Jul 2023
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
- 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
- 2021Animatable Neural Radiance Fields from Monocular RGB Videoscited by 109
- 2021Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Controlcited by 106
- 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
- 2023Text2Performer: Text-Driven Human Video Generationcited by 53
- 2021Towards Scalable Unpaired Virtual Try-On via Patch-Routed Spatially-Adaptive GANcited by 40
- 2024Large Language Models for Medicine: A Surveycited by 38
- 2022HumanGen: Generating Human Radiance Fields with Explicit Priorscited by 33
- 2023Towards Garment Sewing Pattern Reconstruction from a Single Imagecited by 33
- 20213D-Aware Semantic-Guided Generative Model for Human Synthesiscited by 31
12 most cited of 40 All 40 (JSON)
- 2026ReImagine: Rethinking Controllable High-Quality Human Video Generation via Image-First Synthesis21 Apr 2026
- 2025AnimateAnywhere: Rouse the Background in Human Image Animation28 Apr 2025
- 2025Deep Generative Models: Complexity, Dimensionality, and Approximation1 Apr 2025
- 2025Exploring Disentangled and Controllable Human Image Synthesis: From End-to-End to Stage-by-Stage25 Mar 2025
- 2024One-shot Human Motion Transfer via Occlusion-Robust Flow Prediction and Neural Texturing9 Dec 2024
- 2024Visual Verity in AI-Generated Imagery: Computational Metrics and Human-Centric Analysis22 Aug 2024
- 2024Pattern Guided UV Recovery for Realistic Video Garment Texturing14 Jul 2024
- 2024Large Language Models for Medicine: A Survey20 May 2024
- 2024Global-Local Image Perceptual Score (GLIPS): Evaluating Photorealistic Quality of AI-Generated Images15 May 2024
- 2024Sketch2Human: Deep Human Generation with Disentangled Geometry and Appearance Control24 Apr 2024
- 2023A Two-stage Personalized Virtual Try-on Framework with Shape Control and Texture Guidance24 Dec 2023
- 2023Synthesizing Environment-Specific People in Photographs22 Dec 2023
12 newest of 40 All 40 (JSON)