InsetGAN for Full-Body Image Generation
Not on the map. Why?
Abstract (arXiv)
While GANs can produce photo-realistic images in ideal conditions for certain domains, the generation of full-body human images remains difficult due to the diversity of identities, hairstyles, clothing, and the variance in pose. Instead of modeling this complex domain with a single GAN, we propose a novel method to combine multiple pretrained GANs, where one GAN generates a global canvas (e.g., human body) and a set of specialized GANs, or insets, focus on different parts (e.g., faces, shoes) that can be seamlessly inserted onto the global canvas. We model the problem as jointly exploring the respective latent spaces such that the generated images can be combined, by inserting the parts from the specialized generators onto the global canvas, without introducing seams. We demonstrate the setup by combining a full body GAN with a dedicated high-quality face GAN to produce plausible-looking humans. We evaluate our results with quantitative metrics and user studies.
Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). Builds on 30 of its 35 references that are in the map. First posted on arXiv 14 Mar 2022.
Builds on
30 of 35 references.
References · 30
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Generative Adversarial Networkscited by 5,603
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
18 more
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2021GAN Inversion: A Surveycited by 366
- 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
- 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
- 2017Pose Guided Person Image Generationcited by 251
- 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2020Controllable Person Image Synthesis with Attribute-Decomposed GANcited by 150
- 2019Boundless: Generative Adversarial Networks for Image Extensioncited by 62
- 2021Pose with Style: Detail-Preserving Pose-Guided Image Synthesis with Conditional StyleGANcited by 45
- 2021TryOnGAN: Body-Aware Try-On via Layered Interpolationcited by 31
- 2021Human De-occlusion: Invisible Perception and Recovery for Humanscited by 31
- 2021Collaging Class-specific GANs for Semantic Image Synthesiscited by 25
- 2019Appearance and Pose-Conditioned Human Image Generation using Deformable GANscited by 24
- 2019TileGAN: Synthesis of Large-Scale Non-Homogeneous Texturescited by 15
- 2021Learning Realistic Human Reposing using Cyclic Self-Supervision with 3D Shape, Pose, and Appearance Consistencycited by 15
- 2019Controllable and Progressive Image Extrapolationcited by 13
- 2020Reposing Humans by Warping 3D Featurescited by 13
Built on by
Citing papers per year: 2022: 13; 2023: 21; 2024: 5; 2025: 5; 2026: 1.
45 papers.
Sort:
By area:
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
- 2023GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learningcited by 120
- 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
- 2022Generative Neural Articulated Radiance Fieldscited by 101
- 2022AvatarGen: A 3D Generative Model for Animatable Human Avatarscited by 59
- 2023MVHumanNet: A Large-scale Dataset of Multi-view Daily Dressing Human Capturescited by 54
- 2023PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generationcited by 33
- 2022Text2Human: Text-Driven Controllable Human Image Generationcited by 31
- 2023DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatarscited by 28
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Modelscited by 24
- 2023HumanLiff: Layer-wise 3D Human Generation with Diffusion Modelcited by 23
- 2023Chupa: Carving 3D Clothed Humans from Skinned Shape Priors using 2D Diffusion Probabilistic Modelscited by 20
33 more
- 2023Get3DHuman: Lifting StyleGAN-Human into a 3D Generative Model using Pixel-aligned Reconstruction Priorscited by 19
- 2023Deep Learning Technique for Human Parsing: A Survey and Outlookcited by 18
- 20223DHumanGAN: 3D-Aware Human Image Generation with 3D Pose Mappingcited by 17
- 2024StructLDM: Structured Latent Diffusion for 3D Human Generationcited by 17
- 2023VIVE3D: Viewpoint-Independent Video Editing using 3D-Aware GANscited by 16
- 2023AniPortraitGAN: Animatable 3D Portrait Generation from 2D Image Collectionscited by 16
- 2022PASTA-GAN++: A Versatile Framework for High-Resolution Unpaired Virtual Try-oncited by 15
- 2023Efficient 3D Articulated Human Generation with Layered Surface Volumescited by 13
- 2022HS-Diffusion: Semantic-Mixing Diffusion for Head Swappingcited by 12
- 2023FashionTex: Controllable Virtual Try-on with Text and Texturecited by 9
- 2023UnitedHuman: Harnessing Multi-Source Data for High-Resolution Human Generationcited by 9
- 2025MVHumanNet++: A Large-scale Dataset of Multi-view Daily Dressing Human Captures with Richer Annotations for 3D Human Digitizationcited by 9
- 2023VeRi3D: Generative Vertex-based Radiance Fields for 3D Controllable Human Image Synthesiscited by 8
- 2023What Decreases Editing Capability? Domain-Specific Hybrid Refinement for Improved GAN Inversioncited by 7
- 2023Total Selfie: Generating Full-Body Selfiescited by 5
- 2022Synthesizing Photorealistic Virtual Humans Through Cross-modal Disentanglementcited by 4
- 2022LSAP: Rethinking Inversion Fidelity, Perception and Editability in GAN Latent Spacecited by 4
- 2023Synthesizing Environment-Specific People in Photographscited by 4
- 2023VidStyleODE: Disentangled Video Editing via StyleGAN and NeuralODEscited by 3
- 2023FIANCEE: Faster Inference of Adversarial Networks via Conditional Early Exitscited by 3
- 2023Synthesizing Anyone, Anywhere, in Any Posecited by 2
- 2025Controllable and Expressive One-Shot Video Head Swappingcited by 2
- 2022A Survey on Leveraging Pre-trained Generative Adversarial Networks for Image Editing and Restorationcited by 1
- 2022Clear Memory-Augmented Auto-Encoder for Surface Defect Detectioncited by 1
- 2024Sketch2Human: Deep Human Generation with Disentangled Geometry and Appearance Controlcited by 1
- 2022AvatarGen: a 3D Generative Model for Animatable Human Avatarscited by 0
- 2023One-Shot Stylization for Full-Body Human Imagescited by 0
- 2024CIMGEN: Controlled Image Manipulation by Finetuning Pretrained Generative Models on Limited Datacited by 0
- 2024FashionEngine: Interactive 3D Human Generation and Editing via Multimodal Controlscited by 0
- 2025Fine-Grained Controllable Apparel Showcase Image Generation via Garment-Centric Outpaintingcited by 0
- 2025Exploring Disentangled and Controllable Human Image Synthesis: From End-to-End to Stage-by-Stagecited by 0
- 2025FashionMAC: Deformation-Free Fashion Image Generation with Fine-Grained Model Appearance Customizationcited by 0
- 2026Generating Key Postures of Bharatanatyam Adavus with Pose Estimationcited by 0
- 2026Generating Key Postures of Bharatanatyam Adavus with Pose Estimation31 Mar 2026
- 2025FashionMAC: Deformation-Free Fashion Image Generation with Fine-Grained Model Appearance Customization18 Nov 2025
- 2025Controllable and Expressive One-Shot Video Head Swapping20 Jun 2025
- 2025MVHumanNet++: A Large-scale Dataset of Multi-view Daily Dressing Human Captures with Richer Annotations for 3D Human Digitization3 May 2025
- 2025Exploring Disentangled and Controllable Human Image Synthesis: From End-to-End to Stage-by-Stage25 Mar 2025
- 2025Fine-Grained Controllable Apparel Showcase Image Generation via Garment-Centric Outpainting3 Mar 2025
- 2024Sketch2Human: Deep Human Generation with Disentangled Geometry and Appearance Control24 Apr 2024
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Models24 Apr 2024
- 2024FashionEngine: Interactive 3D Human Generation and Editing via Multimodal Controls2 Apr 2024
- 2024StructLDM: Structured Latent Diffusion for 3D Human Generation1 Apr 2024
- 2024CIMGEN: Controlled Image Manipulation by Finetuning Pretrained Generative Models on Limited Data23 Jan 2024
- 2023Synthesizing Environment-Specific People in Photographs22 Dec 2023
33 more
- 2023PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generation7 Dec 2023
- 2023MVHumanNet: A Large-scale Dataset of Multi-view Daily Dressing Human Captures5 Dec 2023
- 2023UnitedHuman: Harnessing Multi-Source Data for High-Resolution Human Generation25 Sep 2023
- 2023VeRi3D: Generative Vertex-based Radiance Fields for 3D Controllable Human Image Synthesis9 Sep 2023
- 2023AniPortraitGAN: Animatable 3D Portrait Generation from 2D Image Collections5 Sep 2023
- 2023Total Selfie: Generating Full-Body Selfies28 Aug 2023
- 2023HumanLiff: Layer-wise 3D Human Generation with Diffusion Model18 Aug 2023
- 2023Efficient 3D Articulated Human Generation with Layered Surface Volumes11 Jul 2023
- 2023Chupa: Carving 3D Clothed Humans from Skinned Shape Priors using 2D Diffusion Probabilistic Models19 May 2023
- 2023FashionTex: Controllable Virtual Try-on with Text and Texture8 May 2023
- 2023FIANCEE: Faster Inference of Adversarial Networks via Conditional Early Exits20 Apr 2023
- 2023One-Shot Stylization for Full-Body Human Images14 Apr 2023
- 2023VidStyleODE: Disentangled Video Editing via StyleGAN and NeuralODEs12 Apr 2023
- 2023Synthesizing Anyone, Anywhere, in Any Pose6 Apr 2023
- 2023VIVE3D: Viewpoint-Independent Video Editing using 3D-Aware GANs28 Mar 2023
- 2023GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learning24 Mar 2023
- 2023DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatars16 Mar 2023
- 2023Get3DHuman: Lifting StyleGAN-Human into a 3D Generative Model using Pixel-aligned Reconstruction Priors2 Feb 2023
- 2023What Decreases Editing Capability? Domain-Specific Hybrid Refinement for Improved GAN Inversion28 Jan 2023
- 2023Deep Learning Technique for Human Parsing: A Survey and Outlook1 Jan 2023
- 20223DHumanGAN: 3D-Aware Human Image Generation with 3D Pose Mapping14 Dec 2022
- 2022HS-Diffusion: Semantic-Mixing Diffusion for Head Swapping13 Dec 2022
- 2022AvatarGen: A 3D Generative Model for Animatable Human Avatars26 Nov 2022
- 2022EVA3D: Compositional 3D Human Generation from 2D Image Collections10 Oct 2022
- 2022LSAP: Rethinking Inversion Fidelity, Perception and Editability in GAN Latent Space26 Sep 2022
- 2022Synthesizing Photorealistic Virtual Humans Through Cross-modal Disentanglement3 Sep 2022
- 2022Clear Memory-Augmented Auto-Encoder for Surface Defect Detection8 Aug 2022
- 2022AvatarGen: a 3D Generative Model for Animatable Human Avatars1 Aug 2022
- 2022PASTA-GAN++: A Versatile Framework for High-Resolution Unpaired Virtual Try-on27 Jul 2022
- 2022A Survey on Leveraging Pre-trained Generative Adversarial Networks for Image Editing and Restoration21 Jul 2022
- 2022Generative Neural Articulated Radiance Fields28 Jun 2022
- 2022Text2Human: Text-Driven Controllable Human Image Generation31 May 2022
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generation25 Apr 2022
- 2023PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generationcited by 33
- 2023DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatarscited by 28
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Modelscited by 24
- 2023HumanLiff: Layer-wise 3D Human Generation with Diffusion Modelcited by 23
- 2023Chupa: Carving 3D Clothed Humans from Skinned Shape Priors using 2D Diffusion Probabilistic Modelscited by 20
- 2024StructLDM: Structured Latent Diffusion for 3D Human Generationcited by 17
- 2022HS-Diffusion: Semantic-Mixing Diffusion for Head Swappingcited by 12
- 2024FashionEngine: Interactive 3D Human Generation and Editing via Multimodal Controlscited by 0
- 2025Fine-Grained Controllable Apparel Showcase Image Generation via Garment-Centric Outpaintingcited by 0
- 2025Fine-Grained Controllable Apparel Showcase Image Generation via Garment-Centric Outpainting3 Mar 2025
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Models24 Apr 2024
- 2024FashionEngine: Interactive 3D Human Generation and Editing via Multimodal Controls2 Apr 2024
- 2024StructLDM: Structured Latent Diffusion for 3D Human Generation1 Apr 2024
- 2023PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generation7 Dec 2023
- 2023HumanLiff: Layer-wise 3D Human Generation with Diffusion Model18 Aug 2023
- 2023Chupa: Carving 3D Clothed Humans from Skinned Shape Priors using 2D Diffusion Probabilistic Models19 May 2023
- 2023DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatars16 Mar 2023
- 2022HS-Diffusion: Semantic-Mixing Diffusion for Head Swapping13 Dec 2022
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
- 2023GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learningcited by 120
- 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
- 2022Generative Neural Articulated Radiance Fieldscited by 101
- 2022AvatarGen: A 3D Generative Model for Animatable Human Avatarscited by 59
- 2023MVHumanNet: A Large-scale Dataset of Multi-view Daily Dressing Human Capturescited by 54
- 2022Text2Human: Text-Driven Controllable Human Image Generationcited by 31
- 2023Get3DHuman: Lifting StyleGAN-Human into a 3D Generative Model using Pixel-aligned Reconstruction Priorscited by 19
- 2023Deep Learning Technique for Human Parsing: A Survey and Outlookcited by 18
- 20223DHumanGAN: 3D-Aware Human Image Generation with 3D Pose Mappingcited by 17
- 2023VIVE3D: Viewpoint-Independent Video Editing using 3D-Aware GANscited by 16
- 2023AniPortraitGAN: Animatable 3D Portrait Generation from 2D Image Collectionscited by 16
12 most cited of 35 All 35 (JSON)
- 2026Generating Key Postures of Bharatanatyam Adavus with Pose Estimation31 Mar 2026
- 2025FashionMAC: Deformation-Free Fashion Image Generation with Fine-Grained Model Appearance Customization18 Nov 2025
- 2025Controllable and Expressive One-Shot Video Head Swapping20 Jun 2025
- 2025MVHumanNet++: A Large-scale Dataset of Multi-view Daily Dressing Human Captures with Richer Annotations for 3D Human Digitization3 May 2025
- 2025Exploring Disentangled and Controllable Human Image Synthesis: From End-to-End to Stage-by-Stage25 Mar 2025
- 2024Sketch2Human: Deep Human Generation with Disentangled Geometry and Appearance Control24 Apr 2024
- 2024CIMGEN: Controlled Image Manipulation by Finetuning Pretrained Generative Models on Limited Data23 Jan 2024
- 2023Synthesizing Environment-Specific People in Photographs22 Dec 2023
- 2023MVHumanNet: A Large-scale Dataset of Multi-view Daily Dressing Human Captures5 Dec 2023
- 2023UnitedHuman: Harnessing Multi-Source Data for High-Resolution Human Generation25 Sep 2023
- 2023VeRi3D: Generative Vertex-based Radiance Fields for 3D Controllable Human Image Synthesis9 Sep 2023
- 2023AniPortraitGAN: Animatable 3D Portrait Generation from 2D Image Collections5 Sep 2023
12 newest of 35 All 35 (JSON)