StylePeople: A Generative Model of Fullbody Human Avatars
Not on the map. Why?
Abstract (arXiv)
We propose a new type of full-body human avatars, which combines parametric mesh-based body model with a neural texture. We show that with the help of neural textures, such avatars can successfully model clothing and hair, which usually poses a problem for mesh-based approaches. We also show how these avatars can be created from multiple frames of a video using backpropagation. We then propose a generative model for such avatars that can be trained from datasets of images and videos of people. The generative model allows us to sample random avatars as well as to create dressed avatars of people from one or few images. The code for the project is available at saic-violet.github.io/style-people.
Key facts. Cited by 62 papers in the map (data through 7 Oct 2026). Builds on 50 of its 57 references that are in the map. First posted on arXiv 16 Apr 2021.
Builds on
50 of 57 references.
References · 50
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2016Improved Techniques for Training GANscited by 2,938
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
38 more
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2020First Order Motion Model for Image Animationcited by 698
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2018Video-to-Video Synthesiscited by 388
- 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
- 2020StyleRig: Rigging StyleGAN for 3D Control over Portrait Imagescited by 267
- 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
- 2019Deferred Neural Rendering: Image Synthesis using Neural Texturescited by 253
- 2017Pose Guided Person Image Generationcited by 251
- 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 244
- 2018Video Based Reconstruction of 3D People Modelscited by 237
- 2020Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulationcited by 225
- 2019Few-shot Video-to-Video Synthesiscited by 196
- 2020Semantic Photo Manipulation with a Generative Image Priorcited by 178
- 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
- 2017Deformable GANs for Pose-based Human Image Generationcited by 166
- 2019Tex2Shape: Detailed Full Human Body Geometry From a Single Imagecited by 166
- 2018Monocular Total Capture: Posing Face, Body, and Hands in the Wildcited by 162
- 2019Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesiscited by 161
- 2020Monocular Expressive Body Regression through Body-Driven Attentioncited by 155
- 2018A Variational U-Net for Conditional Appearance and Shape Generationcited by 124
- 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 114
- 2018Dense Pose Transfercited by 83
- 2019Graphonomy: Universal Human Parsing via Graph Transfer Learningcited by 81
- 2019360-Degree Textures of People in Clothing from a Single Imagecited by 75
- 2019Learning Generalisable Omni-Scale Representations for Person Re-Identificationcited by 73
- 2019Textured Neural Avatarscited by 65
- 2018Soft-Gated Warping-GAN for Pose-Guided Person Image Synthesiscited by 59
- 2020Learning to Transfer Texture from Clothing Images to 3D Humanscited by 58
- 2017A Generative Model of People in Clothingcited by 37
- 2020DeepLandscape: Adversarial Modeling of Landscape Videocited by 17
- 2018Coordinate-based Texture Inpainting for Pose-Guided Image Generationcited by 10
Built on by
Citing papers per year: 2021: 6; 2022: 16; 2023: 25; 2024: 12; 2025: 1; 2026: 2.
62 papers.
Sort:
By area:
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
- 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
- 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2022Generative Neural Articulated Radiance Fieldscited by 101
- 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
- 2022Unsupervised Learning of Efficient Geometry-Aware Neural Articulated Representationscited by 65
- 2024Advances in 3D Generation: A Surveycited by 62
- 2023Gaussian Shell Maps for Efficient 3D Human Generationcited by 61
- 2022AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatarscited by 55
- 2023AG3D: Learning to Generate 3D Avatars from 2D Image Collectionscited by 55
38 more
- 2023Learning Locally Editable Virtual Humanscited by 54
- 2021HVTR: Hybrid Volumetric-Textural Rendering for Human Avatarscited by 33
- 2022HumanGen: Generating Human Radiance Fields with Explicit Priorscited by 33
- 2023Towards Garment Sewing Pattern Reconstruction from a Single Imagecited by 33
- 2023Disentangled Clothed Avatar Generation from Text Descriptionscited by 33
- 20213D-Aware Semantic-Guided Generative Model for Human Synthesiscited by 31
- 2022Text2Human: Text-Driven Controllable Human Image Generationcited by 31
- 2023SMPLitex: A Generative Model and Dataset for 3D Human Texture Estimation from Single Imagecited by 30
- 2024HAHA: Highly Articulated Gaussian Human Avatars with Textured Mesh Priorcited by 30
- 2023DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatarscited by 28
- 2021Unsupervised Learning of Fine Structure Generation for 3D Point Clouds by 2D Projection Matchingcited by 26
- 2023HumanLiff: Layer-wise 3D Human Generation with Diffusion Modelcited by 23
- 2023Drivable Avatar Clothing: Faithful Full-Body Telepresence with Dynamic Clothing Driven by Sparse RGB-D Inputcited by 22
- 2023CaPhy: Capturing Physical Properties for Animatable Human Avatarscited by 20
- 2022Dressing Avatars: Deep Photorealistic Appearance for Physically Simulated Clothingcited by 19
- 2022DINER: Depth-aware Image-based NEural Radiance fieldscited by 19
- 2023Neural Image-based Avatars: Generalizable Radiance Fields for Human Avatar Modelingcited by 19
- 2023Unsupervised Volumetric Animationcited by 18
- 2023RaBit: Parametric Modeling of 3D Biped Cartoon Characters with a Topological-consistent Datasetcited by 18
- 20223DHumanGAN: 3D-Aware Human Image Generation with 3D Pose Mappingcited by 17
- 2024StructLDM: Structured Latent Diffusion for 3D Human Generationcited by 17
- 2021Dance In the Wild: Monocular Human Animation with Neural Dynamic Appearance Synthesiscited by 14
- 2024TexDreamer: Towards Zero-Shot High-Fidelity 3D Human Texture Generationcited by 14
- 2023Efficient 3D Articulated Human Generation with Layered Surface Volumescited by 13
- 2024A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generationcited by 13
- 2022RANA: Relightable Articulated Neural Avatarscited by 12
- 2022Human Image Generation: A Comprehensive Surveycited by 11
- 2024E3Gen: Efficient, Expressive and Editable Avatars Generationcited by 10
- 2024SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimationcited by 9
- 2023Generating Texture for 3D Human Avatar from a Single Image using Sampling and Refinement Networkscited by 8
- 2023VeRi3D: Generative Vertex-based Radiance Fields for 3D Controllable Human Image Synthesiscited by 8
- 2023MoRF: Mobile Realistic Fullbody Avatars from a Monocular Videocited by 7
- 2023SCULPT: Shape-Conditioned Unpaired Learning of Pose-dependent Clothed and Textured Human Meshescited by 7
- 2023Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Modelscited by 6
- 2022REMOT: A Region-to-Whole Framework for Realistic Human Motion Transfercited by 4
- 2023A Generative Multi-Resolution Pyramid and Normal-Conditioning 3D Cloth Drapingcited by 4
- 2023Synthesizing Environment-Specific People in Photographscited by 4
- 2024TexVocab: Texture Vocabulary-conditioned Human Avatarscited by 4
50 most cited of 62 All 62 (JSON)
- 2026NBAvatar: Neural Billboards Avatars with Realistic Hand-Face Interaction12 Mar 2026
- 2026PoseGaussian: Pose-Driven Novel View Synthesis for Robust 3D Human Reconstruction5 Feb 2026
- 2025PARTE: Part-Guided Texturing for 3D Human Reconstruction from a Single Image23 Jul 2025
- 2024Are Pose Estimators Ready for the Open World? STAGE: A GenAI Toolkit for Auditing 3D Human Pose Estimators28 Aug 2024
- 2024A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generation6 Jun 2024
- 2024E3Gen: Efficient, Expressive and Editable Avatars Generation29 May 2024
- 2024HR Human: Modeling Human Avatars with Triangular Mesh and High-Resolution Textures from Videos18 May 2024
- 2024SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimation23 Apr 2024
- 2024FashionEngine: Interactive 3D Human Generation and Editing via Multimodal Controls2 Apr 2024
- 2024StructLDM: Structured Latent Diffusion for 3D Human Generation1 Apr 2024
- 2024HAHA: Highly Articulated Gaussian Human Avatars with Textured Mesh Prior1 Apr 2024
- 2024TexVocab: Texture Vocabulary-conditioned Human Avatars31 Mar 2024
38 more
- 2024TexDreamer: Towards Zero-Shot High-Fidelity 3D Human Texture Generation19 Mar 2024
- 2024SemanticHuman-HD: High-Resolution Semantic Disentangled 3D Human Generation15 Mar 2024
- 2024Advances in 3D Generation: A Survey31 Jan 2024
- 2023Synthesizing Environment-Specific People in Photographs22 Dec 2023
- 2023Disentangled Clothed Avatar Generation from Text Descriptions8 Dec 2023
- 2023Gaussian Shell Maps for Efficient 3D Human Generation29 Nov 2023
- 2023Towards Garment Sewing Pattern Reconstruction from a Single Image7 Nov 2023
- 2023A Generative Multi-Resolution Pyramid and Normal-Conditioning 3D Cloth Draping5 Nov 2023
- 2023Drivable Avatar Clothing: Faithful Full-Body Telepresence with Dynamic Clothing Driven by Sparse RGB-D Input9 Oct 2023
- 2023VeRi3D: Generative Vertex-based Radiance Fields for 3D Controllable Human Image Synthesis9 Sep 2023
- 2023SMPLitex: A Generative Model and Dataset for 3D Human Texture Estimation from Single Image4 Sep 2023
- 2023SCULPT: Shape-Conditioned Unpaired Learning of Pose-dependent Clothed and Textured Human Meshes21 Aug 2023
- 2023HumanLiff: Layer-wise 3D Human Generation with Diffusion Model18 Aug 2023
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humans16 Aug 2023
- 2023CaPhy: Capturing Physical Properties for Animatable Human Avatars11 Aug 2023
- 2023Efficient 3D Articulated Human Generation with Layered Surface Volumes11 Jul 2023
- 2023Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Models10 Jul 2023
- 2023AG3D: Learning to Generate 3D Avatars from 2D Image Collections3 May 2023
- 2023Generating Texture for 3D Human Avatar from a Single Image using Sampling and Refinement Networks1 May 2023
- 2023Learning Locally Editable Virtual Humans28 Apr 2023
- 2023ContraNeRF: 3D-Aware Generative Model via Contrastive Learning with Unsupervised Implicit Pose Embedding27 Apr 2023
- 2023UVA: Towards Unified Volumetric Avatar for View Synthesis, Pose rendering, Geometry and Texture Editing14 Apr 2023
- 2023Neural Image-based Avatars: Generalizable Radiance Fields for Human Avatar Modeling10 Apr 2023
- 2023RaBit: Parametric Modeling of 3D Biped Cartoon Characters with a Topological-consistent Dataset22 Mar 2023
- 2023MoRF: Mobile Realistic Fullbody Avatars from a Monocular Video17 Mar 2023
- 2023DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatars16 Mar 2023
- 2023Refining 3D Human Texture Estimation from a Single Image6 Mar 2023
- 2023Unsupervised Volumetric Animation26 Jan 2023
- 2022Human Image Generation: A Comprehensive Survey17 Dec 2022
- 2022ECON: Explicit Clothed humans Optimized via Normal integration14 Dec 2022
- 20223DHumanGAN: 3D-Aware Human Image Generation with 3D Pose Mapping14 Dec 2022
- 2022HumanGen: Generating Human Radiance Fields with Explicit Priors10 Dec 2022
- 2022RANA: Relightable Articulated Neural Avatars6 Dec 2022
- 2022DINER: Depth-aware Image-based NEural Radiance fields29 Nov 2022
- 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatars21 Nov 2022
- 2022EVA3D: Compositional 3D Human Generation from 2D Image Collections10 Oct 2022
- 2022REMOT: A Region-to-Whole Framework for Realistic Human Motion Transfer1 Sep 2022
- 2022Dressing Avatars: Deep Photorealistic Appearance for Physically Simulated Clothing30 Jun 2022
50 newest of 62 All 62 (JSON)
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2023DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatarscited by 28
- 2023HumanLiff: Layer-wise 3D Human Generation with Diffusion Modelcited by 23
- 2024StructLDM: Structured Latent Diffusion for 3D Human Generationcited by 17
- 2023Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Modelscited by 6
- 2024FashionEngine: Interactive 3D Human Generation and Editing via Multimodal Controlscited by 0
- 2024FashionEngine: Interactive 3D Human Generation and Editing via Multimodal Controls2 Apr 2024
- 2024StructLDM: Structured Latent Diffusion for 3D Human Generation1 Apr 2024
- 2023HumanLiff: Layer-wise 3D Human Generation with Diffusion Model18 Aug 2023
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humans16 Aug 2023
- 2023Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Models10 Jul 2023
- 2023DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatars16 Mar 2023
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
- 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
- 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
- 2022Generative Neural Articulated Radiance Fieldscited by 101
- 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
- 2022Unsupervised Learning of Efficient Geometry-Aware Neural Articulated Representationscited by 65
- 2024Advances in 3D Generation: A Surveycited by 62
- 2023Gaussian Shell Maps for Efficient 3D Human Generationcited by 61
- 2022AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatarscited by 55
- 2023AG3D: Learning to Generate 3D Avatars from 2D Image Collectionscited by 55
- 2023Learning Locally Editable Virtual Humanscited by 54
12 most cited of 56 All 56 (JSON)
- 2026NBAvatar: Neural Billboards Avatars with Realistic Hand-Face Interaction12 Mar 2026
- 2026PoseGaussian: Pose-Driven Novel View Synthesis for Robust 3D Human Reconstruction5 Feb 2026
- 2025PARTE: Part-Guided Texturing for 3D Human Reconstruction from a Single Image23 Jul 2025
- 2024Are Pose Estimators Ready for the Open World? STAGE: A GenAI Toolkit for Auditing 3D Human Pose Estimators28 Aug 2024
- 2024A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generation6 Jun 2024
- 2024E3Gen: Efficient, Expressive and Editable Avatars Generation29 May 2024
- 2024HR Human: Modeling Human Avatars with Triangular Mesh and High-Resolution Textures from Videos18 May 2024
- 2024SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimation23 Apr 2024
- 2024HAHA: Highly Articulated Gaussian Human Avatars with Textured Mesh Prior1 Apr 2024
- 2024TexVocab: Texture Vocabulary-conditioned Human Avatars31 Mar 2024
- 2024TexDreamer: Towards Zero-Shot High-Fidelity 3D Human Texture Generation19 Mar 2024
- 2024SemanticHuman-HD: High-Resolution Semantic Disentangled 3D Human Generation15 Mar 2024
12 newest of 56 All 56 (JSON)