Synthesizing Anyone, Anywhere, in Any Pose
Not on the map. Why?
Abstract (arXiv)
We address the task of in-the-wild human figure synthesis, where the primary goal is to synthesize a full body given any region in any image. In-the-wild human figure synthesis has long been a challenging and under-explored task, where current methods struggle to handle extreme poses, occluding objects, and complex backgrounds. Our main contribution is TriA-GAN, a keypoint-guided GAN that can synthesize Anyone, Anywhere, in Any given pose. Key to our method is projected GANs combined with a well-crafted training strategy, where our simple generator architecture can successfully handle the challenges of in-the-wild full-body synthesis. We show that TriA-GAN significantly improves over previous in-the-wild full-body synthesis methods, all while requiring less conditional information for synthesis (keypoints vs DensePose). Finally, we show that the latent space of TriA-GAN is compatible with standard unconditional editing techniques, enabling text-guided editing of generated human figures.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 63 of its 82 references that are in the map. First posted on arXiv 6 Apr 2023.
Builds on
63 of 82 references.
References · 63
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
38 more
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2021Going deeper with Image Transformerscited by 759
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2018Generative Image Inpainting with Contextual Attentioncited by 578
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
- 2016Conditional Image Synthesis With Auxiliary Classifier GANscited by 562
- 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
- 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 489
- 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
- 2018Everybody Dance Nowcited by 313
- 2017VITON: An Image-based Virtual Try-on Networkcited by 285
- 2017Pose Guided Person Image Generationcited by 251
- 2022The Role of ImageNet Classes in Fr'echet Inception Distancecited by 211
- 2021Projected GANs Converge Fastercited by 204
- 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 200
- 2017Deformable GANs for Pose-based Human Image Generationcited by 166
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
- 2020A U-Net Based Discriminator for Generative Adversarial Networkscited by 128
- 2018A Variational U-Net for Conditional Appearance and Shape Generationcited by 124
- 2020Contextual Residual Aggregation for Ultra High-Resolution Image Inpaintingcited by 124
- 2019StructureFlow: Image Inpainting via Structure-aware Appearance Flowcited by 118
- 2019SC-FEGAN: Face Editing Generative Adversarial Network with User's Sketch and Colorcited by 105
- 2019Dense Intrinsic Appearance Flow for Human Pose Transfercited by 104
- 2017Disentangled Person Image Generationcited by 98
- 2019Coherent Semantic Attention for Image Inpaintingcited by 97
- 2018Synthesizing Images of Humans in Unseen Posescited by 96
- 2019Foreground-aware Image Inpaintingcited by 90
- 2018Dense Pose Transfercited by 83
- 2020High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsamplingcited by 79
- 2020Continuous Surface Embeddingscited by 79
- 2018The Unusual Effectiveness of Averaging in GAN Trainingcited by 73
- 2021Neural Re-Rendering of Humans from a Single Imagecited by 59
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2023: 2.
2 papers.