mlsanityData to 7 Oct 2026

Synthesizing Anyone, Anywhere, in Any Pose

arXiv 2304.03164 ↗First posted 6 Apr 2023cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

We address the task of in-the-wild human figure synthesis, where the primary goal is to synthesize a full body given any region in any image. In-the-wild human figure synthesis has long been a challenging and under-explored task, where current methods struggle to handle extreme poses, occluding objects, and complex backgrounds. Our main contribution is TriA-GAN, a keypoint-guided GAN that can synthesize Anyone, Anywhere, in Any given pose. Key to our method is projected GANs combined with a well-crafted training strategy, where our simple generator architecture can successfully handle the challenges of in-the-wild full-body synthesis. We show that TriA-GAN significantly improves over previous in-the-wild full-body synthesis methods, all while requiring less conditional information for synthesis (keypoints vs DensePose). Finally, we show that the latent space of TriA-GAN is compatible with standard unconditional editing techniques, enabling text-guided editing of generated human figures.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 63 of its 82 references that are in the map. First posted on arXiv 6 Apr 2023.

Builds on

63 of 82 references.

References · 63

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  8. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  9. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  10. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  11. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  12. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
38 more
  1. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  2. 2017Improved Training of Wasserstein GANscited by 2,223
  3. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  4. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  5. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  6. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
  7. 2021Going deeper with Image Transformerscited by 759
  8. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
  9. 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
  10. 2018Generative Image Inpainting with Contextual Attentioncited by 578
  11. 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
  12. 2016Conditional Image Synthesis With Auxiliary Classifier GANscited by 562
  13. 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
  14. 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 489
  15. 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
  16. 2018Everybody Dance Nowcited by 313
  17. 2017VITON: An Image-based Virtual Try-on Networkcited by 285
  18. 2017Pose Guided Person Image Generationcited by 251
  19. 2022The Role of ImageNet Classes in Fr'echet Inception Distancecited by 211
  20. 2021Projected GANs Converge Fastercited by 204
  21. 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 200
  22. 2017Deformable GANs for Pose-based Human Image Generationcited by 166
  23. 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
  24. 2020A U-Net Based Discriminator for Generative Adversarial Networkscited by 128
  25. 2018A Variational U-Net for Conditional Appearance and Shape Generationcited by 124
  26. 2020Contextual Residual Aggregation for Ultra High-Resolution Image Inpaintingcited by 124
  27. 2019StructureFlow: Image Inpainting via Structure-aware Appearance Flowcited by 118
  28. 2019SC-FEGAN: Face Editing Generative Adversarial Network with User's Sketch and Colorcited by 105
  29. 2019Dense Intrinsic Appearance Flow for Human Pose Transfercited by 104
  30. 2017Disentangled Person Image Generationcited by 98
  31. 2019Coherent Semantic Attention for Image Inpaintingcited by 97
  32. 2018Synthesizing Images of Humans in Unseen Posescited by 96
  33. 2019Foreground-aware Image Inpaintingcited by 90
  34. 2018Dense Pose Transfercited by 83
  35. 2020High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsamplingcited by 79
  36. 2020Continuous Surface Embeddingscited by 79
  37. 2018The Unusual Effectiveness of Averaging in GAN Trainingcited by 73
  38. 2021Neural Re-Rendering of Humans from a Single Imagecited by 59

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year

Citing papers per year: 2023: 2.

2 papers.