Towards Better Adversarial Synthesis of Human Images from Text
Not on the map. Why?
Abstract (arXiv)
This paper proposes an approach that generates multiple 3D human meshes from text. The human shapes are represented by 3D meshes based on the SMPL model. The model's performance is evaluated on the COCO dataset, which contains challenging human shapes and intricate interactions between individuals. The model is able to capture the dynamics of the scene and the interactions between individuals based on text. We further show how using such a shape as input to image synthesis frameworks helps to constrain the network to synthesize humans with realistic human shapes.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 27 of its 41 references that are in the map. First posted on arXiv 5 Jul 2021.
Builds on
27 of 41 references.
References · 27
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2016Generative Adversarial Text to Image Synthesiscited by 735
- 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
- 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 575
- 2017Neural 3D Mesh Renderercited by 437
- 2017Real-valued (Medical) Time Series Generation with Recurrent Conditional GANscited by 329
- 2019DM-GAN: Dynamic Memory Generative Adversarial Networks for Text-to-Image Synthesiscited by 308
- 2017Pose Guided Person Image Generationcited by 251
15 more
- 2019MirrorGAN: Learning Text-to-image Generation by Redescriptioncited by 176
- 2018StoryGAN: A Sequential Conditional GAN for Story Visualizationcited by 137
- 2016C-RNN-GAN: Continuous recurrent neural networks with adversarial trainingcited by 132
- 2019Generating 3D People in Scenes without Peoplecited by 127
- 2019Object-driven Text-to-Image Synthesis via Adversarial Trainingcited by 117
- 2016Learning What and Where to Drawcited by 105
- 2020XingGAN for Person Image Generationcited by 81
- 2019Putting Humans in a Scene: Learning Affordance in 3D Indoor Environmentscited by 72
- 2020SMPLpix: Neural Avatars from 3D Human Modelscited by 69
- 2017CycleGAN, a Master of Steganographycited by 63
- 2017Towards Diverse and Natural Image Descriptions via a Conditional GANcited by 59
- 2017Be Your Own Prada: Fashion Synthesis with Structural Coherencecited by 49
- 2020Bipartite Graph Reasoning GANs for Person Image Generationcited by 34
- 2019Text Guided Person Image Synthesiscited by 22
- 2020Adversarial Synthesis of Human Pose from Textcited by 7
Built on by
Citing papers per year: 2022: 2; 2023: 3; 2024: 1; 2025: 1.
7 papers.
- 2023ChatPose: Chatting about 3D Human Posecited by 71
- 2023Make-An-Animation: Large-Scale Text-conditional 3D Human Motion Generationcited by 56
- 2024UniPose: A Unified Multimodal Framework for Human Pose Comprehension, Generation and Editingcited by 18
- 2022PoseScript: Linking 3D Human Poses and Natural Languagecited by 13
- 2022TIPS: Text-Induced Pose Synthesiscited by 11
- 2023Text-Conditional Contextualized Avatars For Zero-Shot Personalizationcited by 3
- 2025CoT-Pose: Chain-of-Thought Reasoning for 3D Pose Generation from Abstract Promptscited by 2
- 2025CoT-Pose: Chain-of-Thought Reasoning for 3D Pose Generation from Abstract Prompts11 Aug 2025
- 2024UniPose: A Unified Multimodal Framework for Human Pose Comprehension, Generation and Editing25 Nov 2024
- 2023ChatPose: Chatting about 3D Human Pose30 Nov 2023
- 2023Make-An-Animation: Large-Scale Text-conditional 3D Human Motion Generation16 May 2023
- 2023Text-Conditional Contextualized Avatars For Zero-Shot Personalization14 Apr 2023
- 2022PoseScript: Linking 3D Human Poses and Natural Language21 Oct 2022
- 2022TIPS: Text-Induced Pose Synthesis24 Jul 2022