mlsanityData to 7 Oct 2026

Deep Person Generation: A Survey from the Perspective of Face, Pose and Cloth Synthesis

arXiv 2109.02081 ↗First posted 5 Sep 2021cs.CVcited by 16

Not on the map. Why?

Abstract (arXiv)

Deep person generation has attracted extensive research attention due to its wide applications in virtual agents, video conferencing, online shopping and art/movie production. With the advancement of deep learning, visual appearances (face, pose, cloth) of a person image can be easily generated or manipulated on demand. In this survey, we first summarize the scope of person generation, and then systematically review recent progress and technical trends in deep person generation, covering three major tasks: talking-head generation (face), pose-guided person generation (pose) and garment-oriented person generation (cloth). More than two hundred papers are covered for a thorough overview, and the milestone works are highlighted to witness the major technical breakthrough. Based on these fundamental tasks, a number of applications are investigated, e.g., virtual fitting, digital human, generative data augmentation. We hope this survey could shed some light on the future prospects of deep person generation, and provide a helpful foundation for full applications towards digital human.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 151 of its 247 references that are in the map. First posted on arXiv 5 Sep 2021.

Builds on

151 of 247 references.

References · 151

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  4. 2017Graph Attention Networkscited by 8,854
  5. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  6. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  7. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  8. 2016Improved Techniques for Training GANscited by 2,938
  9. 2014Conditional Generative Adversarial Netscited by 2,152
  10. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  11. 2015Spatial Transformer Networkscited by 1,423
  12. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
38 more
  1. 2018VoxCeleb2: Deep Speaker Recognitioncited by 862
  2. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  3. 2017VoxCeleb: a large-scale speaker identification datasetcited by 714
  4. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
  5. 2020First Order Motion Model for Image Animationcited by 698
  6. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
  7. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
  8. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
  9. 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
  10. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
  11. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  12. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
  13. 2018Video-to-Video Synthesiscited by 388
  14. 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
  15. 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
  16. 2018Deep Audio-Visual Speech Recognitioncited by 318
  17. 2018Everybody Dance Nowcited by 313
  18. 2020MakeItTalk: Speaker-Aware Talking-Head Animationcited by 310
  19. 2018LRS3-TED: a large-scale dataset for visual speech recognitioncited by 301
  20. 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
  21. 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
  22. 2017VITON: An Image-based Virtual Try-on Networkcited by 285
  23. 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
  24. 2017Unlabeled Samples Generated by GAN Improve the Person Re-identification Baseline in vitrocited by 280
  25. 2020State of the Art on Neural Renderingcited by 276
  26. 2018Deep Video Portraitscited by 265
  27. 2019Capture, Learning, and Synthesis of 3D Speaking Stylescited by 257
  28. 2019Deferred Neural Rendering: Image Synthesis using Neural Texturescited by 253
  29. 2019Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Losscited by 252
  30. 2017Pose Guided Person Image Generationcited by 251
  31. 2019Neural Voice Puppetry: Audio-driven Facial Reenactmentcited by 249
  32. 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 231
  33. 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
  34. 2018A Note on the Inception Scorecited by 225
  35. 2018Talking Face Generation by Adversarially Disentangled Audio-Visual Representationcited by 212
  36. 2019Joint Discriminative and Generative Learning for Person Re-identificationcited by 211
  37. 2020Media Forensics and DeepFakes: an overviewcited by 208
  38. 2018Animating Arbitrary Objects via Deep Motion Transfercited by 206

50 most cited of 151 All 151 (JSON)

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 4; 2024: 6; 2025: 4.

16 papers.

Sort:

By area:

  1. 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
  2. 2025Human Motion Video Generation: A Surveycited by 25
  3. 2024A Comprehensive Survey on Human Video Generation: Challenges, Methods, and Insightscited by 24
  4. 2022FNeVR: Neural Volume Rendering for Face Animationcited by 22
  5. 2022Human Image Generation: A Comprehensive Surveycited by 11
  6. 2023Motion Matters: Neural Motion Transfer for Better Camera Physiological Measurementcited by 11
  7. 2024A Comprehensive Taxonomy and Analysis of Talking Head Synthesis: Techniques for Portrait Generation, Driving Mechanisms, and Editingcited by 4
  8. 2023A Survey on Deep Multi-modal Learning for Body Language Recognition and Generationcited by 3
  9. 2023MyPortrait: Morphable Prior-Guided Personalized Portrait Generationcited by 3
  10. 2023Controllable One-Shot Face Video Synthesis With Semantic Aware Priorcited by 1
  11. 2024Personality Perception in Human Videos Altered by Motion Transfer Networkscited by 1
  12. 2025Realism to Deception: Investigating Deepfake Detectors Against Face Enhancementcited by 1
4 more
  1. 2024LawDNet: Enhanced Audio-Driven Lip Synthesis via Local Affine Warping Deformationcited by 0
  2. 2024Fusion Embedding for Pose-Guided Person Image Synthesis with Diffusion Modelcited by 0
  3. 2025Real-Time Person Image Synthesis Using a Flow Matching Modelcited by 0
  4. 2025HandCraft: Dynamic Sign Generation for Synthetic Data Augmentationcited by 0