mlsanityData to 7 Oct 2026

A Survey of Body and Face Motion: Datasets, Performance Evaluation Metrics and Generative Techniques

arXiv 2512.09005 ↗First posted 9 Dec 2025cs.CV cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Body and face motion play an integral role in communication. They convey crucial information on the participants. Advances in generative modeling and multi-modal learning have enabled motion generation from signals such as speech, conversational context and visual cues. However, generating expressive and coherent face and body dynamics remains challenging due to the complex interplay of verbal / non-verbal cues and individual personality traits. This survey reviews body and face motion generation, covering core concepts, representations techniques, generative approaches, datasets and evaluation metrics. We highlight future directions to enhance the realism, coherence and expressiveness of avatars in dyadic settings. To the best of our knowledge, this work is the first comprehensive review to cover both body and face motion. Detailed resources are listed on https://lownish23csz0010.github.io/mogen/.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 156 of its 202 references that are in the map. First posted on arXiv 9 Dec 2025.

Builds on

156 of 202 references.

References · 156

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2022Generative Adversarial Networkscited by 5,603
  4. 2013Auto-Encoding Variational Bayescited by 3,980
  5. 2015Variational Inference with Normalizing Flowscited by 2,161
  6. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  7. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  8. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  9. 2022Human Motion Diffusion Modelcited by 1,062
  10. 2018VoxCeleb2: Deep Speaker Recognitioncited by 862
  11. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  12. 2017VoxCeleb: a large-scale speaker identification datasetcited by 714
38 more
  1. 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 683
  2. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
  3. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  4. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
  5. 2019NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understandingcited by 530
  6. 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
  7. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
  8. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
  9. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  10. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
  11. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
  12. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
  13. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
  14. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
  15. 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 397
  16. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
  17. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 380
  18. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
  19. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
  20. 2016The KIT Motion-Language Datasetcited by 334
  21. 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
  22. 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 294
  23. 2022EDGE: Editable Dance Generation From Musiccited by 284
  24. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
  25. 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
  26. 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
  27. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
  28. 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
  29. 2016Lip Reading Sentences in the Wildcited by 226
  30. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 220
  31. 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 220
  32. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  33. 2018Talking Face Generation by Adversarially Disentangled Audio-Visual Representationcited by 212
  34. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 205
  35. 2021Stochastic Scene-Aware Motion Predictioncited by 203
  36. 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 202
  37. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 194
  38. 2020Long-term Human Motion Prediction with Scene Contextcited by 191

50 most cited of 156 All 156 (JSON)

Built on by

Not cited yet.