mlsanityData to 7 Oct 2026

Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Dataset

arXiv 2307.00818 ↗First posted 3 Jul 2023cs.CVcited by 220

Not on the map. Why?

Cited by 24 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

In this paper, we present Motion-X, a large-scale 3D expressive whole-body motion dataset. Existing motion datasets predominantly contain body-only poses, lacking facial expressions, hand gestures, and fine-grained pose descriptions. Moreover, they are primarily collected from limited laboratory scenes with textual descriptions manually labeled, which greatly limits their scalability. To overcome these limitations, we develop a whole-body motion and text annotation pipeline, which can automatically annotate motion from either single- or multi-view videos and provide comprehensive semantic labels for each video and fine-grained whole-body pose descriptions for each frame. This pipeline is of high precision, cost-effective, and scalable for further research. Based on it, we construct Motion-X, which comprises 15.6M precise 3D whole-body pose annotations (i.e., SMPL-X) covering 81.1K motion sequences from massive scenes. Besides, Motion-X provides 15.6M frame-level whole-body pose descriptions and 81.1K sequence-level semantic labels. Comprehensive experiments demonstrate the accuracy of the annotation pipeline and the significant benefit of Motion-X in enhancing expressive, diverse, and natural motion generation, as well as 3D whole-body human mesh recovery.

Key facts. Cited by 220 papers in the map (data through 7 Oct 2026). Builds on 68 of its 90 references that are in the map. First posted on arXiv 3 Jul 2023.

Builds on

68 of 90 references.

References · 68

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  4. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
  5. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  6. 2022Human Motion Diffusion Modelcited by 1,062
  7. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
  8. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  9. 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
  10. 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 683
  11. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  12. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
38 more
  1. 2019NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understandingcited by 530
  2. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
  3. 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 490
  4. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  5. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
  6. 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
  7. 2017AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actionscited by 449
  8. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
  9. 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 397
  10. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
  11. 2017On human motion prediction using recurrent neural networkscited by 336
  12. 2016The KIT Motion-Language Datasetcited by 334
  13. 2019A Short Note on the Kinetics-700 Human Action Datasetcited by 308
  14. 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 294
  15. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
  16. 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
  17. 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
  18. 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 245
  19. 2021AGORA: Avatars in Geography Optimized for Regression Analysiscited by 203
  20. 2021Stochastic Scene-Aware Motion Predictioncited by 203
  21. 2022Generating Holistic 3D Human Motion from Speechcited by 180
  22. 2020Whole-Body Human Pose Estimation in the Wildcited by 178
  23. 2021Synthesis of Compositional Animations from Textual Descriptionscited by 177
  24. 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 170
  25. 2019The VIA Annotation Software for Images, Audio and Videocited by 166
  26. 2020History Repeats Itself: Human Motion Prediction via Motion Attentioncited by 164
  27. 2020MediaPipe Hands: On-device Real-time Hand Trackingcited by 157
  28. 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
  29. 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
  30. 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
  31. 2023One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformercited by 128
  32. 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
  33. 2017Text2Action: Generative Adversarial Synthesis from Language to Actioncited by 106
  34. 2017Deep representation learning for human motion prediction and classificationcited by 97
  35. 2020Accurate 3D Hand Pose Estimation for Whole-Body 3D Human Mesh Estimationcited by 81
  36. 2022GIMO: Gaze-Informed Human Motion Prediction in Contextcited by 81
  37. 2020Convolutional Autoencoders for Human Motion Infillingcited by 73
  38. 2017Learning Human Motion Models for Long-term Predictionscited by 67

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 14; 2024: 60; 2025: 86; 2026: 60.

220 papers.

Sort:

By area:

  1. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
  2. 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
  3. 2024MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captionscited by 144
  4. 2023State of the Art on Diffusion Models for Visual Computingcited by 126
  5. 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 109
  6. 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 103
  7. 2023Inter-X: Towards Versatile Human-Human Interaction Analysiscited by 98
  8. 2025Being-H0: Vision-Language-Action Pretraining from Large-Scale Human Videoscited by 94
  9. 2024MotionLLM: Understanding Human Behaviors from Human Motions and Videoscited by 89
  10. 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 80
  11. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 78
  12. 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 77
38 more
  1. 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generationcited by 75
  2. 2023PhysHOI: Physics-Based Imitation of Dynamic Human-Object Interactioncited by 72
  3. 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 67
  4. 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
  5. 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interactioncited by 63
  6. 2024HumanVid: Demystifying Training Data for Camera-controllable Human Image Animationcited by 63
  7. 2024MotionFix: Text-Driven 3D Human Motion Editingcited by 63
  8. 2024Human4DiT: 360-degree Human Video Generation with 4D Diffusion Transformercited by 61
  9. 2024MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understandingcited by 58
  10. 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimationcited by 57
  11. 2024IDOL: Instant Photorealistic 3D Human Creation from a Single Imagecited by 55
  12. 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 52
  13. 2023OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllerscited by 47
  14. 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenizationcited by 46
  15. 2025SnapMoGen: Human Motion Generation from Expressive Textscited by 44
  16. 2025Humanoid-VLA: Towards Universal Humanoid Control with Visual Integrationcited by 43
  17. 2025GENMO: A GENeralist Model for Human MOtioncited by 43
  18. 2024FreeMotion: A Unified Framework for Number-free Text-to-Motion Synthesiscited by 42
  19. 2024MoGenTS: Motion Generation based on Spatial-Temporal Joint Modelingcited by 40
  20. 2025Motion Anything: Any to Motion Generationcited by 40
  21. 2024M3GPT: An Advanced Multimodal, Multitask Framework for Motion Comprehension and Generationcited by 37
  22. 2026Kimodo: Scaling Controllable Human Motion Generationcited by 33
  23. 2024AnySkill: Learning Open-Vocabulary Physical Skill for Interactive Agentscited by 32
  24. 2024GigaHands: A Massive Annotated Dataset of Bimanual Hand Activitiescited by 32
  25. 2025SMPLest-X: Ultimate Scaling for Expressive Human Pose and Shape Estimationcited by 31
  26. 2025InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generationcited by 31
  27. 2024MotionChain: Conversational Motion Controllers via Multimodal Promptscited by 30
  28. 2025MotionLab: Unified Human Motion Generation and Editing via the Motion-Condition-Motion Paradigmcited by 30
  29. 2023SignAvatars: A Large-scale 3D Sign Language Holistic Motion Dataset and Benchmarkcited by 29
  30. 2024Learning from Massive Human Videos for Universal Humanoid Pose Controlcited by 27
  31. 2025Absolute Coordinates Make Motion Generation Easycited by 27
  32. 2023Plan, Posture and Go: Towards Open-World Text-to-Motion Generationcited by 26
  33. 2025SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Predictioncited by 26
  34. 2024SkillMimic: Learning Basketball Interaction Skills from Demonstrationscited by 25
  35. 2023Revisit Human-Scene Interaction via Space Occupancycited by 24
  36. 2024MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal Controlscited by 24
  37. 2024Make-It-Animatable: An Efficient Framework for Authoring Animation-Ready 3D Characterscited by 23
  38. 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatarcited by 22

50 most cited of 220 All 220 (JSON)