HumanScore: Benchmarking Human Motions in Generated Videos
Not on the map. Why?
Abstract (arXiv)
Recent advances in model architectures, compute, and data scale have driven rapid progress in video generation, producing increasingly realistic content. Yet, no prior method systematically measures how faithfully these systems render human bodies and motion dynamics. In this paper, we present HumanScore, a systematic framework to evaluate the quality of human motions in AI-generated videos. HumanScore defines six interpretable metrics spanning kinematic plausibility, temporal stability, and biomechanical consistency, enabling fine-grained diagnosis beyond visual realism alone. Through carefully designed prompts, we elicit a diverse set of movements at varying intensities and evaluate videos generated by thirteen state-of-the-art models. Our analysis reveals consistent gaps between perceptual plausibility and motion biomechanical fidelity, identifies recurrent failure modes (e.g., temporal jitter, anatomically implausible poses, and motion drift), and produces robust model rankings from quantitative and physically meaningful criteria.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 49 of its 76 references that are in the map. First posted on arXiv 22 Apr 2026.
Builds on
49 of 76 references.
References · 49
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
- 2017End-to-end Recovery of Human Shape and Posecited by 885
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
37 more
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 350
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
- 2016The KIT Motion-Language Datasetcited by 338
- 2016YouTube-8M: A Large-Scale Video Classification Benchmarkcited by 324
- 2019A Short Note on the Kinetics-700 Human Action Datasetcited by 310
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
- 2020Deep Learning-Based Human Pose Estimation: A Surveycited by 207
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 185
- 2025HunyuanVideo 1.5 Technical Reportcited by 160
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
- 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 137
- 2024GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generationcited by 135
- 2017Compositional Human Pose Regressioncited by 124
- 20233D Human Pose Estimation via Intuitive Physicscited by 103
- 2020Contact and Human Dynamics from Monocular Videocited by 95
- 2025PromptHMR: Promptable Human Mesh Recoverycited by 76
- 2025MotionBench: Benchmarking and Improving Fine-grained Video Motion Understanding for Vision Language Modelscited by 70
- 2025Towards Understanding Camera Motions in Any Videocited by 64
- 2024Fr'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videoscited by 58
- 2025Video-Bench: Human-Aligned Video Generation Benchmarkcited by 57
- 2022Learning 3D Human Pose Estimation from Dozens of Datasets using a Geometry-Aware Autoencoder to Bridge Between Skeleton Formatscited by 50
- 2025VMBench: A Benchmark for Perception-Aligned Video Motion Generationcited by 49
- 2023HumanBench: Towards General Human-centric Perception with Projector Assisted Pretrainingcited by 38
- 2020MeTRAbs: Metric-Scale Truncation-Robust Heatmaps for Absolute 3D Human Pose Estimationcited by 35
- 2024PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videoscited by 28
- 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluationcited by 22
- 2024MultiPhys: Multi-Person Physics-aware 3D Motion Estimationcited by 18
- 2023Monocular 3D Human Pose Estimation for Sports Broadcasts using Partial Sports Field Registrationcited by 13
- 2024Detecting Human Artifacts from Text-to-Image Modelscited by 12
- 2025Kandinsky 5.0: A Family of Foundation Models for Image and Video Generationcited by 12
- 2022Evaluating the Quality of a Synthesized Motion with the Fr'echet Motion Distancecited by 8
- 2025Portable Biomechanics Laboratory: Clinically Accessible Movement Analysis from a Handheld Smartphonecited by 8
- 2024STREAM: Spatio-TempoRal Evaluation and Analysis Metric for Video Generative Modelscited by 6
- 2024CLOAF: CoLlisiOn-Aware Human Flowcited by 4
- 2025Recognizing Actions from Robotic View for Natural Human-Robot Interactioncited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.