Aligning Human Motion Generation with Human Perceptions
Not on the map. Why?
Abstract (arXiv)
Human motion generation is a critical task with a wide range of applications. Achieving high realism in generated motions requires naturalness, smoothness, and plausibility. Despite rapid advancements in the field, current generation methods often fall short of these goals. Furthermore, existing evaluation metrics typically rely on ground-truth-based errors, simple heuristics, or distribution distances, which do not align well with human perceptions of motion quality. In this work, we propose a data-driven approach to bridge this gap by introducing a large-scale human perceptual evaluation dataset, MotionPercept, and a human motion critic model, MotionCritic, that capture human perceptual preferences. Our critic model offers a more accurate metric for assessing motion quality and could be readily integrated into the motion generation pipeline to enhance generation quality. Extensive experiments demonstrate the effectiveness of our approach in both evaluating and improving the quality of generated human motions by aligning with human perceptions. Code and data are publicly available at https://motioncritic.github.io/.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 34 of its 68 references that are in the map. First posted on arXiv 2 Jul 2024.
Builds on
34 of 68 references.
References · 34
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2018Datasheets for Datasetscited by 1,371
- 2022Human Motion Diffusion Modelcited by 1,062
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2023RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignmentcited by 672
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
22 more
- 2023RRHF: Rank Responses to Align Language Models with Human Feedback without tearscited by 454
- 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
- 2023Aligning Text-to-Image Models using Human Feedbackcited by 418
- 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
- 2022EDGE: Editable Dance Generation From Musiccited by 284
- 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
- 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 210
- 2022Generating Holistic 3D Human Motion from Speechcited by 180
- 2023Rich Human Feedback for Text-to-Image Generationcited by 139
- 2020Synthesizing Long-Term 3D Human Motion and Interaction in 3D Scenescited by 135
- 2023Human Motion Generation: A Surveycited by 95
- 2023InstructVideo: Instructing Video Diffusion Models with Human Feedbackcited by 85
- 2019Context-aware Human Motion Predictioncited by 83
- 2020Dance Revolution: Long-Term Dance Generation with Music via Curriculum Learningcited by 81
- 2023CIRCLE: Capture In Rich Contextual Environmentscited by 79
- 2022PoseGPT: Quantization-based 3D Human Motion Generation and Forecastingcited by 78
- 2023Inverse Preference Learning: Preference-based RL without a Reward Functioncited by 68
- 2019Analyzing Input and Output Representations for Speech-Driven Gesture Generationcited by 51
- 2023QPGesture: Quantization-Based and Phase-Guided Motion Matching for Natural Speech-Driven Gesture Generationcited by 40
- 2020TransMoMo: Invariance-Driven Unsupervised Video Motion Retargetingcited by 36
- 2023What is the Best Automated Metric for Text to Motion Generation?cited by 19
Built on by
Citing papers per year: 2025: 7; 2026: 9.
16 papers.
Sort:
By area:
- 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluationcited by 20
- 2025Motion-R1: Enhancing Motion Generation with Decomposed Chain-of-Thought and RL Bindingcited by 8
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
- 2025IRG-MotionLLM: Interleaving Motion Generation, Assessment and Refinement for Text-to-Motion Generationcited by 4
- 2026EasyTune: Efficient Step-Aware Fine-Tuning for Diffusion-Based Motion Generationcited by 3
- 2026U-Mind: A Unified Framework for Real-Time Multimodal Interaction with Audiovisual Generationcited by 2
- 2025Biomechanics-Guided Residual Approach to Generalizable Human Motion Generation and Estimationcited by 1
- 2025Quality assessment of 3D human animation: Subjective and objective evaluationcited by 1
- 2025Multimodal Generative AI with Autoregressive LLMs for Human Motion Understanding and Generation: A Way Forwardcited by 1
- 2026PhyMotion: Structured 3D Motion Reward for Physics-Grounded Human Video Generationcited by 1
- 2026FMReward: Aligning and Evaluating Audio-Driven 3D Facial Animation with Human Preferencescited by 1
- 2026MoRL: Reinforced Reasoning for Unified Motion Understanding and Generationcited by 0
4 more
- 2026Towards Highly-Constrained Human Motion Generation with Retrieval-Guided Diffusion Noise Optimizationcited by 0
- 2026MotionMERGE: A Multi-granular Framework for Human Motion Editing, Reasoning, Generation, and Explanationcited by 0
- 2026HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmarkcited by 0
- 2026Multi-Modal Controlled Coherent Motion Generationcited by 0
- 2026Multi-Modal Controlled Coherent Motion Generation10 Sep 2026
- 2026FMReward: Aligning and Evaluating Audio-Driven 3D Facial Animation with Human Preferences15 Aug 2026
- 2026HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmark13 Aug 2026
- 2026MotionMERGE: A Multi-granular Framework for Human Motion Editing, Reasoning, Generation, and Explanation18 May 2026
- 2026PhyMotion: Structured 3D Motion Reward for Physics-Grounded Human Video Generation14 May 2026
- 2026Towards Highly-Constrained Human Motion Generation with Retrieval-Guided Diffusion Noise Optimization8 May 2026
- 2026U-Mind: A Unified Framework for Real-Time Multimodal Interaction with Audiovisual Generation27 Feb 2026
- 2026MoRL: Reinforced Reasoning for Unified Motion Understanding and Generation16 Feb 2026
- 2026EasyTune: Efficient Step-Aware Fine-Tuning for Diffusion-Based Motion Generation8 Feb 2026
- 2025IRG-MotionLLM: Interleaving Motion Generation, Assessment and Refinement for Text-to-Motion Generation11 Dec 2025
- 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluation30 Oct 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
4 more
- 2025Motion-R1: Enhancing Motion Generation with Decomposed Chain-of-Thought and RL Binding12 Jun 2025
- 2025Multimodal Generative AI with Autoregressive LLMs for Human Motion Understanding and Generation: A Way Forward31 May 2025
- 2025Quality assessment of 3D human animation: Subjective and objective evaluation29 May 2025
- 2025Biomechanics-Guided Residual Approach to Generalizable Human Motion Generation and Estimation8 Mar 2025
- 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluationcited by 20
- 2025Biomechanics-Guided Residual Approach to Generalizable Human Motion Generation and Estimationcited by 1
- 2026Towards Highly-Constrained Human Motion Generation with Retrieval-Guided Diffusion Noise Optimizationcited by 0
- 2026Towards Highly-Constrained Human Motion Generation with Retrieval-Guided Diffusion Noise Optimization8 May 2026
- 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluation30 Oct 2025
- 2025Biomechanics-Guided Residual Approach to Generalizable Human Motion Generation and Estimation8 Mar 2025
- 2025Motion-R1: Enhancing Motion Generation with Decomposed Chain-of-Thought and RL Bindingcited by 8
- 2026MoRL: Reinforced Reasoning for Unified Motion Understanding and Generationcited by 0
- 2026MotionMERGE: A Multi-granular Framework for Human Motion Editing, Reasoning, Generation, and Explanationcited by 0
- 2026MotionMERGE: A Multi-granular Framework for Human Motion Editing, Reasoning, Generation, and Explanation18 May 2026
- 2026MoRL: Reinforced Reasoning for Unified Motion Understanding and Generation16 Feb 2026
- 2025Motion-R1: Enhancing Motion Generation with Decomposed Chain-of-Thought and RL Binding12 Jun 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
- 2025IRG-MotionLLM: Interleaving Motion Generation, Assessment and Refinement for Text-to-Motion Generationcited by 4
- 2026EasyTune: Efficient Step-Aware Fine-Tuning for Diffusion-Based Motion Generationcited by 3
- 2026U-Mind: A Unified Framework for Real-Time Multimodal Interaction with Audiovisual Generationcited by 2
- 2025Quality assessment of 3D human animation: Subjective and objective evaluationcited by 1
- 2025Multimodal Generative AI with Autoregressive LLMs for Human Motion Understanding and Generation: A Way Forwardcited by 1
- 2026PhyMotion: Structured 3D Motion Reward for Physics-Grounded Human Video Generationcited by 1
- 2026HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmarkcited by 0
- 2026Multi-Modal Controlled Coherent Motion Generationcited by 0
- 2026Multi-Modal Controlled Coherent Motion Generation10 Sep 2026
- 2026HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmark13 Aug 2026
- 2026PhyMotion: Structured 3D Motion Reward for Physics-Grounded Human Video Generation14 May 2026
- 2026U-Mind: A Unified Framework for Real-Time Multimodal Interaction with Audiovisual Generation27 Feb 2026
- 2026EasyTune: Efficient Step-Aware Fine-Tuning for Diffusion-Based Motion Generation8 Feb 2026
- 2025IRG-MotionLLM: Interleaving Motion Generation, Assessment and Refinement for Text-to-Motion Generation11 Dec 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
- 2025Multimodal Generative AI with Autoregressive LLMs for Human Motion Understanding and Generation: A Way Forward31 May 2025
- 2025Quality assessment of 3D human animation: Subjective and objective evaluation29 May 2025