HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmark
Not on the map. Why?
Abstract (arXiv)
Humanoid motion tracking is central to teleoperation and whole-body imitation, yet evaluation often disagrees with what people perceive in videos. Kinematic errors average per-frame pose differences but miss the physical artifacts that matter most, particularly unstable support and incorrect contacts such as foot skating and mistimed touch-downs. Meanwhile, widely used test suites are small and lack the diversity needed to stress contact-rich, long-horizon behaviors. We introduce HumanTracker to make humanoid tracking evaluation both perceptually aligned and scalable. The HumanTracker benchmark contains approximately 153 hours of optical motion trajectories from multiple professional performers, organized into four motion families with text labels for fine-grained diagnosis. We further propose HumanScore, a preference-aligned metric trained on 12K motion pairs containing 24K motions. Across representative state-of-the-art trackers, HumanScore better predicts human preferences and reveals contact and stability failures that kinematic metrics often miss.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 44 of its 51 references that are in the map. First posted on arXiv 13 Aug 2026.
Builds on
44 of 51 references.
References · 44
- 2017Attention Is All You Needcited by 60,361
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2023Iterative Preference Learning from Human Feedback: Bridging Theory and Practice for RLHF under KL-Constraintcited by 350
- 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 218
- 2023Object Motion Guided Human Motion Synthesiscited by 212
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 206
- 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 189
- 2023LIV: Language-Image Representations and Rewards for Robotic Controlcited by 188
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 165
- 2023RoboCLIP: One Demonstration is Enough to Learn Robot Policiescited by 134
32 more
- 2024Learning Human-to-Humanoid Real-Time Whole-Body Teleoperationcited by 130
- 2023Universal Humanoid Motion Representations for Physics-Based Controlcited by 116
- 2025TWIST: Teleoperated Whole-Body Imitation Systemcited by 101
- 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 101
- 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 83
- 2025Retargeting Matters: General Motion Retargeting for Humanoid Motion Trackingcited by 75
- 2025OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interactioncited by 71
- 2024Humanoid Locomotion as Next Token Predictioncited by 69
- 2026Robometer: Scaling General-Purpose Robotic Reward Models via Trajectory Comparisonscited by 60
- 2026RoboReward: General-Purpose Vision-Language Reward Models for Roboticscited by 53
- 2025KungfuBot: Physics-Based Humanoid Whole-Body Control for Learning Highly-Dynamic Skillscited by 52
- 2024RoHM: Robust Human Motion Reconstruction via Diffusioncited by 48
- 2025TWIST2: Scalable, Portable, and Holistic Humanoid Data Collection Systemcited by 44
- 2025ResMimic: From General Motion Tracking to Humanoid Whole-body Loco-Manipulation via Residual Learningcited by 41
- 2025Robo-Dopamine: General Process Reward Modeling for High-Precision Robotic Manipulationcited by 40
- 2025CLONE: Closed-Loop Whole-Body Humanoid Teleoperation for Long-Horizon Taskscited by 38
- 2025UniTracker: Learning Universal Whole-Body Motion Tracker for Humanoid Robotscited by 37
- 2025Track Any Motions under Any Disturbancescited by 35
- 2025Motion-X++: A Large-Scale Multimodal 3D Whole-body Human Motion Datasetcited by 33
- 2024A Cross-Dataset Study for Text-based 3D Human Motion Retrievalcited by 17
- 2024Aligning Human Motion Generation with Human Perceptionscited by 16
- 2024Learning Multi-Modal Whole-Body Control for Real-World Humanoid Robotscited by 16
- 2025Physics-Based Motion Imitation with Adversarial Differential Discriminatorscited by 12
- 2023ProxyCap: Real-time Monocular Full-body Capture in World Space via Human-Centric Proxy-to-Motion Learningcited by 9
- 2024Exploring Text-to-Motion Generation with Human Preferencecited by 8
- 2026Learning Athletic Humanoid Tennis Skills from Imperfect Human Motion Datacited by 8
- 2024FreeMotion: MoCap-Free Human Motion Synthesis with Multimodal Large Language Modelscited by 6
- 2024I-CTRL: Imitation to Control Humanoid Robots Through Constrained Reinforcement Learningcited by 5
- 2026Collision-Free Humanoid Traversal in Cluttered Indoor Scenescited by 5
- 2026Humanoid-GPT: Scaling Data and Structure for Zero-Shot Motion Trackingcited by 5
- 2026Towards Motion Turing Test: Evaluating Human-Likeness in Humanoid Robotscited by 4
- 2026OmniTrack: General Motion Tracking via Physics-Consistent Referencecited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026InterMimicGen: Scaling Humanoid Loco-Manipulation through Self-Evolving Motion Imitation
- 2026Kinodynamic Motion Retargeting for Humanoid Locomotion via Multi-Contact Whole-Body Trajectory Optimization
- 2026PASSAGE: Scaling Scene-Aligned Motion Learning for Perceptive Humanoid Traversal in Cluttered Environments ↗
- 2024Mimicking-Bench: A Benchmark for Generalizable Humanoid-Scene Interaction Learning via Human Mimicking
- 2025A Scalable Whole-body Motion Transfer via Implicit Kinodynamic Motion Retargeting
- 2026Human2Humanoid: Physics-Aware Cross-Morphology Motion Retargeting for Humanoid Robots
- 2026SixthSense: Task-Agnostic Proprioception-Only Whole-Body Wrench Estimation for Humanoids ↗
- 2025CoMPAS3D: A Dataset and Benchmark for Interactive Motion