GMT: General Motion Tracking for Humanoid Whole-Body Control
Not on the map. Why?
Abstract (arXiv)
The ability to track general whole-body motions in the real world is a useful way to build general-purpose humanoid robots. However, achieving this can be challenging due to the temporal and kinematic diversity of the motions, the policy's capability, and the difficulty of coordination of the upper and lower bodies. To address these issues, we propose GMT, a general and scalable motion-tracking framework that trains a single unified policy to enable humanoid robots to track diverse motions in the real world. GMT is built upon two core components: an Adaptive Sampling strategy and a Motion Mixture-of-Experts (MoE) architecture. The Adaptive Sampling automatically balances easy and difficult motions during training. The MoE ensures better specialization of different regions of the motion manifold. We show through extensive experiments in both simulation and the real world the effectiveness of GMT, achieving state-of-the-art performance across a broad spectrum of motions using a unified general policy. Videos and additional information can be found at https://gmt-humanoid.github.io.
Key facts. Cited by 72 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Jun 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 21; 2026: 51.
72 papers.
Sort:
By area:
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 128
- 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 83
- 2025TWIST2: Scalable, Portable, and Holistic Humanoid Data Collection Systemcited by 39
- 2025ResMimic: From General Motion Tracking to Humanoid Whole-body Loco-Manipulation via Residual Learningcited by 34
- 2025WholeBodyVLA: Towards Unified Latent VLA for Whole-Body Loco-Manipulation Controlcited by 32
- 2025From Language to Locomotion: Retargeting-free Humanoid Control via Motion Latent Guidancecited by 17
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
- 2025DreamControl: Human-Inspired Whole-Body Humanoid Control for Scene Interaction via Guided Diffusioncited by 13
- 2026Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matchingcited by 13
- 2025KungfuBot2: Learning Versatile Motion Skills for Humanoid Whole-Body Controlcited by 11
- 2025DemoHLM: From One Demonstration to Generalizable Humanoid Loco-Manipulationcited by 10
- 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructionscited by 10
38 more
- 2026HumanX: Toward Agile and Generalizable Humanoid Interaction Skills from Human Videoscited by 10
- 2026HEX: Humanoid-Aligned Experts for Cross-Embodiment Whole-Body Manipulationcited by 10
- 2026ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulationcited by 9
- 2026HoloMotion-1 Technical Reportcited by 8
- 2025SoftMimic: Learning Compliant Whole-body Control from Examplescited by 7
- 2025SENTINEL: A Fully End-to-End Language-Action Model for Humanoid Whole Body Controlcited by 7
- 2025Towards Adaptable Humanoid Control via Adaptive Motion Trackingcited by 6
- 2025RoboMirror: Understand Before You Imitate for Video to Humanoid Locomotioncited by 6
- 2025GentleHumanoid: Learning Upper-body Compliance for Contact-rich Human and Object Interactioncited by 5
- 2025From Generated Human Videos to Physically Plausible Robot Trajectoriescited by 5
- 2025CHIP: Adaptive Compliance for Humanoid Control through Hindsight Perturbationcited by 5
- 2026Deep Whole-body Parkourcited by 5
- 2026Learning Whole-Body Human-Humanoid Interaction from Human-Human Demonstrationscited by 5
- 2026PolicyFlow: Policy Optimization with Continuous Normalizing Flow in Reinforcement Learningcited by 5
- 2026MeshMimic: Geometry-Aware Humanoid Motion Learning through 3D Scene Reconstructioncited by 5
- 2026ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Datacited by 5
- 2026Heracles: Bridging Precise Tracking and Generative Synthesis for General Humanoid Controlcited by 5
- 2026MotionBricks: Scalable Real-Time Motions with Modular Latent Generative Model and Smart Primitivescited by 5
- 2026ω-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulationcited by 5
- 2025Coordinated Humanoid Manipulation with Choice Policiescited by 4
- 2026ZEST: Zero-shot Embodied Skill Transfer for Athletic Robot Controlcited by 4
- 2026CLOT: Closed-Loop Global Motion Tracking for Whole-Body Humanoid Teleoperationcited by 4
- 2026Humanoid-GPT: Scaling Data and Structure for Zero-Shot Motion Trackingcited by 4
- 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulationcited by 4
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interactioncited by 4
- 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gatingcited by 3
- 2025A Scalable Whole-body Motion Transfer via Implicit Kinodynamic Motion Retargetingcited by 2
- 2025RobotDancing: Residual-Action Reinforcement Learning Enables Robust Long-Horizon Humanoid Motion Trackingcited by 2
- 2026PhyGile: Physics-Prefix Guided Motion Generation for Agile General Humanoid Motion Trackingcited by 2
- 2026Imagine2Real: Towards Zero-shot Humanoid-Object Interaction via Video Generative Priorscited by 2
- 2026VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenescited by 2
- 2026Scaling Behavior Foundation Model for Humanoid Robotscited by 2
- 2026PAC-MAN: Perception-Aware CBF-RL for Whole-Body Safety in Humanoid Dodgeballcited by 2
- 2025Feature-Based vs. GAN-Based Learning from Demonstrations: When and Whycited by 1
- 2026PDF-HR: Pose Distance Fields for Humanoid Robotscited by 1
- 2026AdaptManip: Learning Adaptive Whole-Body Object Lifting and Delivery with Online Recurrent State Estimationcited by 1
- 2026Learning to Assist: Physics-Grounded Human-Human Control via Multi-Agent Reinforcement Learningcited by 1
- 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memorycited by 1
50 most cited of 72 All 72 (JSON)
- 2026InterEvolve: Test-Time Evolution of Reward Programs for Humanoid Loco-Manipulation1 Oct 2026
- 2026Learning Expressive and Compositional Motion Representation via Spectral Skills29 Sep 2026
- 2026EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulation29 Sep 2026
- 2026Sample, Simulate, Select: Physics-in-the-Loop Text-to-Motion for Humanoids Without Training22 Sep 2026
- 2026BRIDGE: An Open-Source Humanoid Platform via Morphology-Control Co-Design for Physical AI3 Sep 2026
- 2026GigaBrain-WBC-0.5: A Behavior World Model for Robust Humanoid Whole-Body Tracking with Environment Interaction18 Aug 2026
- 2026HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmark13 Aug 2026
- 2026ω-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulation6 Aug 2026
- 2026PFM-HR: Pose Flow Matching for Humanoid Robots4 Aug 2026
- 2026PAC-MAN: Perception-Aware CBF-RL for Whole-Body Safety in Humanoid Dodgeball30 Jul 2026
- 2026Scaling Behavior Foundation Model for Humanoid Robots16 Jul 2026
- 2026EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversal15 Jul 2026
38 more
- 2026Behavior Foundations for Quadruped Robots: ABot-C0 Technical Report8 Jul 2026
- 2026WristMimic: Full-Body Humanoid Control with Wrist-Guided Manipulation7 Jul 2026
- 2026VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenes29 Jun 2026
- 2026AnyBody: Free-Form Whole-Body Humanoid Control from Arbitrary Keypoint Guidance28 Jun 2026
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interaction25 Jun 2026
- 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memory22 Jun 2026
- 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulation20 Jun 2026
- 2026CTS-MoE: Implicit Terrain Adaptation via Mixture-of-Experts for Perceptive Locomotion17 Jun 2026
- 2026Stubborn: A Streamlined and Unified Reinforcement Learning Framework for Robust Motion Tracking and Fall Recovery for Humanoids11 Jun 2026
- 2026HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Teachers4 Jun 2026
- 2026Humanoid-GPT: Scaling Data and Structure for Zero-Shot Motion Tracking2 Jun 2026
- 2026SPRINT: Efficient Spectral Priors for Humanoid Athletic Sprints27 May 2026
- 2026Any2Any: Efficient Cross-Embodiment Transfer for Humanoid Whole-Body Tracking22 May 2026
- 2026Imagine2Real: Towards Zero-shot Humanoid-Object Interaction via Video Generative Priors21 May 2026
- 2026HoloMotion-1 Technical Report14 May 2026
- 2026Towards Highly-Constrained Human Motion Generation with Retrieval-Guided Diffusion Noise Optimization8 May 2026
- 2026LineRides: Line-Guided Reinforcement Learning for Bicycle Robot Stunts6 May 2026
- 2026MotionBricks: Scalable Real-Time Motions with Modular Latent Generative Model and Smart Primitives27 Apr 2026
- 2026HEX: Humanoid-Aligned Experts for Cross-Embodiment Whole-Body Manipulation9 Apr 2026
- 2026Heracles: Bridging Precise Tracking and Generative Synthesis for General Humanoid Control29 Mar 2026
- 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gating25 Mar 2026
- 2026PhyGile: Physics-Prefix Guided Motion Generation for Agile General Humanoid Motion Tracking13 Mar 2026
- 2026Learning to Assist: Physics-Grounded Human-Human Control via Multi-Agent Reinforcement Learning11 Mar 2026
- 2026SCDP: Learning Humanoid Locomotion from Partial Observations via Mixed-Observation Distillation10 Mar 2026
- 2026ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Data10 Mar 2026
- 2026ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulation3 Mar 2026
- 2026HERO: Learning Humanoid End-Effector Control for Visual Whole-Body Open-Vocabulary Object Grasping18 Feb 2026
- 2026Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matching17 Feb 2026
- 2026MeshMimic: Geometry-Aware Humanoid Motion Learning through 3D Scene Reconstruction17 Feb 2026
- 2026AdaptManip: Learning Adaptive Whole-Body Object Lifting and Delivery with Online Recurrent State Estimation16 Feb 2026
- 2026CLOT: Closed-Loop Global Motion Tracking for Whole-Body Humanoid Teleoperation13 Feb 2026
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Control7 Feb 2026
- 2026PDF-HR: Pose Distance Fields for Humanoid Robots4 Feb 2026
- 2026HumanX: Toward Agile and Generalizable Humanoid Interaction Skills from Human Videos2 Feb 2026
- 2026PolicyFlow: Policy Optimization with Continuous Normalizing Flow in Reinforcement Learning1 Feb 2026
- 2026ZEST: Zero-shot Embodied Skill Transfer for Athletic Robot Control30 Jan 2026
- 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructions19 Jan 2026
- 2026Learning Whole-Body Human-Humanoid Interaction from Human-Human Demonstrations14 Jan 2026
50 newest of 72 All 72 (JSON)
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 128
- 2025DreamControl: Human-Inspired Whole-Body Humanoid Control for Scene Interaction via Guided Diffusioncited by 13
- 2026SCDP: Learning Humanoid Locomotion from Partial Observations via Mixed-Observation Distillationcited by 0
- 2026Towards Highly-Constrained Human Motion Generation with Retrieval-Guided Diffusion Noise Optimizationcited by 0
- 2026PFM-HR: Pose Flow Matching for Humanoid Robotscited by 0
- 2026PFM-HR: Pose Flow Matching for Humanoid Robots4 Aug 2026
- 2026Towards Highly-Constrained Human Motion Generation with Retrieval-Guided Diffusion Noise Optimization8 May 2026
- 2026SCDP: Learning Humanoid Locomotion from Partial Observations via Mixed-Observation Distillation10 Mar 2026
- 2025DreamControl: Human-Inspired Whole-Body Humanoid Control for Scene Interaction via Guided Diffusion17 Sep 2025
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusion11 Aug 2025
- 2025A Scalable Whole-body Motion Transfer via Implicit Kinodynamic Motion Retargetingcited by 2
- 2025Feature-Based vs. GAN-Based Learning from Demonstrations: When and Whycited by 1
- 2026AdaptManip: Learning Adaptive Whole-Body Object Lifting and Delivery with Online Recurrent State Estimationcited by 1
- 2026AdaptManip: Learning Adaptive Whole-Body Object Lifting and Delivery with Online Recurrent State Estimation16 Feb 2026
- 2025A Scalable Whole-body Motion Transfer via Implicit Kinodynamic Motion Retargeting18 Sep 2025
- 2025Feature-Based vs. GAN-Based Learning from Demonstrations: When and Why8 Jul 2025
- 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 83
- 2025TWIST2: Scalable, Portable, and Holistic Humanoid Data Collection Systemcited by 39
- 2025ResMimic: From General Motion Tracking to Humanoid Whole-body Loco-Manipulation via Residual Learningcited by 34
- 2025WholeBodyVLA: Towards Unified Latent VLA for Whole-Body Loco-Manipulation Controlcited by 32
- 2025From Language to Locomotion: Retargeting-free Humanoid Control via Motion Latent Guidancecited by 17
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
- 2026Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matchingcited by 13
- 2025KungfuBot2: Learning Versatile Motion Skills for Humanoid Whole-Body Controlcited by 11
- 2025DemoHLM: From One Demonstration to Generalizable Humanoid Loco-Manipulationcited by 10
- 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructionscited by 10
- 2026HumanX: Toward Agile and Generalizable Humanoid Interaction Skills from Human Videoscited by 10
- 2026ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulationcited by 9
12 most cited of 57 All 57 (JSON)
- 2026InterEvolve: Test-Time Evolution of Reward Programs for Humanoid Loco-Manipulation1 Oct 2026
- 2026Learning Expressive and Compositional Motion Representation via Spectral Skills29 Sep 2026
- 2026EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulation29 Sep 2026
- 2026Sample, Simulate, Select: Physics-in-the-Loop Text-to-Motion for Humanoids Without Training22 Sep 2026
- 2026BRIDGE: An Open-Source Humanoid Platform via Morphology-Control Co-Design for Physical AI3 Sep 2026
- 2026HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmark13 Aug 2026
- 2026PAC-MAN: Perception-Aware CBF-RL for Whole-Body Safety in Humanoid Dodgeball30 Jul 2026
- 2026Scaling Behavior Foundation Model for Humanoid Robots16 Jul 2026
- 2026EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversal15 Jul 2026
- 2026Behavior Foundations for Quadruped Robots: ABot-C0 Technical Report8 Jul 2026
- 2026WristMimic: Full-Body Humanoid Control with Wrist-Guided Manipulation7 Jul 2026
- 2026VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenes29 Jun 2026
12 newest of 57 All 57 (JSON)