A Scalable Whole-body Motion Transfer via Implicit Kinodynamic Motion Retargeting
On the map: Offline RL and imitation learning from data → Real-world robot offline RL
Abstract (arXiv)
Human-to-humanoid imitation learning presents a promising pathway to address the severe data scarcity bottleneck in robotics by utilizing abundant, large-scale human motion collections. However, scaling this paradigm requires addressing two key challenges. First, human motion data acquired from videos, motion capture systems, or generative models often contains spatial noise, jitter, and frame-level flickering, which can be amplified during retargeting and lead to unsafe or physically infeasible robot motions. Second, existing motion retargeting methods typically rely on frame-by-frame numerical optimization, making them too computationally expensive for large-scale dataset synthesis. To overcome these limitations, we introduce Implicit Kinodynamic Motion Retargeting (IKMR), a highly scalable, neural-based data transformation pipeline. IKMR leverages a skeleton-based graph convolutional dual autoencoder to map cross-structural human and humanoid kinematic configurations into a shared topological latent space. To guarantee the physical viability of the generated data, the framework incorporates a physics-informed refinement phase that utilizes simulated physical tracking feedback to learn a robust motion prior. This implicit formulation fundamentally resolves both challenges. By shifting the computational burden from online optimization to offline inference, IKMR achieves an unprecedented data conversion throughput exceeding 5000 frames per second. Furthermore, leveraging the learned motion prior, it functions as an intrinsic data curation mechanism and naturally filters out high-frequency noise and spatial jitters from source data, yielding smooth trajectories that ensure physical hardware safety. Extensive evaluations, including real-world whole-body control deployments on humanoid robot, confirm that IKMR bridges the gap between human motion and robotic data.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Real-world robot offline RL, one of 13 directions in Offline RL and imitation learning from data. Builds on 36 of its 64 references that are in the map. First posted on arXiv 18 Sep 2025.
Builds on
36 of 64 references.
References · 36
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
- 2022Human Motion Diffusion Modelcited by 1,080
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
- 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 408
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
- 2016The KIT Motion-Language Datasetcited by 338
- 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
- 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 249
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
24 more
- 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 218
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 206
- 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 189
- 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 185
- 2022HUMANISE: Language-conditioned Human Motion Generation in 3D Scenescited by 158
- 2024Expressive Whole-Body Control for Humanoid Robotscited by 139
- 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 137
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 130
- 2020Skeleton-Aware Networks for Deep Motion Retargetingcited by 124
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 106
- 2025TWIST: Teleoperated Whole-Body Imitation Systemcited by 101
- 2018Neural Kinematic Networks for Unsupervised Motion Retargettingcited by 88
- 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 83
- 2025Visual Imitation Enables Contextual Humanoid Controlcited by 68
- 2025KungfuBot: Physics-Based Humanoid Whole-Body Control for Learning Highly-Dynamic Skillscited by 52
- 2025UniTracker: Learning Universal Whole-Body Motion Tracker for Humanoid Robotscited by 37
- 2024Reconstructing People, Places, and Camerascited by 31
- 2024Scaling Large Motion Models with Million-Level Human Motionscited by 22
- 2019Whole-Body Geometric Retargeting for Humanoid Robotscited by 20
- 2025Behavior Foundation Model for Humanoid Robotscited by 15
- 2025A Unified and General Humanoid Whole-Body Controller for Versatile Locomotioncited by 11
- 2023Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Priorcited by 8
- 2024Text-driven Human Motion Generation with Motion Masked Diffusion Modelcited by 8
- 2014State Estimation for a Humanoid Robotcited by 5
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Human2Humanoid: Physics-Aware Cross-Morphology Motion Retargeting for Humanoid Robots
- 2026Make Tracking Easy: Neural Motion Retargeting for Humanoid Whole-body Control
- 2026Kinodynamic Motion Retargeting for Humanoid Locomotion via Multi-Contact Whole-Body Trajectory Optimization
- 2026Direct Dynamic Retargeting for Humanoid Imitation Learning from Videos
- 2026Being-M0.7: A Latent World-Action Model for Humanoid Robots
- 2026WholeBodyWAM: Learning Whole-Body World Action Models with Scalable Motion Priors
- 2025SPIDER: Scalable Physics-Informed Dexterous Retargeting
- 2023HumanMimic: Learning Natural Locomotion and Transitions for Humanoid Robot via Wasserstein Adversarial Imitation