mlsanityData to 14 Oct 2026

A Scalable Whole-body Motion Transfer via Implicit Kinodynamic Motion Retargeting

arXiv 2509.15443 ↗First posted 18 Sep 2025cs.RO cs.AIcited by 2

On the map: Offline RL and imitation learning from data → Real-world robot offline RL

Abstract (arXiv)

Human-to-humanoid imitation learning presents a promising pathway to address the severe data scarcity bottleneck in robotics by utilizing abundant, large-scale human motion collections. However, scaling this paradigm requires addressing two key challenges. First, human motion data acquired from videos, motion capture systems, or generative models often contains spatial noise, jitter, and frame-level flickering, which can be amplified during retargeting and lead to unsafe or physically infeasible robot motions. Second, existing motion retargeting methods typically rely on frame-by-frame numerical optimization, making them too computationally expensive for large-scale dataset synthesis. To overcome these limitations, we introduce Implicit Kinodynamic Motion Retargeting (IKMR), a highly scalable, neural-based data transformation pipeline. IKMR leverages a skeleton-based graph convolutional dual autoencoder to map cross-structural human and humanoid kinematic configurations into a shared topological latent space. To guarantee the physical viability of the generated data, the framework incorporates a physics-informed refinement phase that utilizes simulated physical tracking feedback to learn a robust motion prior. This implicit formulation fundamentally resolves both challenges. By shifting the computational burden from online optimization to offline inference, IKMR achieves an unprecedented data conversion throughput exceeding 5000 frames per second. Furthermore, leveraging the learned motion prior, it functions as an intrinsic data curation mechanism and naturally filters out high-frequency noise and spatial jitters from source data, yielding smooth trajectories that ensure physical hardware safety. Extensive evaluations, including real-world whole-body control deployments on humanoid robot, confirm that IKMR bridges the gap between human motion and robotic data.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Real-world robot offline RL, one of 13 directions in Offline RL and imitation learning from data. Builds on 36 of its 64 references that are in the map. First posted on arXiv 18 Sep 2025.

Builds on

36 of 64 references.

References · 36

  1. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  2. 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
  3. 2022Human Motion Diffusion Modelcited by 1,080
  4. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  5. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  6. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  7. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 408
  8. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  9. 2016The KIT Motion-Language Datasetcited by 338
  10. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
  11. 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 249
  12. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
24 more
  1. 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 218
  2. 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 206
  3. 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 189
  4. 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 185
  5. 2022HUMANISE: Language-conditioned Human Motion Generation in 3D Scenescited by 158
  6. 2024Expressive Whole-Body Control for Humanoid Robotscited by 139
  7. 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 137
  8. 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 130
  9. 2020Skeleton-Aware Networks for Deep Motion Retargetingcited by 124
  10. 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 106
  11. 2025TWIST: Teleoperated Whole-Body Imitation Systemcited by 101
  12. 2018Neural Kinematic Networks for Unsupervised Motion Retargettingcited by 88
  13. 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 83
  14. 2025Visual Imitation Enables Contextual Humanoid Controlcited by 68
  15. 2025KungfuBot: Physics-Based Humanoid Whole-Body Control for Learning Highly-Dynamic Skillscited by 52
  16. 2025UniTracker: Learning Universal Whole-Body Motion Tracker for Humanoid Robotscited by 37
  17. 2024Reconstructing People, Places, and Camerascited by 31
  18. 2024Scaling Large Motion Models with Million-Level Human Motionscited by 22
  19. 2019Whole-Body Geometric Retargeting for Humanoid Robotscited by 20
  20. 2025Behavior Foundation Model for Humanoid Robotscited by 15
  21. 2025A Unified and General Humanoid Whole-Body Controller for Versatile Locomotioncited by 11
  22. 2023Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Priorcited by 8
  23. 2024Text-driven Human Motion Generation with Motion Masked Diffusion Modelcited by 8
  24. 2014State Estimation for a Humanoid Robotcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Human2Humanoid: Physics-Aware Cross-Morphology Motion Retargeting for Humanoid Robots
  2. 2026Make Tracking Easy: Neural Motion Retargeting for Humanoid Whole-body Control
  3. 2026Kinodynamic Motion Retargeting for Humanoid Locomotion via Multi-Contact Whole-Body Trajectory Optimization
  4. 2026Direct Dynamic Retargeting for Humanoid Imitation Learning from Videos
  5. 2026Being-M0.7: A Latent World-Action Model for Humanoid Robots
  6. 2026WholeBodyWAM: Learning Whole-Body World Action Models with Scalable Motion Priors
  7. 2025SPIDER: Scalable Physics-Informed Dexterous Retargeting
  8. 2023HumanMimic: Learning Natural Locomotion and Transitions for Humanoid Robot via Wasserstein Adversarial Imitation