mlsanityData to 14 Oct 2026

OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interaction

arXiv 2509.26633 ↗First posted 30 Sep 2025cs.RO cs.AI cs.LGcited by 71

On the map: Deep reinforcement learning methods → RL for robot locomotion and manipulation

Abstract (arXiv)

A dominant paradigm for teaching humanoid robots complex skills is to retarget human motions as kinematic references to train reinforcement learning (RL) policies. However, existing retargeting pipelines often struggle with the significant embodiment gap between humans and robots, producing physically implausible artifacts like foot-skating and penetration. More importantly, common retargeting methods neglect the rich human-object and human-environment interactions essential for expressive locomotion and loco-manipulation. To address this, we introduce OmniRetarget, an interaction-preserving data generation engine based on an interaction mesh that explicitly models and preserves the crucial spatial and contact relationships between an agent, the terrain, and manipulated objects. By minimizing the Laplacian deformation between the human and robot meshes while enforcing kinematic constraints, OmniRetarget generates kinematically feasible trajectories. Moreover, preserving task-relevant interactions enables efficient data augmentation, from a single demonstration to different robot embodiments, terrains, and object configurations. We comprehensively evaluate OmniRetarget by retargeting motions from OMOMO, LAFAN1, and our in-house MoCap datasets, generating over 8-hour trajectories that achieve better kinematic constraint satisfaction and contact preservation than widely used baselines. Such high-quality data enables proprioceptive RL policies to successfully execute long-horizon (up to 30 seconds) parkour and loco-manipulation skills on a Unitree G1 humanoid, trained with only 5 reward terms and simple domain randomization shared by all tasks, without any learning curriculum.

Key facts. Cited by 71 papers in the map (data through 14 Oct 2026). Placed in RL for robot locomotion and manipulation, one of 15 directions in Deep reinforcement learning methods. Builds on 39 of its 65 references that are in the map. First posted on arXiv 30 Sep 2025.

Builds on

39 of 65 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025SkillBlender: Towards Versatile Humanoid Whole-Body Loco-Manipulation via Skill Blending11 Jun
  2. 2025PARC: Physics-based Augmentation with Reinforcement Learning for Character Controllers6 May
  3. 2024Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control30 Jan

Other references · 36

  1. 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 604
  2. 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
  3. 2021Robust Motion In-betweeningcited by 229
  4. 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 218
  5. 2023Object Motion Guided Human Motion Synthesiscited by 212
  6. 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 189
  7. 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 185
  8. 2023Scaling Robot Learning with Semantically Imagined Experiencecited by 177
  9. 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 165
  10. 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 130
  11. 2020Skeleton-Aware Networks for Deep Motion Retargetingcited by 124
  12. 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learningcited by 116
24 more
  1. 2023GenAug: Retargeting behaviors to unseen situations via Generative Augmentationcited by 104
  2. 2025TWIST: Teleoperated Whole-Body Imitation Systemcited by 101
  3. 2018Neural Kinematic Networks for Unsupervised Motion Retargettingcited by 88
  4. 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 76
  5. 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 72
  6. 2022CACTI: A Framework for Scalable Multi-Task Multi-Scene Visual Imitation Learningcited by 71
  7. 2025Visual Imitation Enables Contextual Humanoid Controlcited by 68
  8. 2024Human-Object Interaction from Human-Level Instructionscited by 64
  9. 2024WoCoCo: Learning Whole-Body Humanoid Control with Sequential Contactscited by 61
  10. 2023Deep Imitation Learning for Humanoid Loco-manipulation through Human Teleoperationcited by 54
  11. 2024SkillMimicGen: Automated Demonstration Generation for Efficient Skill Learning and Deploymentcited by 52
  12. 2024Learning Humanoid Locomotion with Perceptive Internal Modelcited by 50
  13. 2024RoVi-Aug: Robot and Viewpoint Augmentation for Cross-Embodiment Robot Learningcited by 46
  14. 2025FALCON: Learning Force-Adaptive Humanoid Loco-Manipulationcited by 40
  15. 2025Attention-Based Map Encoding for Learning Generalized Legged Locomotioncited by 40
  16. 2023Sim-to-Real Learning for Humanoid Box Loco-Manipulationcited by 36
  17. 2024Diffusion Meets DAgger: Supercharging Eye-in-hand Imitation Learningcited by 35
  18. 2024View-Invariant Policy Learning via Zero-Shot Novel View Synthesiscited by 35
  19. 2023Simulation and Retargeting of Complex Multi-Character Interactionscited by 34
  20. 2025HuB: Learning Extreme Humanoid Balancecited by 28
  21. 2025Learning Getting-Up Policies for Real-World Humanoid Robotscited by 26
  22. 2025Physics-Driven Data Generation for Contact-Rich Manipulation via Trajectory Optimizationcited by 21
  23. 2025Unleashing Humanoid Reaching Potential via Real-world-Ready Skill Spacecited by 14
  24. 2025A Unified and General Humanoid Whole-Body Controller for Versatile Locomotioncited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 65.

71 papers.

Sort:

By area:

  1. 2025SPIDER: Scalable Physics-Informed Dexterous Retargetingcited by 32
  2. 2026Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matchingcited by 19
  3. 2026HumanX: Toward Agile and Generalizable Humanoid Interaction Skills from Human Videoscited by 14
  4. 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
  5. 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrationscited by 12
  6. 2026ZEST: Zero-shot Embodied Skill Transfer for Athletic Robot Controlcited by 11
  7. 2025OXE-AugE: A Large-Scale Robot Augmentation of OXE for Scaling Cross-Embodiment Policy Learningcited by 10
  8. 2025Humanoid Goalkeeper: Learning from Position Conditioned Task-Motion Constraintscited by 9
  9. 2026ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulationcited by 9
  10. 2026Learning Whole-Body Human-Humanoid Interaction from Human-Human Demonstrationscited by 6
  11. 2026MeshMimic: Geometry-Aware Humanoid Motion Learning through 3D Scene Reconstructioncited by 6
  12. 2026MotionBricks: Scalable Real-Time Motions with Modular Latent Generative Model and Smart Primitivescited by 6
38 more
  1. 2026TopoRetarget: Interaction-Preserving Retargeting for Dexterous Manipulationcited by 6
  2. 2025UniAct: Unified Motion Generation and Action Streaming for Humanoid Robotscited by 5
  3. 2026SteadyTray: Learning Object Balancing Tasks in Humanoid Tray Transport via Residual Reinforcement Learningcited by 5
  4. 2026Heracles: Bridging Precise Tracking and Generative Synthesis for General Humanoid Controlcited by 5
  5. 2026Humanoid-GPT: Scaling Data and Structure for Zero-Shot Motion Trackingcited by 5
  6. 2025Coordinated Humanoid Manipulation with Choice Policiescited by 4
  7. 2026CLOT: Closed-Loop Global Motion Tracking for Whole-Body Humanoid Teleoperationcited by 4
  8. 2026Towards Motion Turing Test: Evaluating Human-Likeness in Humanoid Robotscited by 4
  9. 2026HumanoidMimicGen: Data Generation for Loco-Manipulation via Whole-Body Planningcited by 4
  10. 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interactioncited by 4
  11. 2026A Minimalist Retargeting-Guided Reinforcement Learning Recipe for Dexterous Manipulationcited by 4
  12. 2026Learning Human-Like Badminton Skills for Humanoid Robotscited by 3
  13. 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Frameworkcited by 3
  14. 2026SplitAdapter: Load-Aware Humanoid Loco-Manipulation via Factorized Adaptationcited by 3
  15. 2026PhysDrift: Bridging the Embodiment Gap in Humanoid Co-Speech Motion Generationcited by 3
  16. 2026VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenescited by 3
  17. 2026PAC-MAN: Perception-Aware CBF-RL for Whole-Body Safety in Humanoid Dodgeballcited by 3
  18. 2026RoboGesture: Real-Time Semantic-aligned Co-Speech Gestures Generation for Humanoid Interactioncited by 3
  19. 2026ReActor: Reinforcement Learning for Physics-Aware Motion Retargetingcited by 2
  20. 2026Imagine2Real: Towards Zero-shot Humanoid-Object Interaction via Video Generative Priorscited by 2
  21. 2026Direct Dynamic Retargeting for Humanoid Imitation Learning from Videoscited by 2
  22. 2026HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Teacherscited by 2
  23. 2026Humanoid-DART: Humanoid Loco-Manipulation using Diffusion-guided Augmentation through Relabeling and Trackingcited by 2
  24. 2026Scaling Behavior Foundation Model for Humanoid Robotscited by 2
  25. 2025HAFO: A Force-Adaptive Control Framework for Humanoid Robots in Intense Interaction Environmentscited by 1
  26. 2026PDF-HR: Pose Distance Fields for Humanoid Robotscited by 1
  27. 2026APEX: Learning Adaptive High-Platform Traversal for Humanoid Robotscited by 1
  28. 2026AdaptManip: Learning Adaptive Whole-Body Object Lifting and Delivery with Online Recurrent State Estimationcited by 1
  29. 2026HERO: Learning Humanoid End-Effector Control for Visual Whole-Body Open-Vocabulary Object Graspingcited by 1
  30. 2026DreamControl-v2: Simpler and Scalable Autonomous Humanoid Skills via Trainable Guided Diffusion Priorscited by 1
  31. 2026Physics-Informed Reinforcement Learning of Spatial Density Velocity Potentials for Map-Free Racingcited by 1
  32. 2026PressMimic: Pressure-Guided Motion Capture and Control for Humanoid Robot Imitationcited by 1
  33. 2026HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmarkcited by 1
  34. 2026HiPHI: A Large-Scale Benchmark for High-Precision Human Motion and Object-Interactioncited by 1
  35. 2026Weave: Learning Whole-Body Dexterous Loco-Manipulation from Human-Object Interactionscited by 1
  36. 2026Imitation Learning from Human Motion Alone Does Not Guarantee Biomechanically Plausible Gait Kineticscited by 0
  37. 2026SynAgent: Generalizable Cooperative Humanoid Manipulation via Solo-to-Cooperative Agent Synergycited by 0
  38. 2026SalsaAgent: A multimodal embodied language model for interactive dance generationcited by 0

50 most cited of 71 All 71 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026HOI-Retarget: Contact-Centric Retargeting for Human-Object Interaction
  2. 2026InterMimicGen: Scaling Humanoid Loco-Manipulation through Self-Evolving Motion Imitation
  3. 2026DexWeave: Learning Dexterous Humanoid Loco-Manipulation from Human Demonstrations ↗
  4. 2026OTRetarget: Joint Robot and Object Motion Retargeting via Optimal Transport ↗
  5. 2026Kinodynamic Motion Retargeting for Humanoid Locomotion via Multi-Contact Whole-Body Trajectory Optimization
  6. 2026Psi0: An Open Foundation Model Towards Universal Humanoid Loco-Manipulation
  7. 2026Human2Humanoid: Physics-Aware Cross-Morphology Motion Retargeting for Humanoid Robots
  8. 2026Make Tracking Easy: Neural Motion Retargeting for Humanoid Whole-body Control