ResMimic: From General Motion Tracking to Humanoid Whole-body Loco-Manipulation via Residual Learning
Not on the map. Why?
Abstract (arXiv)
Humanoid whole-body loco-manipulation promises transformative capabilities for daily service and warehouse tasks. While recent advances in general motion tracking (GMT) have enabled humanoids to reproduce diverse human motions, these policies lack the precision and object awareness required for loco-manipulation. To this end, we introduce ResMimic, a two-stage residual learning framework for precise and expressive humanoid control from human motion data. First, a GMT policy, trained on large-scale human-only motion, serves as a task-agnostic base for generating human-like whole-body movements. An efficient but precise residual policy is then learned to refine the GMT outputs to improve locomotion and incorporate object interaction. To further facilitate efficient training, we design (i) a point-cloud-based object tracking reward for smoother optimization, (ii) a contact reward that encourages accurate humanoid body-object interactions, and (iii) a curriculum-based virtual object controller to stabilize early training. We evaluate ResMimic in both simulation and on a real Unitree G1 humanoid. Results show substantial gains in task success, training efficiency, and robustness over strong baselines. Videos are available at https://resmimic.github.io/ .
Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). Builds on 38 of its 41 references that are in the map. First posted on arXiv 6 Oct 2025.
Builds on
38 of 41 references.
References · 38
- 2023GPT-4 Technical Reportcited by 18,132
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2018Residual Reinforcement Learning for Robot Controlcited by 242
- 2023Object Motion Guided Human Motion Synthesiscited by 206
- 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 167
- 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 164
- 2018Residual Policy Learningcited by 146
- 2023Real-World Humanoid Locomotion with Reinforcement Learningcited by 132
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 128
26 more
- 2025A Careful Examination of Large Behavior Models for Multitask Dexterous Manipulationcited by 125
- 2024Expressive Whole-Body Control for Humanoid Robotscited by 117
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 104
- 2024HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulationcited by 101
- 2025TWIST: Teleoperated Whole-Body Imitation Systemcited by 86
- 2024From Imitation to Refinement -- Residual RL for Precise Assemblycited by 80
- 2023Teach a Robot to FISH: Versatile Imitation from One Minute of Demonstrationscited by 74
- 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 72
- 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 67
- 2024Humanoid Parkour Learningcited by 66
- 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 65
- 2024Humanoid Locomotion as Next Token Predictioncited by 63
- 2024OKAMI: Teaching Humanoid Robots Manipulation Skills through Single Video Imitationcited by 62
- 2025Visual Imitation Enables Contextual Humanoid Controlcited by 57
- 2025ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual Learningcited by 56
- 2024Generalizable Humanoid Manipulation with 3D Diffusion Policiescited by 49
- 2025AMO: Adaptive Motion Optimization for Hyper-Dexterous Humanoid Whole-Body Controlcited by 47
- 2025Learning Humanoid Standing-up Control across Diverse Posturescited by 34
- 2023Sim-to-Real Learning for Humanoid Box Loco-Manipulationcited by 30
- 2025DexMachina: Functional Retargeting for Bimanual Dexterous Manipulationcited by 30
- 2024Opt2Skill: Imitating Dynamically-feasible Whole-Body Trajectories for Versatile Humanoid Loco-Manipulationcited by 28
- 2025FALCON: Learning Force-Adaptive Humanoid Loco-Manipulationcited by 28
- 2021Residual Reinforcement Learning from Demonstrationscited by 27
- 2024Learning from Massive Human Videos for Universal Humanoid Pose Controlcited by 27
- 2025HuB: Learning Extreme Humanoid Balancecited by 21
- 2024DexH2R: Task-oriented Dexterous Manipulation from Human to Robotscited by 11
Built on by
Citing papers per year: 2025: 1; 2026: 33.
34 papers.
Sort:
By area:
- 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrationscited by 11
- 2026InterPrior: Scaling Generative Control for Physics-Based Human-Object Interactionscited by 10
- 2026Dex4D: Task-Agnostic Point Track Policy for Sim-to-Real Dexterous Manipulationcited by 10
- 2026ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulationcited by 9
- 2025From Generated Human Videos to Physically Plausible Robot Trajectoriescited by 5
- 2026MeshMimic: Geometry-Aware Humanoid Motion Learning through 3D Scene Reconstructioncited by 5
- 2026ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generationcited by 5
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interactioncited by 4
- 2026Imagine2Real: Towards Zero-shot Humanoid-Object Interaction via Video Generative Priorscited by 2
- 2026SplitAdapter: Load-Aware Humanoid Loco-Manipulation via Factorized Adaptationcited by 2
- 2026CoorDex: Coordinating Body and Hand Priors for Continuous Dexterous Humanoid Loco-Manipulationcited by 2
- 2026VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenescited by 2
22 more
- 2026AdaptManip: Learning Adaptive Whole-Body Object Lifting and Delivery with Online Recurrent State Estimationcited by 1
- 2026Learning to Assist: Physics-Grounded Human-Human Control via Multi-Agent Reinforcement Learningcited by 1
- 2026ExpertGen: Scalable Sim-to-Real Expert Policy Learning from Imperfect Behavior Priorscited by 1
- 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Frameworkcited by 1
- 2026DreamMimic: Learning Visuomotor Whole-Body Loco-Manipulation via World Modelcited by 1
- 2026Imitation Learning from Human Motion Alone Does Not Guarantee Biomechanically Plausible Gait Kineticscited by 0
- 2026HOIST: Humanoid Optimization with Imitation and Sample-efficient Tuning for Manipulating Suspended Loadscited by 0
- 2026LadderMan: Learning Humanoid Perceptive Ladder Climbingcited by 0
- 2026HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Teacherscited by 0
- 2026RoboNaldo: Accurate, Stable and Powerful Humanoid Soccer Shooting via Motion-Guided Curriculum Reinforcement Learningcited by 0
- 2026EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversalcited by 0
- 2026PFM-HR: Pose Flow Matching for Humanoid Robotscited by 0
- 2026Learning Loco-Manipulation From SMPC Demonstrations With Sparse Offline-to-Online RLcited by 0
- 2026HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmarkcited by 0
- 2026GigaBrain-WBC-0.5: A Behavior World Model for Robust Humanoid Whole-Body Tracking with Environment Interactioncited by 0
- 2026Weave: Learning Whole-Body Dexterous Loco-Manipulation from Human-Object Interactionscited by 0
- 2026Learning Multi-Humanoid Pickup and Transport via Decentralized Object-Centric Controlcited by 0
- 2026EquivDP3: A SIM(3)-Invariant Point-Cloud Encoder for Data-Efficient Humanoid Loco-Manipulationcited by 0
- 2026EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulationcited by 0
- 2026LocoWM: High-Precision Locomotion through World-Model-Guided Residual Adaptationcited by 0
- 2026InterEvolve: Test-Time Evolution of Reward Programs for Humanoid Loco-Manipulationcited by 0
- 2026Being-M0.7: A Latent World-Action Model for Humanoid Robotscited by 0
- 2026Being-M0.7: A Latent World-Action Model for Humanoid Robots8 Oct 2026
- 2026InterEvolve: Test-Time Evolution of Reward Programs for Humanoid Loco-Manipulation1 Oct 2026
- 2026LocoWM: High-Precision Locomotion through World-Model-Guided Residual Adaptation30 Sep 2026
- 2026EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulation29 Sep 2026
- 2026EquivDP3: A SIM(3)-Invariant Point-Cloud Encoder for Data-Efficient Humanoid Loco-Manipulation29 Sep 2026
- 2026Learning Multi-Humanoid Pickup and Transport via Decentralized Object-Centric Control15 Sep 2026
- 2026Weave: Learning Whole-Body Dexterous Loco-Manipulation from Human-Object Interactions15 Sep 2026
- 2026DreamMimic: Learning Visuomotor Whole-Body Loco-Manipulation via World Model23 Aug 2026
- 2026GigaBrain-WBC-0.5: A Behavior World Model for Robust Humanoid Whole-Body Tracking with Environment Interaction18 Aug 2026
- 2026HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmark13 Aug 2026
- 2026Learning Loco-Manipulation From SMPC Demonstrations With Sparse Offline-to-Online RL12 Aug 2026
- 2026PFM-HR: Pose Flow Matching for Humanoid Robots4 Aug 2026
22 more
- 2026EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversal15 Jul 2026
- 2026ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generation9 Jul 2026
- 2026VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenes29 Jun 2026
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interaction25 Jun 2026
- 2026CoorDex: Coordinating Body and Hand Priors for Continuous Dexterous Humanoid Loco-Manipulation22 Jun 2026
- 2026RoboNaldo: Accurate, Stable and Powerful Humanoid Soccer Shooting via Motion-Guided Curriculum Reinforcement Learning9 Jun 2026
- 2026HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Teachers4 Jun 2026
- 2026LadderMan: Learning Humanoid Perceptive Ladder Climbing4 Jun 2026
- 2026SplitAdapter: Load-Aware Humanoid Loco-Manipulation via Factorized Adaptation2 Jun 2026
- 2026HOIST: Humanoid Optimization with Imitation and Sample-efficient Tuning for Manipulating Suspended Loads29 May 2026
- 2026Imagine2Real: Towards Zero-shot Humanoid-Object Interaction via Video Generative Priors21 May 2026
- 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Framework19 May 2026
- 2026ExpertGen: Scalable Sim-to-Real Expert Policy Learning from Imperfect Behavior Priors16 Mar 2026
- 2026Imitation Learning from Human Motion Alone Does Not Guarantee Biomechanically Plausible Gait Kinetics12 Mar 2026
- 2026Learning to Assist: Physics-Grounded Human-Human Control via Multi-Agent Reinforcement Learning11 Mar 2026
- 2026ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulation3 Mar 2026
- 2026Dex4D: Task-Agnostic Point Track Policy for Sim-to-Real Dexterous Manipulation17 Feb 2026
- 2026MeshMimic: Geometry-Aware Humanoid Motion Learning through 3D Scene Reconstruction17 Feb 2026
- 2026AdaptManip: Learning Adaptive Whole-Body Object Lifting and Delivery with Online Recurrent State Estimation16 Feb 2026
- 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrations6 Feb 2026
- 2026InterPrior: Scaling Generative Control for Physics-Based Human-Object Interactions5 Feb 2026
- 2025From Generated Human Videos to Physically Plausible Robot Trajectories4 Dec 2025
- 2026SplitAdapter: Load-Aware Humanoid Loco-Manipulation via Factorized Adaptationcited by 2
- 2026DreamMimic: Learning Visuomotor Whole-Body Loco-Manipulation via World Modelcited by 1
- 2026GigaBrain-WBC-0.5: A Behavior World Model for Robust Humanoid Whole-Body Tracking with Environment Interactioncited by 0
- 2026LocoWM: High-Precision Locomotion through World-Model-Guided Residual Adaptationcited by 0
- 2026LocoWM: High-Precision Locomotion through World-Model-Guided Residual Adaptation30 Sep 2026
- 2026DreamMimic: Learning Visuomotor Whole-Body Loco-Manipulation via World Model23 Aug 2026
- 2026GigaBrain-WBC-0.5: A Behavior World Model for Robust Humanoid Whole-Body Tracking with Environment Interaction18 Aug 2026
- 2026SplitAdapter: Load-Aware Humanoid Loco-Manipulation via Factorized Adaptation2 Jun 2026
- 2026AdaptManip: Learning Adaptive Whole-Body Object Lifting and Delivery with Online Recurrent State Estimationcited by 1
- 2026Imitation Learning from Human Motion Alone Does Not Guarantee Biomechanically Plausible Gait Kineticscited by 0
- 2026Learning Loco-Manipulation From SMPC Demonstrations With Sparse Offline-to-Online RLcited by 0
- 2026Learning Loco-Manipulation From SMPC Demonstrations With Sparse Offline-to-Online RL12 Aug 2026
- 2026Imitation Learning from Human Motion Alone Does Not Guarantee Biomechanically Plausible Gait Kinetics12 Mar 2026
- 2026AdaptManip: Learning Adaptive Whole-Body Object Lifting and Delivery with Online Recurrent State Estimation16 Feb 2026
- 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrationscited by 11
- 2026InterPrior: Scaling Generative Control for Physics-Based Human-Object Interactionscited by 10
- 2026Dex4D: Task-Agnostic Point Track Policy for Sim-to-Real Dexterous Manipulationcited by 10
- 2026ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulationcited by 9
- 2025From Generated Human Videos to Physically Plausible Robot Trajectoriescited by 5
- 2026MeshMimic: Geometry-Aware Humanoid Motion Learning through 3D Scene Reconstructioncited by 5
- 2026ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generationcited by 5
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interactioncited by 4
- 2026Imagine2Real: Towards Zero-shot Humanoid-Object Interaction via Video Generative Priorscited by 2
- 2026CoorDex: Coordinating Body and Hand Priors for Continuous Dexterous Humanoid Loco-Manipulationcited by 2
- 2026VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenescited by 2
- 2026Learning to Assist: Physics-Grounded Human-Human Control via Multi-Agent Reinforcement Learningcited by 1
12 most cited of 23 All 23 (JSON)
- 2026Being-M0.7: A Latent World-Action Model for Humanoid Robots8 Oct 2026
- 2026InterEvolve: Test-Time Evolution of Reward Programs for Humanoid Loco-Manipulation1 Oct 2026
- 2026EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulation29 Sep 2026
- 2026Learning Multi-Humanoid Pickup and Transport via Decentralized Object-Centric Control15 Sep 2026
- 2026Weave: Learning Whole-Body Dexterous Loco-Manipulation from Human-Object Interactions15 Sep 2026
- 2026HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmark13 Aug 2026
- 2026EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversal15 Jul 2026
- 2026ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generation9 Jul 2026
- 2026VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenes29 Jun 2026
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interaction25 Jun 2026
- 2026CoorDex: Coordinating Body and Hand Priors for Continuous Dexterous Humanoid Loco-Manipulation22 Jun 2026
- 2026RoboNaldo: Accurate, Stable and Powerful Humanoid Soccer Shooting via Motion-Guided Curriculum Reinforcement Learning9 Jun 2026
12 newest of 23 All 23 (JSON)