WristMimic: Full-Body Humanoid Control with Wrist-Guided Manipulation
Not on the map. Why?
Abstract (arXiv)
Retargeting human object interaction demonstrations to physics based simulation requires reproducing not only body motion but also the object motion and contacts that make manipulation succeed. However, position only hand trajectories do not specify the contact forces needed to manipulate objects, and directly tracking them can overconstrain contact rich finger behavior. We introduce WristMimic, a wrist guided whole body control framework that explicitly separates contact free body motion from contact rich hand manipulation. The contact free body and wrist are guided by kinematic pose targets, whereas the fingers are not directly supervised by human hand pose. Instead, they learn grasping and manipulation behaviors from object tracking and contact outcomes. Our key insight is that the wrist is the natural gate between these two regimes. It is largely free from contact and can be tracked kinematically, yet it determines the global hand configuration and places the fingers within reachable grasp affordances. To ensure reliable wrist placement during interaction, we introduce wrist specific reset constraints and reward prioritization. Experiments show that WristMimic matches or surpasses methods using full finger pose supervision while enabling finger agnostic retargeting across diverse hand embodiments.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 70 of its 77 references that are in the map. First posted on arXiv 7 Jul 2026.
Builds on
70 of 77 references.
References · 70
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 882
- 2019Solving Rubik's Cube with a Robot Handcited by 699
- 2018Learning Dexterous In-Hand Manipulationcited by 643
- 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 397
- 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
- 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 306
- 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
- 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
38 more
- 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 244
- 2023Object Motion Guided Human Motion Synthesiscited by 206
- 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 198
- 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 167
- 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 164
- 2024EgoMimic: Scaling Imitation Learning via Egocentric Videocited by 160
- 2022DeXtreme: Transfer of Agile In-hand Manipulation from Simulation to Realitycited by 136
- 2022OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interactioncited by 129
- 2022DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulationcited by 129
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 128
- 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 122
- 2023UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned Policycited by 117
- 2024Expressive Whole-Body Control for Humanoid Robotscited by 117
- 2023Universal Humanoid Motion Representations for Physics-Based Controlcited by 109
- 2024CLoSD: Closing the Loop between Simulation and Diffusion for multi-task character controlcited by 103
- 2023Synthesizing Physical Character-Scene Interactionscited by 102
- 2023General In-Hand Object Rotation with Vision and Touchcited by 87
- 2025DexGraspVLA: A Vision-Language-Action Framework Towards General Dexterous Graspingcited by 87
- 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 83
- 2022From One Hand to Multiple Hands: Imitation Learning for Dexterous Manipulation from Single-Camera Teleoperationcited by 79
- 2024OAKINK2: A Dataset of Bimanual Hands-Object Manipulation in Complex Task Completioncited by 78
- 2026EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Datacited by 77
- 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 72
- 20243D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensingcited by 67
- 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 67
- 2023AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimationcited by 64
- 2024Human-Object Interaction from Human-Level Instructionscited by 62
- 2024OKAMI: Teaching Humanoid Robots Manipulation Skills through Single Video Imitationcited by 62
- 2024GraspXL: Generating Grasping Motions for Diverse Objects at Scalecited by 59
- 2025DexUMI: Using Human Hand as the Universal Manipulation Interface for Dexterous Manipulationcited by 58
- 2025ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual Learningcited by 56
- 2024ParaHome: Parameterizing Everyday Home Activities Towards 3D Generative Modeling of Human-Object Interactionscited by 54
- 2023Physically Plausible Full-Body Hand-Object Interaction Synthesiscited by 52
- 2022Grasp'D: Differentiable Contact-rich Grasp Synthesis for Multi-fingered Handscited by 49
- 2024DexDiffuser: Generating Dexterous Grasps with Diffusion Modelscited by 46
- 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenizationcited by 46
- 2024Omnigrasp: Grasping Diverse Objects with Simulated Humanoidscited by 45
- 2023Sequential Dexterity: Chaining Dexterous Policies for Long-Horizon Manipulationcited by 43
50 most cited of 70 All 70 (JSON)
Built on by
Not cited yet.