ZEST: Zero-shot Embodied Skill Transfer for Athletic Robot Control
Not on the map. Why?
Abstract (arXiv)
Achieving robust, human-like whole-body control on humanoid robots for agile, contact-rich behaviors remains a central challenge, demanding heavy per-skill engineering and a brittle process of tuning controllers. We introduce ZEST (Zero-shot Embodied Skill Transfer), a streamlined motion-imitation framework that trains policies via reinforcement learning from diverse sources -- high-fidelity motion capture, noisy monocular video, and non-physics-constrained animation -- and deploys them to hardware zero-shot. ZEST generalizes across behaviors and platforms while avoiding contact labels, reference or observation windows, state estimators, and extensive reward shaping. Its training pipeline combines adaptive sampling, which focuses training on difficult motion segments, and an automatic curriculum using a model-based assistive wrench, together enabling dynamic, long-horizon maneuvers. We further provide a procedure for selecting joint-level gains from approximate analytical armature values for closed-chain actuators, along with a refined model of actuators. Trained entirely in simulation with moderate domain randomization, ZEST demonstrates remarkable generality. On Boston Dynamics' Atlas humanoid, ZEST learns dynamic, multi-contact skills (e.g., army crawl, breakdancing) from motion capture. It transfers expressive dance and scene-interaction skills, such as box-climbing, directly from videos to Atlas and the Unitree G1. Furthermore, it extends across morphologies to the Spot quadruped, enabling acrobatics, such as a continuous backflip, through animation. Together, these results demonstrate robust zero-shot deployment across heterogeneous data sources and embodiments, establishing ZEST as a scalable interface between biological movements and their robotic counterparts.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 48 of its 67 references that are in the map. First posted on arXiv 30 Jan 2026.
Builds on
48 of 67 references.
References · 48
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2018Learning Dexterous In-Hand Manipulationcited by 643
- 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 494
- 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 395
- 2020Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Surveycited by 388
- 2022Learning robust perceptive locomotion for quadrupedal robots in the wildcited by 299
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
- 2017Asymmetric Actor Critic for Image-Based Robot Learningcited by 202
- 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 198
- 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 167
- 2018DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skillscited by 153
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 128
36 more
- 2023Extreme Parkour with Legged Robotscited by 120
- 2023ANYmal Parkour: Learning Agile Navigation for Quadrupedal Robotscited by 105
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 104
- 2024CLoSD: Closing the Loop between Simulation and Diffusion for multi-task character controlcited by 103
- 2024MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpaintingcited by 101
- 2023CALM: Conditional Adversarial Latent Models for Directable Virtual Characterscited by 91
- 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 83
- 2024HOVER: Versatile Neural Whole-Body Controller for Humanoid Robotscited by 76
- 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 72
- 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 67
- 2020Residual Force Control for Agile Human Behavior Imitation and Extended Motion Synthesiscited by 63
- 2025Visual Imitation Enables Contextual Humanoid Controlcited by 57
- 2025OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interactioncited by 57
- 2018Learning Symmetric and Low-energy Locomotioncited by 53
- 2025Humanoid Locomotion and Manipulation: Current Progress and Challenges in Control, Planning, and Learningcited by 52
- 2025Sim-to-Real Reinforcement Learning for Vision-Based Dexterous Manipulation on Humanoidscited by 40
- 2025KungfuBot: Physics-Based Humanoid Whole-Body Control for Learning Highly-Dynamic Skillscited by 39
- 2023DTC: Deep Tracking Controlcited by 37
- 2025Learning Humanoid Standing-up Control across Diverse Posturescited by 34
- 2023Versatile Multi-Contact Planning and Control for Legged Loco-Manipulationcited by 28
- 2025FALCON: Learning Force-Adaptive Humanoid Loco-Manipulationcited by 28
- 2025PARC: Physics-based Augmentation with Reinforcement Learning for Character Controllerscited by 24
- 2025HuB: Learning Extreme Humanoid Balancecited by 21
- 2021Robust High-speed Running for Quadruped Robots via Deep Reinforcement Learningcited by 20
- 2022OPT-Mimic: Imitation of Optimized Trajectories for Dynamic Quadruped Behaviorscited by 19
- 2025Parkour in the Wild: Learning a General and Extensible Agile Locomotion Policy Using Multi-expert Distillation and RL Fine-tuningcited by 18
- 2021Model-free Reinforcement Learning for Robust Locomotion using Demonstrations from Trajectory Optimizationcited by 16
- 2025Learning coordinated badminton skills for legged manipulatorscited by 16
- 2025Design and Control of a Bipedal Robotic Charactercited by 12
- 2024Guided Reinforcement Learning for Robust Multi-Contact Loco-Manipulationcited by 9
- 2025Learning Perceptive Humanoid Locomotion over Challenging Terraincited by 8
- 2024Cafe-Mpc: A Cascaded-Fidelity Model Predictive Control Framework with Tuning-Free Whole-Body Controlcited by 5
- 2025High-Performance Reinforcement Learning on Spot: Optimizing Simulation Parameters with Distributional Measurescited by 5
- 2025Dynamic object goal pushing with mobile manipulators through model-free constrained reinforcement learningcited by 3
- 2025Learning Motion Skills with Adaptive Assistive Curriculum Force in Humanoid Robotscited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Heracles: Bridging Precise Tracking and Generative Synthesis for General Humanoid Controlcited by 5
- 2026ADP: Adversarial Dynamics Priors for Physically Grounded Humanoid Locomotioncited by 1
- 2026BRIDGE: An Open-Source Humanoid Platform via Morphology-Control Co-Design for Physical AIcited by 0
- 2026ForgetMimic: Motion Unlearning for Reinforcement Learning Humanoid Controlcited by 0
- 2026ForgetMimic: Motion Unlearning for Reinforcement Learning Humanoid Control23 Sep 2026
- 2026BRIDGE: An Open-Source Humanoid Platform via Morphology-Control Co-Design for Physical AI3 Sep 2026
- 2026ADP: Adversarial Dynamics Priors for Physically Grounded Humanoid Locomotion3 Jul 2026
- 2026Heracles: Bridging Precise Tracking and Generative Synthesis for General Humanoid Control29 Mar 2026