Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matching
Not on the map. Why?
Abstract (arXiv)
While recent advances in humanoid locomotion have achieved stable walking on varied terrains, capturing the agility and adaptivity of highly dynamic human motions remains an open challenge. In particular, agile parkour in complex environments demands not only low-level robustness, but also human-like motion expressiveness, long-horizon skill composition, and perception-driven decision-making. In this paper, we present Perceptive Humanoid Parkour (PHP), a modular framework that enables humanoid robots to autonomously perform long-horizon, vision-based parkour across challenging obstacle courses. Our approach first leverages motion matching, formulated as nearest-neighbor search in a feature space, to compose retargeted atomic human skills into long-horizon kinematic trajectories. This framework enables the flexible composition and smooth transition of complex skill chains while preserving the elegance and fluidity of dynamic human motions. Next, we train motion-tracking reinforcement learning (RL) expert policies for these composed motions, and distill them into a single depth-based, multi-skill student policy, using a combination of DAgger and RL. Crucially, the combination of perception and skill composition enables autonomous, context-aware decision-making: using only onboard depth sensing and a discrete 2D velocity command, the robot selects and executes whether to step over, climb onto, vault or roll off obstacles of varying geometries and heights. We validate our framework with extensive real-world experiments on a Unitree G1 humanoid robot, demonstrating highly dynamic parkour skills such as climbing tall obstacles up to 1.25m (96% robot height), as well as long-horizon multi-obstacle traversal with closed-loop adaptation to real-time obstacle perturbations.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 38 of its 54 references that are in the map. First posted on arXiv 17 Feb 2026.
Builds on
38 of 54 references.
References · 38
- 2022Human Motion Diffusion Modelcited by 1,062
- 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 494
- 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 430
- 2022Learning robust perceptive locomotion for quadrupedal robots in the wildcited by 299
- 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 164
- 2022Legged Locomotion in Challenging Terrains using Egocentric Visioncited by 131
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 128
- 2023Extreme Parkour with Legged Robotscited by 120
- 2023Robot Parkour Learningcited by 115
- 2023ANYmal Parkour: Learning Agile Navigation for Quadrupedal Robotscited by 105
- 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 83
- 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 72
26 more
- 2024Humanoid Parkour Learningcited by 66
- 2025OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interactioncited by 57
- 2023Neural Volumetric Memory for Visual Locomotion Controlcited by 40
- 2025KungfuBot: Physics-Based Humanoid Whole-Body Control for Learning Highly-Dynamic Skillscited by 39
- 2025TWIST2: Scalable, Portable, and Holistic Humanoid Data Collection Systemcited by 39
- 2024Learning Humanoid Locomotion with Perceptive Internal Modelcited by 38
- 2023DreamWaQ: Learning Robust Quadrupedal Locomotion With Implicit Terrain Imagination via Deep Reinforcement Learningcited by 37
- 2023Barkour: Benchmarking Animal-level Agility with Quadruped Robotscited by 33
- 2025BeamDojo: Learning Agile Humanoid Locomotion on Sparse Footholdscited by 32
- 2023Hybrid Internal Model: Learning Agile Legged Locomotion with Simulated Robot Responsecited by 31
- 2025Diffuse-CLoC: Guided Diffusion for Physics-based Character Look-ahead Controlcited by 27
- 2025Attention-Based Map Encoding for Learning Generalized Legged Locomotioncited by 27
- 2025PARC: Physics-based Augmentation with Reinforcement Learning for Character Controllerscited by 24
- 2025HuB: Learning Extreme Humanoid Balancecited by 21
- 2025Parkour in the Wild: Learning a General and Extensible Agile Locomotion Policy Using Multi-expert Distillation and RL Fine-tuningcited by 18
- 2024PIE: Parkour with Implicit-Explicit Learning Framework for Legged Robotscited by 17
- 2024Learning Visual Parkour from Generated Imagescited by 17
- 2025PhysHSI: Towards a Real-World Generalizable and Natural Humanoid-Scene Interaction Systemcited by 17
- 2025DreamControl: Human-Inspired Whole-Body Humanoid Control for Scene Interaction via Guided Diffusioncited by 13
- 2026Hiking in the Wild: A Scalable Perceptive Parkour Framework for Humanoidscited by 11
- 2025Gallant: Voxel Grid-based Humanoid Locomotion and Local-navigation across 3D Constrained Terrainscited by 10
- 2025Agility Meets Stability: Versatile Humanoid Control with Heterogeneous Datacited by 10
- 2025DPL: Depth-only Perceptive Humanoid Locomotion via Realistic Depth Synthesis and Cross-Attention Terrain Reconstructioncited by 7
- 2025Learning to Ball: Composing Policies for Long-Horizon Basketball Movescited by 6
- 2024Walking with Terrain Reconstruction: Learning to Traverse Risky Sparse Footholdscited by 4
- 2026Locomotion Beyond Feetcited by 2
Built on by
Citing papers per year: 2026: 13.
13 papers.
Sort:
By area:
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interactioncited by 4
- 2026LUCID: Learning Embodiment-Agnostic Intent Models from Unstructured Human Videos for Scalable Dexterous Robot Skill Acquisitioncited by 2
- 2026PAC-MAN: Perception-Aware CBF-RL for Whole-Body Safety in Humanoid Dodgeballcited by 2
- 2026Active Stereo-Camera Outperforms Multi-Sensor Setup in ACT Imitation Learning for Humanoid Manipulationcited by 0
- 2026LadderMan: Learning Humanoid Perceptive Ladder Climbingcited by 0
- 2026HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Teacherscited by 0
- 2026TaskNPoint: How to Teach Your Humanoid to Hit a Backhand in Minutescited by 0
- 2026EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversalcited by 0
- 2026GigaBrain-WBC-0.5: A Behavior World Model for Robust Humanoid Whole-Body Tracking with Environment Interactioncited by 0
- 2026TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Modelcited by 0
- 2026CAP: Continuously Adaptive Perception-Blind Humanoid Locomotion via Learned Denoisingcited by 0
- 2026Skill Composition for Legged Robot Reinforcement Learningcited by 0
1 more
- 2026Counterfactual Video Generation Enables Scalable Humanoid Loco-Manipulation29 Sep 2026
- 2026Skill Composition for Legged Robot Reinforcement Learning13 Sep 2026
- 2026CAP: Continuously Adaptive Perception-Blind Humanoid Locomotion via Learned Denoising10 Sep 2026
- 2026TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Model8 Sep 2026
- 2026GigaBrain-WBC-0.5: A Behavior World Model for Robust Humanoid Whole-Body Tracking with Environment Interaction18 Aug 2026
- 2026PAC-MAN: Perception-Aware CBF-RL for Whole-Body Safety in Humanoid Dodgeball30 Jul 2026
- 2026EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversal15 Jul 2026
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interaction25 Jun 2026
- 2026TaskNPoint: How to Teach Your Humanoid to Hit a Backhand in Minutes24 Jun 2026
- 2026LUCID: Learning Embodiment-Agnostic Intent Models from Unstructured Human Videos for Scalable Dexterous Robot Skill Acquisition10 Jun 2026
- 2026HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Teachers4 Jun 2026
- 2026LadderMan: Learning Humanoid Perceptive Ladder Climbing4 Jun 2026
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interactioncited by 4
- 2026LUCID: Learning Embodiment-Agnostic Intent Models from Unstructured Human Videos for Scalable Dexterous Robot Skill Acquisitioncited by 2
- 2026PAC-MAN: Perception-Aware CBF-RL for Whole-Body Safety in Humanoid Dodgeballcited by 2
- 2026LadderMan: Learning Humanoid Perceptive Ladder Climbingcited by 0
- 2026TaskNPoint: How to Teach Your Humanoid to Hit a Backhand in Minutescited by 0
- 2026EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversalcited by 0
- 2026TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Modelcited by 0
- 2026Skill Composition for Legged Robot Reinforcement Learningcited by 0
- 2026Counterfactual Video Generation Enables Scalable Humanoid Loco-Manipulationcited by 0
- 2026Counterfactual Video Generation Enables Scalable Humanoid Loco-Manipulation29 Sep 2026
- 2026Skill Composition for Legged Robot Reinforcement Learning13 Sep 2026
- 2026TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Model8 Sep 2026
- 2026PAC-MAN: Perception-Aware CBF-RL for Whole-Body Safety in Humanoid Dodgeball30 Jul 2026
- 2026EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversal15 Jul 2026
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interaction25 Jun 2026
- 2026TaskNPoint: How to Teach Your Humanoid to Hit a Backhand in Minutes24 Jun 2026
- 2026LUCID: Learning Embodiment-Agnostic Intent Models from Unstructured Human Videos for Scalable Dexterous Robot Skill Acquisition10 Jun 2026
- 2026LadderMan: Learning Humanoid Perceptive Ladder Climbing4 Jun 2026