mlsanityData to 14 Oct 2026

FootQuery: Future-Touchdown-Guided Retrieval from Depth History for Perceptive Humanoid Locomotion

arXiv 2609.21447 ↗First posted 18 Sep 2026cs.RO cs.LG cs.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

Humanoid locomotion over complex terrain requires anticipating footholds that may no longer be visible at touchdown. Limited camera coverage and self-occlusion make it necessary to retrieve relevant terrain information from earlier observations. We present FootQuery, a perceptive locomotion framework that queries depth history using each foot's predicted next touchdown. The policy predicts touchdown locations and uncertainty from proprioception and uses these distributions, together with per-foot features, to query sparsely sampled historical depth frames. During training, realized contacts are projected into historical images to supervise retrieval at the regions where those contacts were visible. The retrieved per-foot features are fused with global visual memory to generate control actions. A progressive force-assistance curriculum supports early exploration, while event-consistent tread-midline shaping encourages coordinated stair contacts. Deployment requires only proprioception and onboard depth images. In simulation, the complete framework outperforms its component ablations on the most challenging tested stairs, gaps, and platforms. Real-world experiments on a Unitree G1 demonstrate continuous traversal with a single policy across outdoor stairs and indoor routes combining stair ascent and descent, platforms, and gaps. These results support organizing visual history around anticipated contacts for perceptive humanoid locomotion.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 30 references that are in the map. First posted on arXiv 18 Sep 2026.

Builds on

28 of 30 references.

References · 28

  1. 2017Attention Is All You Needcited by 60,361
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  4. 2022Learning robust perceptive locomotion for quadrupedal robots in the wildcited by 382
  5. 2022Legged Locomotion in Challenging Terrains using Egocentric Visioncited by 151
  6. 2023Robot Parkour Learningcited by 149
  7. 2024Humanoid Parkour Learningcited by 96
  8. 2021Learning Vision-Guided Quadrupedal Locomotion End-to-End with Cross-Modal Transformerscited by 79
  9. 2025BeamDojo: Learning Agile Humanoid Locomotion on Sparse Footholdscited by 46
  10. 2023Neural Volumetric Memory for Visual Locomotion Controlcited by 44
  11. 2023Learning Vision-Based Bipedal Locomotion for Challenging Terraincited by 42
  12. 2025Attention-Based Map Encoding for Learning Generalized Legged Locomotioncited by 40
16 more
  1. 2022Perceptive Locomotion through Nonlinear Model Predictive Controlcited by 38
  2. 2026Hiking in the Wild: A Scalable Perceptive Parkour Framework for Humanoidscited by 13
  3. 2025MoRE: Mixture of Residual Experts for Humanoid Lifelike Gaits Learning on Complex Terrainscited by 10
  4. 2025Learning Motion Skills with Adaptive Assistive Curriculum Force in Humanoid Robotscited by 3
  5. 2025START: Traversing Sparse Footholds with Terrain Reconstructioncited by 3
  6. 2025Perceptive Mixed-Integer Footstep Control for Underactuated Bipedal Walking on Rough Terraincited by 2
  7. 2025KiVi: Kinesthetic-Visuospatial Integration for Dynamic and Safe Egocentric Legged Locomotioncited by 2
  8. 2026CReF: Cross-modal and Recurrent Fusion for Depth-conditioned Humanoid Locomotioncited by 2
  9. 2025GelFusion: Enhancing Robotic Manipulation under Visual Constraints via Visuotactile Fusioncited by 1
  10. 2026Look Forward to Walk Backward: Efficient Terrain Memory for Backward Locomotion with Forward Visioncited by 1
  11. 2026Learning Locomotion on Complex Terrain for Quadrupedal Robots with Foot Position Maps and Stability Rewardscited by 1
  12. 2026SSR: Scaling Surefooted and Symmetric Humanoid Traversal to the Open Worldcited by 1
  13. 2026Global-Local Attention Decomposition for Terrain Encoding in Humanoid Perceptive Locomotioncited by 1
  14. 2026DELTA: Deformable Elevation-Based Local Terrain Attention Encoder for Sparse-Terrain Quadrupedal Locomotioncited by 1
  15. 2026SOLO: Stable Omni-terrain Long-Horizon Perceptive Humanoid Locomotioncited by 1
  16. 2026PGMT: Perceptive General Motion Tracking for Humanoid Robotscited by 1

Built on by

Not cited yet.