Global-Local Attention Decomposition for Terrain Encoding in Humanoid Perceptive Locomotion
On the map: Deep reinforcement learning methods → RL for robot locomotion and manipulation
Abstract (arXiv)
Although reinforcement learning has significantly advanced humanoid locomotion, perceptive policies still struggle on sparse-foothold terrain and constrained environments. Success in these scenarios requires both broad terrain awareness and precise foothold selection, two perceptual roles that conventional encoders often entangle. To address this challenge, we propose Global-Local Attention Decomposition (GLAD) for terrain encoding in humanoid locomotion. Realized by a coarse-to-fine encoder over a robot-centric elevation map, GLAD explicitly separates these objectives: a global attention branch uses attention pooling to summarize the surrounding terrain context, while a local attention branch sparsifies the local features by terrain saliency and applies state-conditioned attention to encode precise foothold-relevant geometry. This explicit attention decomposition prevents the dilution of fine-grained spatial cues while reducing training overhead. Experiments demonstrate that GLAD enables reliable locomotion over challenging gaps, stepping stones, and stairs. Furthermore, the learned policy exhibits emergent terrain-responsive behaviors, autonomously following narrow paths and avoiding obstacles under forward-velocity commands alone, without explicit navigation planners. In real-world deployment on a Unitree G1 humanoid robot using onboard LiDAR, the proposed method achieves robust zero-shot sim-to-real transfer across diverse sparse-foothold and obstacle-rich domains.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in RL for robot locomotion and manipulation, one of 15 directions in Deep reinforcement learning methods. Builds on 22 of its 27 references that are in the map. First posted on arXiv 30 May 2026.
Builds on
22 of 27 references.
Closest ancestors · 1
Same direction, newest first
- 2025Gait-Adaptive Perceptive Humanoid Locomotion with Real-Time Under-Base Terrain Reconstruction8 Dec
Other references · 21
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 512
- 2023Real-World Humanoid Locomotion with Reinforcement Learningcited by 187
- 2021Learning Vision-Guided Quadrupedal Locomotion End-to-End with Cross-Modal Transformerscited by 79
- 2020FAST-LIO: A Fast, Robust LiDAR-inertial Odometry Package by Tightly-Coupled Iterated Kalman Filtercited by 74
- 2024Learning Humanoid Locomotion with Perceptive Internal Modelcited by 50
- 2025BeamDojo: Learning Agile Humanoid Locomotion on Sparse Footholdscited by 46
- 2022Elevation Mapping for Locomotion and Navigation using GPUcited by 43
- 2023Learning Vision-Based Bipedal Locomotion for Challenging Terraincited by 42
- 2025Attention-Based Map Encoding for Learning Generalized Legged Locomotioncited by 40
- 2024Learning Humanoid Locomotion over Challenging Terraincited by 26
- 2024PIE: Parkour with Implicit-Explicit Learning Framework for Legged Robotscited by 25
9 more
- 2023Learning Agile Locomotion on Risky Terrainscited by 21
- 2022TAMOLS: Terrain-Aware Motion Optimization for Legged Systemscited by 14
- 2026Hiking in the Wild: A Scalable Perceptive Parkour Framework for Humanoidscited by 13
- 2025Learning Perceptive Humanoid Locomotion over Challenging Terraincited by 12
- 2025DPL: Depth-only Perceptive Humanoid Locomotion via Realistic Depth Synthesis and Cross-Attention Terrain Reconstructioncited by 11
- 2026RPL: Learning Robust Humanoid Perceptive Locomotion on Challenging Terrainscited by 10
- 2024Walking with Terrain Reconstruction: Learning to Traverse Risky Sparse Footholdscited by 8
- 2026Agile and Generalized Legged Locomotion via Attention-Based Neural Map Encodingcited by 5
- 2025No More Blind Spots: Learning Vision-Based Omnidirectional Bipedal Locomotion for Challenging Terraincited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Loco-Loco-RL: Low-Cost Terrain Mapping for Humanoid Locomotion with Reinforcement Learning
- 2026TAGA: Terrain-aware Active Gaze Learning for Generalizable Agile Humanoid Locomotion
- 2026World-Model-Augmented Visual Locomotion for Humanoids on Foothold-Constrained Terrain
- 2026DELTA: Deformable Elevation-Based Local Terrain Attention Encoder for Sparse-Terrain Quadrupedal Locomotion
- 2025E-SDS: Environment-aware See it, Do it, Sorted - Automated Environment-Aware Reinforcement Learning for Humanoid Locomotion
- 2026PILOT: A Perceptive Integrated Low-level Controller for Loco-manipulation over Unstructured Scenes ↗
- 2026P-BFM: Perceptive Behavioral Foundation Models for Humanoid Control via Unsupervised Reinforcement Learning
- 2024Advancing Humanoid Locomotion: Mastering Challenging Terrains with Denoising World Model Learning