CMR: Contractive Mapping Embeddings for Robust Humanoid Locomotion on Unstructured Terrains
Not on the map. Why?
Abstract (arXiv)
Robust disturbance rejection remains a longstanding challenge in humanoid locomotion, particularly on unstructured terrains where sensing is unreliable and model mismatch is pronounced. While perception information, such as height map, enhances terrain awareness, sensor noise and sim-to-real gaps can destabilize policies in practice. In this work, we provide theoretical analysis that bounds the return gap under observation noise, when the induced latent dynamics are contractive. Furthermore, we present Contractive Mapping for Robustness (CMR) framework that maps high-dimensional, disturbance-prone observations into a latent space, where local perturbations are attenuated over time. Specifically, this approach couples contrastive representation learning with Lipschitz regularization to preserve task-relevant geometry while explicitly controlling sensitivity. Notably, the formulation can be incorporated into modern deep reinforcement learning pipelines as an auxiliary loss term with minimal additional technical effort required. Further, our extensive humanoid experiments show that CMR potently outperforms other locomotion algorithms under increased noise.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 48 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
39 of 48 references.
References · 39
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 494
- 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 430
- 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 395
- 2019Learning by Cheatingcited by 361
- 2019Efficient and Accurate Estimation of Lipschitz Constants for Deep Neural Networkscited by 290
- 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 167
- 2023Real-World Humanoid Locomotion with Reinforcement Learningcited by 132
- 2022Rapid Locomotion via Reinforcement Learningcited by 130
- 2024AttnLRP: Attention-Aware Layer-Wise Relevance Propagation for Transformerscited by 116
- 2022Walk These Ways: Tuning Robot Control for Generalization with Multiplicity of Behaviorcited by 113
27 more
- 2024Learning Human-to-Humanoid Real-Time Whole-Body Teleoperationcited by 112
- 2021Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robotscited by 95
- 2024Humanoid Parkour Learningcited by 66
- 2025Humanoid Locomotion and Manipulation: Current Progress and Challenges in Control, Planning, and Learningcited by 52
- 2020Regularizing Action Policies for Smooth Control with Reinforcement Learningcited by 47
- 2024Learning Humanoid Locomotion with Perceptive Internal Modelcited by 38
- 2022Hierarchical Reinforcement Learning for Precise Soccer Shooting Skills using a Quadrupedal Robotcited by 32
- 2024Learning Robust Autonomous Navigation and Locomotion for Wheeled-Legged Robotscited by 32
- 2025BeamDojo: Learning Agile Humanoid Locomotion on Sparse Footholdscited by 32
- 2023Hybrid Internal Model: Learning Agile Legged Locomotion with Simulated Robot Responsecited by 31
- 2018Stability-certified reinforcement learning: A control-theoretic perspectivecited by 29
- 2020Hamilton-Jacobi Deep Q-Learning for Deterministic Continuous-Time Systems with Lipschitz Continuous Controlscited by 29
- 2025Attention-Based Map Encoding for Learning Generalized Legged Locomotioncited by 27
- 2017Gradient Regularization Improves Accuracy of Discriminative Modelscited by 26
- 2024Learning Smooth Humanoid Locomotion through Lipschitz-Constrained Policiescited by 26
- 2022L2C2: Locally Lipschitz Continuous Constraint towards Stable and Smooth Reinforcement Learningcited by 22
- 2021Model-free Reinforcement Learning for Robust Locomotion using Demonstrations from Trajectory Optimizationcited by 16
- 2024Learning to walk in confined spaces using 3D representationcited by 15
- 2025Robust Gymnasium: A Unified Modular Benchmark for Robust Reinforcement Learningcited by 12
- 2025Humanoid Whole-Body Locomotion on Narrow Terrain via Dynamic Balance and Reinforcement Learningcited by 7
- 2020Efficient Multi-Contact Pattern Generation with Sequential Convex Approximations of the Centroidal Dynamicscited by 6
- 2023Guaranteeing Control Requirements via Reward Shaping in Reinforcement Learningcited by 5
- 2024Toward Understanding Key Estimation in Learning Robust Humanoid Locomotioncited by 4
- 2023Dynamic Loco-manipulation on HECTOR: Humanoid for Enhanced ConTrol and Open-source Researchcited by 3
- 2021Learning Collision-free and Torque-limited Robot Trajectories based on Alternative Safe Behaviorscited by 2
- 2021Optimal control of the Fokker-Planck equation under state constraints in the Wasserstein spacecited by 2
- 2024Near Optimality of Lipschitz and Smooth Policies in Controlled Diffusionscited by 2
Built on by
Not cited yet.