mlsanityData to 14 Oct 2026

HuMam: Humanoid Motion Control via End-to-End Deep Reinforcement Learning with Mamba

arXiv 2509.18046 ↗First posted 22 Sep 2025cs.RO cs.AI cs.ETcited by 0

On the map: State-space sequence models (S4, Mamba) → Video, motion and generative Mamba models

also in 1 more
Abstract (arXiv)

End-to-end reinforcement learning (RL) for humanoid locomotion is appealing for its compact perception-action mapping, yet practical policies often suffer from training instability, inefficient feature fusion, and high actuation cost. We present HuMam, a state-centric end-to-end RL framework that employs a single-layer Mamba encoder to fuse robot-centric states with oriented footstep targets and a continuous phase clock. The policy outputs joint position targets tracked by a low-level PD loop and is optimized with PPO. A concise six-term reward balances contact quality, swing smoothness, foot placement, posture, and body stability while implicitly promoting energy saving. On the JVRC-1 humanoid in mc-mujoco, HuMam consistently improves learning efficiency, training stability, and overall task performance over a strong feedforward baseline, while reducing power consumption and torque peaks. To our knowledge, this is the first end-to-end humanoid RL controller that adopts Mamba as the fusion backbone, demonstrating tangible gains in efficiency, stability, and control economy.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video, motion and generative Mamba models, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 20 of its 34 references that are in the map. First posted on arXiv 22 Sep 2025.

Builds on

20 of 34 references.

References · 20

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
  4. 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 604
  5. 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 512
  6. 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 508
  7. 2019Learning agile and dynamic motor skills for legged robotscited by 504
  8. 2021Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robotscited by 116
  9. 2020Sim-to-Real Learning of All Common Bipedal Gaits via Periodic Reward Compositioncited by 96
  10. 2021Blind Bipedal Stair Traversal via Sim-to-Real Reinforcement Learningcited by 92
  11. 2020Multi-expert learning of adaptive legged locomotioncited by 67
  12. 2020ALLSTEPS: Curriculum-driven Learning of Stepping Stone Skillscited by 54
8 more
  1. 2023Teleoperation of Humanoid Robots: A Surveycited by 34
  2. 2021DeepWalk: Omnidirectional Bipedal Gait by Deep Reinforcement Learningcited by 21
  3. 2023Learning Bipedal Walking for Humanoids with Current Feedbackcited by 18
  4. 2021Robust Feedback Motion Policy Design Using Reinforcement Learning on a 3D Digit Bipedal Robotcited by 17
  5. 2022Learning Bipedal Walking On Planned Footsteps For Humanoid Robotscited by 12
  6. 2022Learning Dynamic Bipedal Walking Across Stepping Stonescited by 9
  7. 2020Learning Whole-body Motor Skills for Humanoidscited by 6
  8. 2022mc-mujoco: Simulating Articulated Robots with FSM Controllers in MuJoCocited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026RGB: RL Guided Whole-Body MPPI for Humanoid Control
  2. 2025Learning Sim-to-Real Humanoid Locomotion in 15 Minutes
  3. 2025SEEC: Stable End-Effector Control with Model-Enhanced Residual Learning for Humanoid Loco-Manipulation
  4. 2024Achieving Stable High-Speed Locomotion for Humanoid Robots with Deep Reinforcement Learning
  5. 2026Towards Bridging the Gap between Large-Scale Pretraining and Efficient Finetuning for Humanoid Control
  6. 2026BAT: Balancing Agility and Stability via Online Policy Switching for Long-Horizon Whole-Body Humanoid Control
  7. 2025Robot Trains Robot: Automatic Real-World Policy Adaptation and Learning for Humanoids
  8. 2026HuMBLE: Human Motion-Driven Behavior Learning for Embodied Locomotion ↗