Predictive Safety Curricula for Robust Legged Locomotion
Not on the map. Why?
Abstract (arXiv)
Rare but consequential failures can persist in learned locomotion policies for legged robots even when average task performance is high, in part because standard curricula primarily adapt task difficulty rather than the distribution of safety-critical experience. We introduce Predictive Safety Curricula (PSC), a framework for allocating locomotion training experience using learned predictions of future safety cost. PSC trains a distributional safety critic from policy rollouts and uses its predictions to prioritize both terrain contexts and previously encountered randomized events. The resulting curriculum modifies the training distribution while leaving the task reward and policy-optimization loss unchanged. We evaluate PSC in controlled rough-terrain locomotion and in production locomotion systems. PSC improves reliability relative to standard terrain progression, advantage-based replay, and learning-progress curricula, with the largest gains on difficult terrain and under degraded observations. The same allocation principle transfers to two production locomotion stacks. On ANYmal-D hardware, PSC reduces shank-collision incidence by 63% relative to the learning-progress curriculum across three matched training seeds, with a reduction in every seed. On a production stair-climbing platform, PSC eliminates observed shank collisions in the evaluated hardware trials. These results show that learned predictions of future safety cost can provide an effective signal for allocating training experience toward rare failure modes and improving locomotion reliability.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 31 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
25 of 31 references.
References · 25
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2017Constrained Policy Optimizationcited by 983
- 2017A Distributional Perspective on Reinforcement Learningcited by 765
- 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 604
- 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 512
- 2017Distributional Reinforcement Learning with Quantile Regressioncited by 474
- 2022Learning robust perceptive locomotion for quadrupedal robots in the wildcited by 382
- 2020Curriculum Learning for Reinforcement Learning Domains: A Framework and Surveycited by 373
- 2018Implicit Quantile Networks for Distributional Reinforcement Learningcited by 369
- 2020Prioritized Level Replaycited by 198
- 2020Recovery RL: Safe Reinforcement Learning with Learned Recovery Zonescited by 175
- 2022Evolving Curricula with Regret-Based Environment Designcited by 173
13 more
- 2019Active Domain Randomizationcited by 170
- 2020Automatic Curriculum Learning For Deep RL: A Short Surveycited by 150
- 2019Teacher algorithms for curriculum learning of Deep RL in continuously parameterized environmentscited by 119
- 2020Safe Reinforcement Learning via Curriculum Inductioncited by 74
- 2024Agile But Safe: Learning Collision-Free High-Speed Legged Locomotioncited by 73
- 2025RSL-RL: A Learning Library for Robotics Researchcited by 49
- 2022Efficient Risk-Averse Reinforcement Learningcited by 43
- 2023Robust Quadrupedal Locomotion via Risk-Averse Policy Learningcited by 19
- 2023Learning Risk-Aware Quadrupedal Locomotion using Distributional Reinforcement Learningcited by 14
- 2024Adversarial Environment Design via Regret-Guided Diffusion Modelscited by 10
- 2025HACL: History-Aware Curriculum Learning for Fast Locomotioncited by 3
- 2026Scaling Rough Terrain Locomotion with Automatic Curriculum Reinforcement Learningcited by 3
- 2026Trajectory-Level Automatic Curriculum Learning for Legged Locomotion on Unstructured Terraincited by 1
Built on by
Not cited yet.