Learning Low-Frequency Motion Control for Robust and Dynamic Robot Locomotion
Not on the map. Why?
Abstract (arXiv)
Robotic locomotion is often approached with the goal of maximizing robustness and reactivity by increasing motion control frequency. We challenge this intuitive notion by demonstrating robust and dynamic locomotion with a learned motion controller executing at as low as 8 Hz on a real ANYmal C quadruped. The robot is able to robustly and repeatably achieve a high heading velocity of 1.5 m/s, traverse uneven terrain, and resist unexpected external perturbations. We further present a comparative analysis of deep reinforcement learning (RL) based motion control policies trained and executed at frequencies ranging from 5 Hz to 200 Hz. We show that low-frequency policies are less sensitive to actuation latencies and variations in system dynamics. This is to the extent that a successful sim-to-real transfer can be performed even without any dynamics randomization or actuation modeling. We support this claim through a set of rigorous empirical evaluations. Moreover, to assist reproducibility, we provide the training and deployment code along with an extended analysis at https://articulated.robots.ox.ac.uk/lfmc/.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 19 of its 42 references that are in the map. First posted on arXiv 29 Sep 2022.
Builds on
19 of 42 references.
References · 19
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2019Solving Rubik's Cube with a Robot Handcited by 734
- 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 604
- 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 512
- 2019Learning agile and dynamic motor skills for legged robotscited by 504
- 2022Learning robust perceptive locomotion for quadrupedal robots in the wildcited by 382
- 2021Blind Bipedal Stair Traversal via Sim-to-Real Reinforcement Learningcited by 92
- 2022Concurrent Training of a Control Policy and a State Estimator for Dynamic and Robust Legged Locomotioncited by 88
- 2020Multi-expert learning of adaptive legged locomotioncited by 67
- 2020Dynamics Randomization Revisited:A Case Study for Quadrupedal Locomotioncited by 59
- 2020RLOC: Terrain-Aware Legged Locomotion using Reinforcement Learning and Optimal Controlcited by 59
- 2021Fast and Efficient Locomotion via Learned Gait Transitionscited by 54
7 more
- 2016Learning Locomotion Skills Using DeepRL: Does the Choice of Action Space Matter?cited by 48
- 2018Feedback Control For Cassie With Deep Reinforcement Learningcited by 45
- 2015Learning Deep Control Policies for Autonomous Aerial Vehicles with MPC-Guided Policy Searchcited by 42
- 2020Guided Constrained Policy Optimization for Dynamic Quadrupedal Robot Locomotioncited by 25
- 2019Feedback MPC for Torque-Controlled Legged Robotscited by 21
- 2020Learning Task Space Actions for Bipedal Locomotioncited by 21
- 2021Hybrid leg compliance enables robots to operate with sensorimotor delays and low control update frequenciescited by 3
Built on by
Citing papers per year: 2023: 2; 2024: 3; 2025: 4; 2026: 3.
12 papers.
- 2023Prompt a Robot to Walk with Large Language Modelscited by 45
- 2026Tune to Learn: How Controller Gains Shape Robot Policy Learningcited by 8
- 2024Constrained Skill Discovery: Quadruped Locomotion with Unsupervised Reinforcement Learningcited by 6
- 2024Offline Adaptation of Quadruped Locomotion using Diffusion Modelscited by 3
- 2023Efficient Reinforcement Learning for Jumping Monopodscited by 1
- 2025TARC: Time-Adaptive Robotic Controlcited by 1
- 2024BricksRL: A Platform for Democratizing Robotics and Reinforcement Learning Research and Education with LEGOcited by 0
- 2025Acrobotics: A Generalist Approach to Quadrupedal Robots' Parkourcited by 0
- 2025GeCCo -- a Generalist Contact-Conditioned Policy for Loco-Manipulation Skills on Legged Robotscited by 0
- 2025PGTT: Phase-Guided Terrain Traversal for Perceptive Legged Locomotioncited by 0
- 2026Learning Perceptive Platform Adaptive Locomotion Controllers for Quadrupedal Robotscited by 0
- 2026Think Fast, Plan Selectively: Adaptive Deliberation for Efficient Data-Driven MPCcited by 0
- 2026Think Fast, Plan Selectively: Adaptive Deliberation for Efficient Data-Driven MPC26 Sep 2026
- 2026Learning Perceptive Platform Adaptive Locomotion Controllers for Quadrupedal Robots23 Jun 2026
- 2026Tune to Learn: How Controller Gains Shape Robot Policy Learning2 Apr 2026
- 2025TARC: Time-Adaptive Robotic Control27 Oct 2025
- 2025PGTT: Phase-Guided Terrain Traversal for Perceptive Legged Locomotion21 Oct 2025
- 2025GeCCo -- a Generalist Contact-Conditioned Policy for Loco-Manipulation Skills on Legged Robots22 Sep 2025
- 2025Acrobotics: A Generalist Approach to Quadrupedal Robots' Parkour2 Sep 2025
- 2024Offline Adaptation of Quadruped Locomotion using Diffusion Models13 Nov 2024
- 2024Constrained Skill Discovery: Quadruped Locomotion with Unsupervised Reinforcement Learning10 Oct 2024
- 2024BricksRL: A Platform for Democratizing Robotics and Reinforcement Learning Research and Education with LEGO25 Jun 2024
- 2023Prompt a Robot to Walk with Large Language Models18 Sep 2023
- 2023Efficient Reinforcement Learning for Jumping Monopods13 Sep 2023