Rapid Locomotion via Reinforcement Learning
Not on the map. Why?
Cited by 78 in Deep reinforcement learning methods, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Agile maneuvers such as sprinting and high-speed turning in the wild are challenging for legged robots. We present an end-to-end learned controller that achieves record agility for the MIT Mini Cheetah, sustaining speeds up to 3.9 m/s. This system runs and turns fast on natural terrains like grass, ice, and gravel and responds robustly to disturbances. Our controller is a neural network trained in simulation via reinforcement learning and transferred to the real world. The two key components are (i) an adaptive curriculum on velocity commands and (ii) an online system identification strategy for sim-to-real transfer leveraged from prior work. Videos of the robot's behaviors are available at: https://agility.csail.mit.edu/
Key facts. Cited by 168 papers in the map (data through 14 Oct 2026). Builds on 25 of its 53 references that are in the map. First posted on arXiv 5 May 2022.
Builds on
25 of 53 references.
References · 25
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
- 2019Solving Rubik's Cube with a Robot Handcited by 734
- 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 604
- 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 512
- 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 508
- 2019Learning agile and dynamic motor skills for legged robotscited by 504
- 2019Learning by Cheatingcited by 383
- 2022Learning robust perceptive locomotion for quadrupedal robots in the wildcited by 382
- 2018Sim-to-Real: Learning Agile Locomotion For Quadruped Robotscited by 319
- 2017Teacher-Student Curriculum Learningcited by 210
13 more
- 2021A System for General In-Hand Object Re-Orientationcited by 165
- 2018Multi-task Deep Reinforcement Learning with PopArtcited by 141
- 2021Blind Bipedal Stair Traversal via Sim-to-Real Reinforcement Learningcited by 92
- 2022Concurrent Training of a Control Policy and a State Estimator for Dynamic and Robust Legged Locomotioncited by 88
- 2021Minimizing Energy Consumption Leads to the Emergence of Gaits in Legged Robotscited by 76
- 2020Dynamics Randomization Revisited:A Case Study for Quadrupedal Locomotioncited by 59
- 2019Towards Practical Multi-Object Manipulation using Relational Reinforcement Learningcited by 55
- 2019Highly Dynamic Quadruped Locomotion via Whole-Body Impulse Control and Model Predictive Controlcited by 54
- 2020ALLSTEPS: Curriculum-driven Learning of Stepping Stone Skillscited by 54
- 2021Learning to Jump from Pixelscited by 45
- 2021The MIT Humanoid Robot: Design, Motion Planning, and Control For Acrobatic Behaviorscited by 32
- 2016Structured contact force optimization for kino-dynamic motion generationcited by 6
- 2019STANCE: Locomotion Adaptation over Soft Terraincited by 4
Built on by
Citing papers per year: 2022: 9; 2023: 28; 2024: 54; 2025: 50; 2026: 27.
168 papers.
Sort:
By area:
- 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 571
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
- 2023Extreme Parkour with Legged Robotscited by 164
- 2023Robot Parkour Learningcited by 149
- 2024Open-TeleVision: Teleoperation with Immersive Active Visual Feedbackcited by 145
- 2024Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulationcited by 144
- 2024Expressive Whole-Body Control for Humanoid Robotscited by 139
- 2022Walk These Ways: Tuning Robot Control for Generalization with Multiplicity of Behaviorcited by 138
- 2023Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learningcited by 133
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 130
- 2022Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotioncited by 121
- 2024Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Controlcited by 99
38 more
- 2024From Imitation to Refinement -- Residual RL for Precise Assemblycited by 90
- 2024DrEureka: Language Model Guided Sim-To-Real Transfercited by 83
- 2024Agile But Safe: Learning Collision-Free High-Speed Legged Locomotioncited by 73
- 2025Residual Off-Policy RL for Finetuning Behavior Cloning Policiescited by 55
- 2024Humanoid-Gym: Reinforcement Learning for Humanoid Robot with Zero-Shot Sim2Real Transfercited by 53
- 2024Mobile-TeleVision: Predictive Motion Priors for Humanoid Whole-Body Controlcited by 51
- 2025AMO: Adaptive Motion Optimization for Hyper-Dexterous Humanoid Whole-Body Controlcited by 51
- 2024DiffuseLoco: Real-Time Legged Locomotion Control with Diffusion from Offline Datasetscited by 49
- 2022GenLoco: Generalized Locomotion Controllers for Quadrupedal Robotscited by 48
- 2023Not Only Rewards But Also Constraints: Applications on Legged Robot Locomotioncited by 47
- 2025BeamDojo: Learning Agile Humanoid Locomotion on Sparse Footholdscited by 46
- 2023Prompt a Robot to Walk with Large Language Modelscited by 45
- 2023Neural Volumetric Memory for Visual Locomotion Controlcited by 44
- 2024One Policy to Run Them All: an End-to-end Learning Approach to Multi-Embodiment Locomotioncited by 43
- 2023Barkour: Benchmarking Animal-level Agility with Quadruped Robotscited by 41
- 2023DribbleBot: Dynamic Legged Manipulation in the Wildcited by 40
- 2023Hybrid Internal Model: Learning Agile Legged Locomotion with Simulated Robot Responsecited by 39
- 2023Robust and Versatile Bipedal Jumping Control through Reinforcement Learningcited by 36
- 2025Crossing the Human-Robot Embodiment Gap with Sim-to-Real RL using One Human Demonstrationcited by 34
- 2023Learning and Adapting Agile Locomotion Skills by Transferring Experiencecited by 33
- 2024Learning Quadruped Locomotion Using Differentiable Simulationcited by 32
- 2024Rank2Reward: Learning Shaped Reward Functions from Passive Videocited by 32
- 2024Demonstrating Agile Flight from Pixels without State Estimationcited by 31
- 2022Fleet-DAgger: Interactive Robot Fleet Learning with Scalable Human Supervisioncited by 30
- 2023RL + Model-based Control: Using On-demand Optimal Control to Learn Versatile Legged Locomotioncited by 26
- 2024CTS: Concurrent Teacher-Student Reinforcement Learning for Legged Locomotioncited by 25
- 2022Redeeming Intrinsic Rewards via Constrained Optimizationcited by 24
- 2023Grow Your Limits: Continuous Improvement with Real-World RL for Robotic Locomotioncited by 24
- 2022Creating a Dynamic Quadrupedal Robotic Goalkeeper with Reinforcement Learningcited by 23
- 2024CaT: Constraints as Terminations for Legged Locomotion Reinforcement Learningcited by 23
- 2025MoE-Loco: Mixture of Experts for Multitask Locomotioncited by 23
- 2024Learning Force Control for Legged Manipulationcited by 21
- 2023ManyQuadrupeds: Learning a Single Locomotion Policy for Diverse Quadruped Robotscited by 19
- 2025Learning coordinated badminton skills for legged manipulatorscited by 19
- 2023Learning Bipedal Walking for Humanoids with Current Feedbackcited by 18
- 2023DEFT: Dexterous Fine-Tuning for Real-World Hand Policiescited by 17
- 2024Continuous Control with Coarse-to-fine Reinforcement Learningcited by 17
- 2025Rapidly Adapting Policies to the Real World via Simulation-Guided Fine-Tuningcited by 17
50 most cited of 168 All 168 (JSON)
- 2026CopyQuad: Quadrupedal Skill Transfer from a Single Side-View Video Without a Depth Model12 Oct 2026
- 2026Reusing Past Samples in Proximal Policy Optimization: When and How Does It Help?1 Oct 2026
- 2026Generalizable Robotic Insertion with World Models23 Sep 2026
- 2026OmniMimic: Dynamics-completed Motion Augmentation for Multi-style Omnidirectional Quadruped Locomotion17 Sep 2026
- 2026Active Curriculum Refinement for Reinforcement Learning26 Aug 2026
- 2026Cognitively-Grounded On-Device Runtime Learning for Ground Robots in Unknown Physical Environments25 Aug 2026
- 2026Trajectory-Level Automatic Curriculum Learning for Legged Locomotion on Unstructured Terrain17 Aug 2026
- 2026Learning Fault-Tolerant Locomotion with Adaptive Gait Timing7 Aug 2026
- 2026WARL: Wrench-Augmented Reinforcement Learning for Task-Agnostic Learning in Legged Robots27 Jul 2026
- 2026Agile perceptive multi-skill locomotion for quadrupedal robots in the wild15 Jul 2026
- 2026Reinforcement Learning-Based Control for an Inline Skating Humanoid Robot30 Jun 2026
- 2026HARBOR: A Harness Framework for Agentic Robot Reinforcement Learning7 Jun 2026
38 more
- 2026Mind Your Steps: A General Learning Framework for Accurate Humanoid Foothold Tracking6 Jun 2026
- 2026Neuromorphic Reinforcement Learning for Quadruped Locomotion Control on Uneven Terrain10 May 2026
- 2026LineRides: Line-Guided Reinforcement Learning for Bicycle Robot Stunts6 May 2026
- 2026QuietWalk: Physics-Informed Reinforcement Learning for Ground Reaction Force-Aware Humanoid Locomotion Under Diverse Footwear26 Apr 2026
- 2026PriPG-RL: Privileged Planner-Guided Reinforcement Learning for Partially Observable Systems with Anytime-Feasible MPC9 Apr 2026
- 2026LatentMimic: Terrain-Adaptive Locomotion via Latent Space Imitation7 Apr 2026
- 2026Neural Assistive Impulses: Synthesizing Exaggerated Motions for Physics-based Characters7 Apr 2026
- 2026Flip Stunts on Bicycle Robots using Iterative Motion Imitation30 Mar 2026
- 2026MorFiC: Fixing Value Miscalibration for Zero-Shot Quadruped Transfer15 Mar 2026
- 2026NFPO: Stabilized Policy Optimization of Normalizing Flow for Robotic Policy Learning12 Mar 2026
- 2026Cooperative-Competitive Team Play of Real-World Craft Robots24 Feb 2026
- 2026Data-Efficient Hierarchical Goal-Conditioned Reinforcement Learning via Normalizing Flows11 Feb 2026
- 2026CMR: Contractive Mapping Embeddings for Robust Humanoid Locomotion on Unstructured Terrains3 Feb 2026
- 2026Toward Reliable Sim-to-Real Predictability for MoE-based Robust Quadrupedal Locomotion31 Jan 2026
- 2026Scaling Rough Terrain Locomotion with Automatic Curriculum Reinforcement Learning24 Jan 2026
- 2025Energy-Efficient Omnidirectional Locomotion for Wheeled Quadrupeds via Predictive Energy-Aware Nominal Gait Selection23 Dec 2025
- 2025Staggered Environment Resets Improve Massively Parallel On-Policy Reinforcement Learning26 Nov 2025
- 2025SAC-MoE: Reinforcement Learning with Mixture-of-Experts for Control of Hybrid Dynamical Systems with Uncertainty15 Nov 2025
- 2025Cross-Platform Learnable Fuzzy Gain-Scheduled Proportional-Integral-Derivative Controller Tuning via Physics-Constrained Meta-Learning and Reinforcement Learning Adaptation9 Nov 2025
- 2025SoftMimic: Learning Compliant Whole-body Control from Examples20 Oct 2025
- 2025Simplicial Embeddings Improve Sample Efficiency in Actor-Critic Agents15 Oct 2025
- 2025Bridge the Gap: Enhancing Quadruped Locomotion with Vertical Ground Perturbations15 Oct 2025
- 2025Ego-Vision World Model for Humanoid Contact Planning13 Oct 2025
- 2025Learning Terrain-Specialized Policies for Adaptive Locomotion in Challenging Environments25 Sep 2025
- 2025Residual Off-Policy RL for Finetuning Behavior Cloning Policies23 Sep 2025
- 2025FILIC: Dual-Loop Force-Guided Imitation Learning with Impedance Torque Control for Contact-Rich Manipulation Tasks21 Sep 2025
- 2025Dynamic Adaptive Legged Locomotion Policy via Decoupling Reaction Force Control and Gait Control17 Sep 2025
- 2025LIPM-Guided Reinforcement Learning for Stable and Perceptive Locomotion in Bipedal Robots11 Sep 2025
- 2025Learning to Walk With Less: A Dyna-Style Approach to Quadrupedal Locomotion8 Sep 2025
- 2025Multi-Embodiment Locomotion at Scale with extreme Embodiment Randomization2 Sep 2025
- 2025Toward Deployable Multi-Robot Collaboration via a Symbolically-Guided Decision Transformer19 Aug 2025
- 2025LocoMamba: Vision-Driven Locomotion via End-to-End Deep Reinforcement Learning with Mamba16 Aug 2025
- 2025Unsupervised Skill Discovery as Exploration for Learning Agile Locomotion12 Aug 2025
- 2025End-to-End Humanoid Robot Safe and Comfortable Locomotion Policy11 Aug 2025
- 2025Coordinated Humanoid Robot Locomotion with Symmetry Equivariant Reinforcement Learning Policy2 Aug 2025
- 2025Benchmarking Massively Parallelized Multi-Task Reinforcement Learning for Robotics Tasks31 Jul 2025
- 2025Efficient Navigation Among Movable Obstacles using a Mobile Manipulator via Hierarchical Policy Learning18 Jun 2025
- 2025Learning coordinated badminton skills for legged manipulators29 May 2025
50 newest of 168 All 168 (JSON)
- 2024Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Controlcited by 99
- 2024DiffuseLoco: Real-Time Legged Locomotion Control with Diffusion from Offline Datasetscited by 49
- 2024One Policy to Run Them All: an End-to-end Learning Approach to Multi-Embodiment Locomotioncited by 43
- 2024Rank2Reward: Learning Shaped Reward Functions from Passive Videocited by 32
- 2024Demonstrating Agile Flight from Pixels without State Estimationcited by 31
- 2024CTS: Concurrent Teacher-Student Reinforcement Learning for Legged Locomotioncited by 25
- 2024CaT: Constraints as Terminations for Legged Locomotion Reinforcement Learningcited by 23
- 2025Learning coordinated badminton skills for legged manipulatorscited by 19
- 2024Continuous Control with Coarse-to-fine Reinforcement Learningcited by 17
- 2024Rethinking Robustness Assessment: Adversarial Attacks on Learning-based Quadrupedal Locomotion Controllerscited by 14
- 2024SoloParkour: Constrained Reinforcement Learning for Visual Locomotion from Privileged Experiencecited by 14
- 2025SoftMimic: Learning Compliant Whole-body Control from Examplescited by 14
12 most cited of 74 All 74 (JSON)
- 2026Reusing Past Samples in Proximal Policy Optimization: When and How Does It Help?1 Oct 2026
- 2026Active Curriculum Refinement for Reinforcement Learning26 Aug 2026
- 2026Cognitively-Grounded On-Device Runtime Learning for Ground Robots in Unknown Physical Environments25 Aug 2026
- 2026Learning Fault-Tolerant Locomotion with Adaptive Gait Timing7 Aug 2026
- 2026WARL: Wrench-Augmented Reinforcement Learning for Task-Agnostic Learning in Legged Robots27 Jul 2026
- 2026Reinforcement Learning-Based Control for an Inline Skating Humanoid Robot30 Jun 2026
- 2026Neuromorphic Reinforcement Learning for Quadruped Locomotion Control on Uneven Terrain10 May 2026
- 2026LineRides: Line-Guided Reinforcement Learning for Bicycle Robot Stunts6 May 2026
- 2026QuietWalk: Physics-Informed Reinforcement Learning for Ground Reaction Force-Aware Humanoid Locomotion Under Diverse Footwear26 Apr 2026
- 2026PriPG-RL: Privileged Planner-Guided Reinforcement Learning for Partially Observable Systems with Anytime-Feasible MPC9 Apr 2026
- 2026Flip Stunts on Bicycle Robots using Iterative Motion Imitation30 Mar 2026
- 2026MorFiC: Fixing Value Miscalibration for Zero-Shot Quadruped Transfer15 Mar 2026
12 newest of 74 All 74 (JSON)
- 2024Open-TeleVision: Teleoperation with Immersive Active Visual Feedbackcited by 145
- 2024Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulationcited by 144
- 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomycited by 16
- 2025FILIC: Dual-Loop Force-Guided Imitation Learning with Impedance Torque Control for Contact-Rich Manipulation Taskscited by 7
- 2025Toward Deployable Multi-Robot Collaboration via a Symbolically-Guided Decision Transformercited by 0
- 2025FILIC: Dual-Loop Force-Guided Imitation Learning with Impedance Torque Control for Contact-Rich Manipulation Tasks21 Sep 2025
- 2025Toward Deployable Multi-Robot Collaboration via a Symbolically-Guided Decision Transformer19 Aug 2025
- 2024Open-TeleVision: Teleoperation with Immersive Active Visual Feedback1 Jul 2024
- 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy23 Jun 2024
- 2024Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulation6 Mar 2024
- 2025Ego-Vision World Model for Humanoid Contact Planningcited by 6
- 2026Generalizable Robotic Insertion with World Modelscited by 0
- 2026Generalizable Robotic Insertion with World Models23 Sep 2026
- 2025Ego-Vision World Model for Humanoid Contact Planning13 Oct 2025
- 2025MoE-Loco: Mixture of Experts for Multitask Locomotioncited by 23
- 2025MoE-Loco: Mixture of Experts for Multitask Locomotion11 Mar 2025
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
- 2023Extreme Parkour with Legged Robotscited by 164
- 2023Robot Parkour Learningcited by 149
- 2024Expressive Whole-Body Control for Humanoid Robotscited by 139
- 2022Walk These Ways: Tuning Robot Control for Generalization with Multiplicity of Behaviorcited by 138
- 2023Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learningcited by 133
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 130
- 2022Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotioncited by 121
- 2024From Imitation to Refinement -- Residual RL for Precise Assemblycited by 90
- 2024DrEureka: Language Model Guided Sim-To-Real Transfercited by 83
- 2024Agile But Safe: Learning Collision-Free High-Speed Legged Locomotioncited by 73
- 2025Residual Off-Policy RL for Finetuning Behavior Cloning Policiescited by 55
- 2024Humanoid-Gym: Reinforcement Learning for Humanoid Robot with Zero-Shot Sim2Real Transfercited by 53
12 most cited of 80 All 80 (JSON)
- 2026CopyQuad: Quadrupedal Skill Transfer from a Single Side-View Video Without a Depth Model12 Oct 2026
- 2026OmniMimic: Dynamics-completed Motion Augmentation for Multi-style Omnidirectional Quadruped Locomotion17 Sep 2026
- 2026Trajectory-Level Automatic Curriculum Learning for Legged Locomotion on Unstructured Terrain17 Aug 2026
- 2026Agile perceptive multi-skill locomotion for quadrupedal robots in the wild15 Jul 2026
- 2026Mind Your Steps: A General Learning Framework for Accurate Humanoid Foothold Tracking6 Jun 2026
- 2026LatentMimic: Terrain-Adaptive Locomotion via Latent Space Imitation7 Apr 2026
- 2026Neural Assistive Impulses: Synthesizing Exaggerated Motions for Physics-based Characters7 Apr 2026
- 2026CMR: Contractive Mapping Embeddings for Robust Humanoid Locomotion on Unstructured Terrains3 Feb 2026
- 2025Learning Terrain-Specialized Policies for Adaptive Locomotion in Challenging Environments25 Sep 2025
- 2025Residual Off-Policy RL for Finetuning Behavior Cloning Policies23 Sep 2025
- 2025Multi-Embodiment Locomotion at Scale with extreme Embodiment Randomization2 Sep 2025
- 2025Unsupervised Skill Discovery as Exploration for Learning Agile Locomotion12 Aug 2025
12 newest of 80 All 80 (JSON)