Learning Agile Robotic Locomotion Skills by Imitating Animals
Not on the map. Why?
Cited by 41 in Offline RL and imitation learning from data, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Reproducing the diverse and agile locomotion skills of animals has been a longstanding challenge in robotics. While manually-designed controllers have been able to emulate many complex behaviors, building such controllers involves a time-consuming and difficult development process, often requiring substantial expertise of the nuances of each skill. Reinforcement learning provides an appealing alternative for automating the manual effort involved in the development of controllers. However, designing learning objectives that elicit the desired behaviors from an agent can also require a great deal of skill-specific expertise. In this work, we present an imitation learning system that enables legged robots to learn agile locomotion skills by imitating real-world animals. We show that by leveraging reference motion data, a single learning-based approach is able to automatically synthesize controllers for a diverse repertoire behaviors for legged robots. By incorporating sample efficient domain adaptation techniques into the training process, our system is able to learn adaptive policies in simulation that can then be quickly adapted for real-world deployment. To demonstrate the effectiveness of our system, we train an 18-DoF quadruped robot to perform a variety of agile behaviors ranging from different locomotion gaits to dynamic hops and turns.
Key facts. Cited by 229 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 45; 2022: 40; 2023: 46; 2024: 42; 2025: 35; 2026: 20.
229 papers.
Sort:
By area:
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 882
- 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 430
- 2021PEBBLE: Feedback-Efficient Interactive Reinforcement Learning via Relabeling Experience and Unsupervised Pre-trainingcited by 298
- 2021DexMV: Imitation Learning for Dexterous Manipulation from Human Videoscited by 194
- 2024Open-TeleVision: Teleoperation with Immersive Active Visual Feedbackcited by 137
- 2022Legged Locomotion in Challenging Terrains using Egocentric Visioncited by 131
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 128
- 2024Expressive Whole-Body Control for Humanoid Robotscited by 117
- 2023Robot Parkour Learningcited by 115
- 20243D Diffusion Policy: Generalizable Visuomotor Policy Learning via Simple 3D Representationscited by 115
- 2023Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learningcited by 111
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 104
38 more
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 99
- 2022Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotioncited by 98
- 2021Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robotscited by 95
- 2021Reset-Free Reinforcement Learning via Multi-Task Learning: Learning Dexterous Manipulation Behaviors without Human Interventioncited by 90
- 2021From Motor Control to Team Play in Simulated Humanoid Footballcited by 87
- 2022Robotic Telekinesis: Learning a Robotic Hand Imitator by Watching Humans on Youtubecited by 79
- 2023Preference Transformer: Modeling Human Preferences using Transformers for RLcited by 77
- 2022A Walk in the Park: Learning to Walk in 20 Minutes With Model-Free Reinforcement Learningcited by 76
- 2024ExBody2: Advanced Expressive Humanoid Whole-Body Controlcited by 75
- 2023Teach a Robot to FISH: Versatile Imitation from One Minute of Demonstrationscited by 74
- 2023PhysHOI: Physics-Based Imitation of Dynamic Human-Object Interactioncited by 72
- 2021Learning Vision-Guided Quadrupedal Locomotion End-to-End with Cross-Modal Transformerscited by 71
- 2021Minimizing Energy Consumption Leads to the Emergence of Gaits in Legged Robotscited by 67
- 2024Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Controlcited by 63
- 2022Concurrent Training of a Control Policy and a State Estimator for Dynamic and Robust Legged Locomotioncited by 61
- 2024Visual Whole-Body Control for Legged Loco-Manipulationcited by 58
- 2021Robot Learning from Randomized Simulations: A Reviewcited by 56
- 2021Offline Meta-Reinforcement Learning with Online Self-Supervisioncited by 52
- 2021Fast and Efficient Locomotion via Learned Gait Transitionscited by 50
- 2023Zero-Shot Robot Manipulation from Passive Human Videoscited by 49
- 2021Towards More Generalizable One-shot Visual Imitation Learningcited by 48
- 2025Robotic World Model: A Neural Network Simulator for Robust Policy Optimization in Roboticscited by 47
- 2025AMO: Adaptive Motion Optimization for Hyper-Dexterous Humanoid Whole-Body Controlcited by 47
- 2021AdaRL: What, Where, and How to Adapt in Transfer Reinforcement Learningcited by 46
- 2021Coupling Vision and Proprioception for Navigation of Legged Robotscited by 46
- 2021Auto-Tuned Sim-to-Real Transfercited by 45
- 2023Prompt a Robot to Walk with Large Language Modelscited by 44
- 2022LyaNet: A Lyapunov Framework for Training Neural ODEscited by 43
- 2026RL Token: Bootstrapping Online RL with Vision-Language-Action Modelscited by 43
- 2022NeRF2Real: Sim2real Transfer of Vision-guided Bipedal Motion Skills using Neural Radiance Fieldscited by 41
- 2023Neural Volumetric Memory for Visual Locomotion Controlcited by 40
- 2024Towards Generalist Robot Learning from Internet Video: A Surveycited by 40
- 2022Adapting Rapid Motor Adaptation for Bipedal Robotscited by 39
- 2022Advanced Skills by Learning Locomotion and Local Navigation End-to-Endcited by 39
- 2025KungfuBot: Physics-Based Humanoid Whole-Body Control for Learning Highly-Dynamic Skillscited by 39
- 2022GenLoco: Generalized Locomotion Controllers for Quadrupedal Robotscited by 36
- 2024Deep Generative Models in Robotics: A Survey on Learning from Multimodal Demonstrationscited by 35
- 2024AffordDP: Generalizable Diffusion Policy with Transferable Affordancecited by 35
50 most cited of 229 All 229 (JSON)
- 2026Accelerating Visual Policy Learning with Sampling-Based Model Predictive Control17 Sep 2026
- 2026OmniMimic: Dynamics-completed Motion Augmentation for Multi-style Omnidirectional Quadruped Locomotion17 Sep 2026
- 2026RecMorph: Topology-Guided Spatial Recurrence for Generalized Morphology Control16 Sep 2026
- 2026SafeExplorer: An Unbiased Policy Gradient for Reinforcement Learning with Recovery Interventions9 Jul 2026
- 2026Learning Gait-Aware Quadruped Locomotion with Temporal Logic Specifications1 Jul 2026
- 2026Direct Dynamic Retargeting for Humanoid Imitation Learning from Videos22 May 2026
- 2026Dreaming Smoothly and Sample Efficiently with Gradient Penalized Latent Dynamics21 May 2026
- 2026ARC-RL: A Reinforcement Learning Playground Inspired by ARC Raiders19 May 2026
- 2026Constraint-Aware Diffusion Priors for High-Fidelity and Versatile Quadruped Locomotion9 May 2026
- 2026LineRides: Line-Guided Reinforcement Learning for Bicycle Robot Stunts6 May 2026
- 2026RL Token: Bootstrapping Online RL with Vision-Language-Action Models24 Apr 2026
- 2026LatentMimic: Terrain-Adaptive Locomotion via Latent Space Imitation7 Apr 2026
38 more
- 2026Referring-Aware Visuomotor Policy Learning for Closed-Loop Manipulation7 Apr 2026
- 2026Addressing Ambiguity in Imitation Learning through Product of Experts based Negative Feedback27 Mar 2026
- 2026Sim-to-Real of Humanoid Locomotion Policies via Joint Torque Space Perturbation Injection23 Mar 2026
- 2026Learning Quadruped Walking from Seconds of Demonstration7 Mar 2026
- 2026Cooperative-Competitive Team Play of Real-World Craft Robots24 Feb 2026
- 2026Continual Uncertainty Learning for Robust Control of Nonlinear Systems with Multiple Heterogeneous Uncertainties19 Feb 2026
- 2026Learning Part-Aware Dense 3D Feature Field for Generalizable Articulated Object Manipulation15 Feb 2026
- 2026Task-Centric Policy Optimization from Misaligned Motion Priors27 Jan 2026
- 2025Olaf: Bringing an Animated Character to Life in the Physical World18 Dec 2025
- 2025Sample from What You See: Visuomotor Policy Learning via Diffusion Bridge with Observation-Embedded Stochastic Differential Equation8 Dec 2025
- 2025Structured Imitation Learning of Interactive Policies through Inverse Games17 Nov 2025
- 2025The Reality Gap in Robotics: Challenges, Solutions, and Best Practices23 Oct 2025
- 2025Data-driven simulator of multi-animal behavior with unknown dynamics via offline and online reinforcement learning12 Oct 2025
- 2025PolySim: Bridging the Sim-to-Real Gap for Humanoid Control via Multi-Simulator Dynamics Randomization2 Oct 2025
- 2025Unlocking the Potential of Soft Actor-Critic for Imitation Learning29 Sep 2025
- 2025Musculoskeletal simulation of limb movement biomechanics in Drosophila melanogaster8 Sep 2025
- 2025Offline Imitation Learning upon Arbitrary Demonstrations by Pre-Training Dynamics Representations20 Aug 2025
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusion11 Aug 2025
- 2025Safety-Aware Imitation Learning via MPC-Guided Disturbance Injection5 Aug 2025
- 2025Spatial-Temporal Aware Visuomotor Diffusion Policy Learning9 Jul 2025
- 2025Hierarchical Reinforcement Learning and Value Optimization for Challenging Quadruped Locomotion24 Jun 2025
- 2025Scaffolding Dexterous Manipulation with Vision-Language Models24 Jun 2025
- 2025Learning to Dock: A Simulation-based Study on Closing the Sim2Real Gap in Autonomous Underwater Docking21 Jun 2025
- 2025CDP: Towards Robust Autoregressive Visuomotor Policy Learning via Causal Diffusion17 Jun 2025
- 2025KungfuBot: Physics-Based Humanoid Whole-Body Control for Learning Highly-Dynamic Skills15 Jun 2025
- 2025Similarity as Reward Alignment: Robust and Versatile Preference-based Reinforcement Learning14 Jun 2025
- 2025Scoop-and-Toss: Dynamic Object Collection for Quadrupedal Systems11 Jun 2025
- 2025CARoL: Context-aware Adaptation for Robot Learning8 Jun 2025
- 2025AMO: Adaptive Motion Optimization for Hyper-Dexterous Humanoid Whole-Body Control6 May 2025
- 2025Model-based controller assisted domain randomization for transient vibration suppression of nonlinear powertrain system with parametric uncertainty28 Apr 2025
- 2025Reward Generation via Large Vision-Language Model in Offline Reinforcement Learning3 Apr 2025
- 2025Transferable Latent-to-Latent Locomotion Policy for Efficient and Versatile Motion Control of Diverse Legged Robots22 Mar 2025
- 2025ES-Parkour: Advanced Robot Parkour with Bio-inspired Event Camera and Spiking Neural Network13 Mar 2025
- 2025A2Perf: Real-World Autonomous Agents Benchmark4 Mar 2025
- 2025Subtask-Aware Visual Reward Learning from Segmented Demonstrations28 Feb 2025
- 2025RIZE: Adaptive Regularization for Imitation Learning27 Feb 2025
- 2025SATA: Safe and Adaptive Torque-Based Locomotion Policies Inspired by Animal Learning18 Feb 2025
- 2025PrivilegedDreamer: Explicit Imagination of Privileged Information for Rapid Adaptation of Learned Policies17 Feb 2025
50 newest of 229 All 229 (JSON)
- 2021DexMV: Imitation Learning for Dexterous Manipulation from Human Videoscited by 194
- 2024Open-TeleVision: Teleoperation with Immersive Active Visual Feedbackcited by 137
- 2023Teach a Robot to FISH: Versatile Imitation from One Minute of Demonstrationscited by 74
- 2021Offline Meta-Reinforcement Learning with Online Self-Supervisioncited by 52
- 2021Towards More Generalizable One-shot Visual Imitation Learningcited by 48
- 2024Deep Generative Models in Robotics: A Survey on Learning from Multimodal Demonstrationscited by 35
- 2023Train Once, Get a Family: State-Adaptive Balances for Offline-to-Online Reinforcement Learningcited by 26
- 2025SKIL: Semantic Keypoint Imitation Learning for Generalizable Data-efficient Manipulationcited by 21
- 2021Imitation Learning from MPC for Quadrupedal Multi-Gait Controlcited by 16
- 2021A GAN-Like Approach for Physics-Based Imitation Learning and Interactive Character Controlcited by 12
- 2021Cross Domain Robot Imitation with Invariant Representationcited by 7
- 2020On the Guaranteed Almost Equivalence between Imitation Learning from Observation and Demonstrationcited by 6
12 most cited of 33 All 33 (JSON)
- 2026Direct Dynamic Retargeting for Humanoid Imitation Learning from Videos22 May 2026
- 2026Addressing Ambiguity in Imitation Learning through Product of Experts based Negative Feedback27 Mar 2026
- 2026Learning Quadruped Walking from Seconds of Demonstration7 Mar 2026
- 2025Structured Imitation Learning of Interactive Policies through Inverse Games17 Nov 2025
- 2025Unlocking the Potential of Soft Actor-Critic for Imitation Learning29 Sep 2025
- 2025Offline Imitation Learning upon Arbitrary Demonstrations by Pre-Training Dynamics Representations20 Aug 2025
- 2025Safety-Aware Imitation Learning via MPC-Guided Disturbance Injection5 Aug 2025
- 2025A2Perf: Real-World Autonomous Agents Benchmark4 Mar 2025
- 2025RIZE: Adaptive Regularization for Imitation Learning27 Feb 2025
- 2025SKIL: Semantic Keypoint Imitation Learning for Generalizable Data-efficient Manipulation24 Jan 2025
- 2024Inverse Delayed Reinforcement Learning4 Dec 2024
- 2024Language-Model-Assisted Bi-Level Programming for Reward Learning from Internet Videos11 Oct 2024
12 newest of 33 All 33 (JSON)
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 128
- 20243D Diffusion Policy: Generalizable Visuomotor Policy Learning via Simple 3D Representationscited by 115
- 2024AffordDP: Generalizable Diffusion Policy with Transferable Affordancecited by 35
- 2024Energy-Guided Diffusion Sampling for Offline-to-Online Reinforcement Learningcited by 17
- 2025FDPP: Fine-tune Diffusion Policy with Human Preferencecited by 14
- 2025CDP: Towards Robust Autoregressive Visuomotor Policy Learning via Causal Diffusioncited by 8
- 2025Spatial-Temporal Aware Visuomotor Diffusion Policy Learningcited by 8
- 2024Preference Aligned Diffusion Planner for Quadrupedal Locomotion Controlcited by 7
- 2025Sample from What You See: Visuomotor Policy Learning via Diffusion Bridge with Observation-Embedded Stochastic Differential Equationcited by 2
- 2026Constraint-Aware Diffusion Priors for High-Fidelity and Versatile Quadruped Locomotioncited by 1
- 2026Constraint-Aware Diffusion Priors for High-Fidelity and Versatile Quadruped Locomotion9 May 2026
- 2025Sample from What You See: Visuomotor Policy Learning via Diffusion Bridge with Observation-Embedded Stochastic Differential Equation8 Dec 2025
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusion11 Aug 2025
- 2025Spatial-Temporal Aware Visuomotor Diffusion Policy Learning9 Jul 2025
- 2025CDP: Towards Robust Autoregressive Visuomotor Policy Learning via Causal Diffusion17 Jun 2025
- 2025FDPP: Fine-tune Diffusion Policy with Human Preference14 Jan 2025
- 2024AffordDP: Generalizable Diffusion Policy with Transferable Affordance4 Dec 2024
- 2024Preference Aligned Diffusion Planner for Quadrupedal Locomotion Control17 Oct 2024
- 2024Energy-Guided Diffusion Sampling for Offline-to-Online Reinforcement Learning17 Jul 2024
- 20243D Diffusion Policy: Generalizable Visuomotor Policy Learning via Simple 3D Representations6 Mar 2024
- 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 430
- 2022A Walk in the Park: Learning to Walk in 20 Minutes With Model-Free Reinforcement Learningcited by 76
- 2025Robotic World Model: A Neural Network Simulator for Robust Policy Optimization in Roboticscited by 47
- 2024World Model-based Perception for Visual Legged Locomotioncited by 17
- 2024WARPD: World model Assisted Reactive Policy Diffusioncited by 3
- 2024An Efficient Model-Based Approach on Learning Agile Motor Skills without Reinforcementcited by 2
- 2026Dreaming Smoothly and Sample Efficiently with Gradient Penalized Latent Dynamicscited by 0
- 2026Dreaming Smoothly and Sample Efficiently with Gradient Penalized Latent Dynamics21 May 2026
- 2025Robotic World Model: A Neural Network Simulator for Robust Policy Optimization in Robotics17 Jan 2025
- 2024WARPD: World model Assisted Reactive Policy Diffusion17 Oct 2024
- 2024World Model-based Perception for Visual Legged Locomotion25 Sep 2024
- 2024An Efficient Model-Based Approach on Learning Agile Motor Skills without Reinforcement4 Mar 2024
- 2022A Walk in the Park: Learning to Walk in 20 Minutes With Model-Free Reinforcement Learning16 Aug 2022
- 2021RMA: Rapid Motor Adaptation for Legged Robots8 Jul 2021
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 882
- 2022Legged Locomotion in Challenging Terrains using Egocentric Visioncited by 131
- 2024Expressive Whole-Body Control for Humanoid Robotscited by 117
- 2023Robot Parkour Learningcited by 115
- 2023Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learningcited by 111
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 104
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 99
- 2022Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotioncited by 98
- 2021Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robotscited by 95
- 2021Reset-Free Reinforcement Learning via Multi-Task Learning: Learning Dexterous Manipulation Behaviors without Human Interventioncited by 90
- 2021From Motor Control to Team Play in Simulated Humanoid Footballcited by 87
- 2022Robotic Telekinesis: Learning a Robotic Hand Imitator by Watching Humans on Youtubecited by 79
12 most cited of 173 All 173 (JSON)
- 2026Accelerating Visual Policy Learning with Sampling-Based Model Predictive Control17 Sep 2026
- 2026OmniMimic: Dynamics-completed Motion Augmentation for Multi-style Omnidirectional Quadruped Locomotion17 Sep 2026
- 2026RecMorph: Topology-Guided Spatial Recurrence for Generalized Morphology Control16 Sep 2026
- 2026SafeExplorer: An Unbiased Policy Gradient for Reinforcement Learning with Recovery Interventions9 Jul 2026
- 2026Learning Gait-Aware Quadruped Locomotion with Temporal Logic Specifications1 Jul 2026
- 2026ARC-RL: A Reinforcement Learning Playground Inspired by ARC Raiders19 May 2026
- 2026LineRides: Line-Guided Reinforcement Learning for Bicycle Robot Stunts6 May 2026
- 2026LatentMimic: Terrain-Adaptive Locomotion via Latent Space Imitation7 Apr 2026
- 2026Referring-Aware Visuomotor Policy Learning for Closed-Loop Manipulation7 Apr 2026
- 2026Sim-to-Real of Humanoid Locomotion Policies via Joint Torque Space Perturbation Injection23 Mar 2026
- 2026Cooperative-Competitive Team Play of Real-World Craft Robots24 Feb 2026
- 2026Continual Uncertainty Learning for Robust Control of Nonlinear Systems with Multiple Heterogeneous Uncertainties19 Feb 2026
12 newest of 173 All 173 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026Learning Highly Dynamic Skills Transition for Quadruped Jumping Through Constrained Space ↗
- 2023Manipulator as a Tail: Promoting Dynamic Stability for Legged Locomotion
- 2023Learning Terrain-Adaptive Locomotion with Agile Behaviors by Imitating Animals
- 2025Learning Diverse Natural Behaviors for Enhancing the Agility of Quadrupedal Robots ↗
- 2026Teaching a Robot Dog New Tricks: Diverse Quadruped Skills via Combined Reinforcement and Imitation Learning with Adversarial Task Selection
- 2024Experience-Learning Inspired Two-Step Reward Method for Efficient Legged Locomotion Learning Towards Natural and Robust Gaits
- 2025Learning a Unified Policy for Position and Force Control in Legged Loco-Manipulation
- 2026LocoVLM: Grounding Vision and Language for Adapting Versatile Legged Locomotion Policies