Rapidly Adaptable Legged Robots via Evolutionary Meta-Learning
Not on the map. Why?
Abstract (arXiv)
Learning adaptable policies is crucial for robots to operate autonomously in our complex and quickly changing world. In this work, we present a new meta-learning method that allows robots to quickly adapt to changes in dynamics. In contrast to gradient-based meta-learning algorithms that rely on second-order gradient estimation, we introduce a more noise-tolerant Batch Hill-Climbing adaptation operator and combine it with meta-learning based on evolutionary strategies. Our method significantly improves adaptation to changes in dynamics in high noise settings, which are common in robotics applications. We validate our approach on a quadruped robot that learns to walk while subject to changes in dynamics. We observe that our method significantly outperforms prior gradient-based approaches, enabling the robot to adapt its policy to changes based on less than 3 minutes of real data.
Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). First posted on arXiv 2 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 11; 2023: 7; 2024: 4; 2025: 7; 2026: 1.
43 papers.
Sort:
By area:
- 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 508
- 2022Legged Locomotion in Challenging Terrains using Egocentric Visioncited by 151
- 2023Robot Parkour Learningcited by 149
- 2022Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotioncited by 121
- 2022Neural-Fly Enables Rapid Learning for Agile Flight in Strong Windscited by 85
- 2022A Walk in the Park: Learning to Walk in 20 Minutes With Model-Free Reinforcement Learningcited by 83
- 2021Minimizing Energy Consumption Leads to the Emergence of Gaits in Legged Robotscited by 76
- 2021Fast and Efficient Locomotion via Learned Gait Transitionscited by 54
- 2022Adapting Rapid Motor Adaptation for Bipedal Robotscited by 54
- 2021Coupling Vision and Proprioception for Navigation of Legged Robotscited by 51
- 2021Lifelong Robotic Reinforcement Learning by Retaining Experiencescited by 34
- 2023Learning and Adapting Agile Locomotion Skills by Transferring Experiencecited by 33
31 more
- 2021Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Surveycited by 28
- 2025Synthesis of Model Predictive Control and Reinforcement Learning: Survey and Classificationcited by 26
- 2021Bayesian Meta-Learning for Few-Shot Policy Adaptation Across Robotic Platformscited by 22
- 2025LocoFormer: Generalist Locomotion via Long-context Adaptationcited by 20
- 2022Robust Policy Learning over Multiple Uncertainty Setscited by 18
- 2023Curious Replay for Model-based Adaptationcited by 16
- 2021On sensitivity of meta-learning to support datacited by 15
- 2022Sim-to-Real Transfer for Quadrupedal Locomotion via Terrain Transformercited by 14
- 2023Meta-Learning with a Geometry-Adaptive Preconditionercited by 11
- 2022PI-ARS: Accelerating Evolution-Learned Visual-Locomotion with Predictive Information Representationscited by 10
- 2021MESA: Offline Meta-RL for Safe Adaptation and Fault Tolerancecited by 8
- 2023Continuous Versatile Jumping Using Learned Action Residualscited by 8
- 2023Adapt On-the-Go: Behavior Modulation for Single-Life Robot Deploymentcited by 8
- 2022Transfer Dynamics in Emergent Evolutionary Curriculacited by 6
- 2025Coreset-Based Task Selection for Sample-Efficient Meta-Reinforcement Learningcited by 6
- 2025Unsupervised Skill Discovery as Exploration for Learning Agile Locomotioncited by 6
- 2021Behavior Self-Organization Supports Task Inference for Continual Robot Learningcited by 4
- 2022Adaptive Prototypical Networkscited by 4
- 2024MPC of Uncertain Nonlinear Systems with Meta-Learning for Fast Adaptation of Neural Predictive Modelscited by 4
- 2023Moving Forward by Moving Backward: Embedding Action Impact over Action Semanticscited by 3
- 2025Meta-Learning Online Dynamics Model Adaptation in Off-Road Autonomous Drivingcited by 3
- 2024Meta-Reinforcement Learning with Universal Policy Adaptation: Provable Near-Optimality under All-task Optimum Comparatorcited by 2
- 2022A Survey on Deep Reinforcement Learning-based Approaches for Adaptation and Generalizationcited by 1
- 2024Impedance Matching: Enabling an RL-Based Running Jump in a Quadruped Robotcited by 1
- 2025CARoL: Context-aware Adaptation for Robot Learningcited by 1
- 2021ES-ENAS: Efficient Evolutionary Optimization for Large Hybrid Search Spacescited by 0
- 2021Meta-Reinforcement Learning for Adaptive Motor Control in Changing Robot Dynamics and Environmentscited by 0
- 2021An Embarrassingly Pragmatic Introduction to Vision-based Autonomous Robotscited by 0
- 2024Perturbing the Gradient for Alleviating Meta Overfittingcited by 0
- 2025Beyond Fixed Morphologies: Learning Graph Policies with Trust Region Compensation in Variable Action Spacescited by 0
- 2026Robust Quadruped Locomotion via Evolutionary Reinforcement Learningcited by 0
- 2026Robust Quadruped Locomotion via Evolutionary Reinforcement Learning8 Apr 2026
- 2025LocoFormer: Generalist Locomotion via Long-context Adaptation28 Sep 2025
- 2025Beyond Fixed Morphologies: Learning Graph Policies with Trust Region Compensation in Variable Action Spaces16 Aug 2025
- 2025Unsupervised Skill Discovery as Exploration for Learning Agile Locomotion12 Aug 2025
- 2025CARoL: Context-aware Adaptation for Robot Learning8 Jun 2025
- 2025Meta-Learning Online Dynamics Model Adaptation in Off-Road Autonomous Driving23 Apr 2025
- 2025Coreset-Based Task Selection for Sample-Efficient Meta-Reinforcement Learning4 Feb 2025
- 2025Synthesis of Model Predictive Control and Reinforcement Learning: Survey and Classification4 Feb 2025
- 2024Meta-Reinforcement Learning with Universal Policy Adaptation: Provable Near-Optimality under All-task Optimum Comparator13 Oct 2024
- 2024Perturbing the Gradient for Alleviating Meta Overfitting20 May 2024
- 2024Impedance Matching: Enabling an RL-Based Running Jump in a Quadruped Robot23 Apr 2024
- 2024MPC of Uncertain Nonlinear Systems with Meta-Learning for Fast Adaptation of Neural Predictive Models18 Apr 2024
31 more
- 2023Adapt On-the-Go: Behavior Modulation for Single-Life Robot Deployment2 Nov 2023
- 2023Robot Parkour Learning11 Sep 2023
- 2023Curious Replay for Model-based Adaptation28 Jun 2023
- 2023Moving Forward by Moving Backward: Embedding Action Impact over Action Semantics24 Apr 2023
- 2023Learning and Adapting Agile Locomotion Skills by Transferring Experience19 Apr 2023
- 2023Continuous Versatile Jumping Using Learned Action Residuals17 Apr 2023
- 2023Meta-Learning with a Geometry-Adaptive Preconditioner4 Apr 2023
- 2022Sim-to-Real Transfer for Quadrupedal Locomotion via Terrain Transformer15 Dec 2022
- 2022Adaptive Prototypical Networks22 Nov 2022
- 2022Legged Locomotion in Challenging Terrains using Egocentric Vision14 Nov 2022
- 2022Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotion18 Oct 2022
- 2022A Walk in the Park: Learning to Walk in 20 Minutes With Model-Free Reinforcement Learning16 Aug 2022
- 2022PI-ARS: Accelerating Evolution-Learned Visual-Locomotion with Predictive Information Representations27 Jul 2022
- 2022Adapting Rapid Motor Adaptation for Bipedal Robots30 May 2022
- 2022Neural-Fly Enables Rapid Learning for Agile Flight in Strong Winds13 May 2022
- 2022Transfer Dynamics in Emergent Evolutionary Curricula3 Mar 2022
- 2022A Survey on Deep Reinforcement Learning-based Approaches for Adaptation and Generalization17 Feb 2022
- 2022Robust Policy Learning over Multiple Uncertainty Sets14 Feb 2022
- 2021MESA: Offline Meta-RL for Safe Adaptation and Fault Tolerance7 Dec 2021
- 2021Coupling Vision and Proprioception for Navigation of Legged Robots3 Dec 2021
- 2021An Embarrassingly Pragmatic Introduction to Vision-based Autonomous Robots15 Nov 2021
- 2021On sensitivity of meta-learning to support data26 Oct 2021
- 2021Minimizing Energy Consumption Leads to the Emergence of Gaits in Legged Robots25 Oct 2021
- 2021Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Survey28 Sep 2021
- 2021Lifelong Robotic Reinforcement Learning by Retaining Experiences19 Sep 2021
- 2021Behavior Self-Organization Supports Task Inference for Continual Robot Learning9 Jul 2021
- 2021RMA: Rapid Motor Adaptation for Legged Robots8 Jul 2021
- 2021Fast and Efficient Locomotion via Learned Gait Transitions9 Apr 2021
- 2021Bayesian Meta-Learning for Few-Shot Policy Adaptation Across Robotic Platforms5 Mar 2021
- 2021Meta-Reinforcement Learning for Adaptive Motor Control in Changing Robot Dynamics and Environments19 Jan 2021
- 2021ES-ENAS: Efficient Evolutionary Optimization for Large Hybrid Search Spaces19 Jan 2021
- 2025Synthesis of Model Predictive Control and Reinforcement Learning: Survey and Classificationcited by 26
- 2025Coreset-Based Task Selection for Sample-Efficient Meta-Reinforcement Learningcited by 6
- 2024Meta-Reinforcement Learning with Universal Policy Adaptation: Provable Near-Optimality under All-task Optimum Comparatorcited by 2
- 2025CARoL: Context-aware Adaptation for Robot Learningcited by 1
- 2025Beyond Fixed Morphologies: Learning Graph Policies with Trust Region Compensation in Variable Action Spacescited by 0
- 2026Robust Quadruped Locomotion via Evolutionary Reinforcement Learningcited by 0
- 2026Robust Quadruped Locomotion via Evolutionary Reinforcement Learning8 Apr 2026
- 2025Beyond Fixed Morphologies: Learning Graph Policies with Trust Region Compensation in Variable Action Spaces16 Aug 2025
- 2025CARoL: Context-aware Adaptation for Robot Learning8 Jun 2025
- 2025Coreset-Based Task Selection for Sample-Efficient Meta-Reinforcement Learning4 Feb 2025
- 2025Synthesis of Model Predictive Control and Reinforcement Learning: Survey and Classification4 Feb 2025
- 2024Meta-Reinforcement Learning with Universal Policy Adaptation: Provable Near-Optimality under All-task Optimum Comparator13 Oct 2024
- 2022Legged Locomotion in Challenging Terrains using Egocentric Visioncited by 151
- 2023Robot Parkour Learningcited by 149
- 2022Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotioncited by 121
- 2022Neural-Fly Enables Rapid Learning for Agile Flight in Strong Windscited by 85
- 2021Minimizing Energy Consumption Leads to the Emergence of Gaits in Legged Robotscited by 76
- 2021Fast and Efficient Locomotion via Learned Gait Transitionscited by 54
- 2022Adapting Rapid Motor Adaptation for Bipedal Robotscited by 54
- 2021Coupling Vision and Proprioception for Navigation of Legged Robotscited by 51
- 2021Lifelong Robotic Reinforcement Learning by Retaining Experiencescited by 34
- 2023Learning and Adapting Agile Locomotion Skills by Transferring Experiencecited by 33
- 2021Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Surveycited by 28
- 2021Bayesian Meta-Learning for Few-Shot Policy Adaptation Across Robotic Platformscited by 22
12 most cited of 35 All 35 (JSON)
- 2025LocoFormer: Generalist Locomotion via Long-context Adaptation28 Sep 2025
- 2025Unsupervised Skill Discovery as Exploration for Learning Agile Locomotion12 Aug 2025
- 2025Meta-Learning Online Dynamics Model Adaptation in Off-Road Autonomous Driving23 Apr 2025
- 2024Perturbing the Gradient for Alleviating Meta Overfitting20 May 2024
- 2024Impedance Matching: Enabling an RL-Based Running Jump in a Quadruped Robot23 Apr 2024
- 2024MPC of Uncertain Nonlinear Systems with Meta-Learning for Fast Adaptation of Neural Predictive Models18 Apr 2024
- 2023Adapt On-the-Go: Behavior Modulation for Single-Life Robot Deployment2 Nov 2023
- 2023Robot Parkour Learning11 Sep 2023
- 2023Curious Replay for Model-based Adaptation28 Jun 2023
- 2023Moving Forward by Moving Backward: Embedding Action Impact over Action Semantics24 Apr 2023
- 2023Learning and Adapting Agile Locomotion Skills by Transferring Experience19 Apr 2023
- 2023Continuous Versatile Jumping Using Learned Action Residuals17 Apr 2023
12 newest of 35 All 35 (JSON)