Efficient and Diverse Generative Robot Designs using Evolution and Intrinsic Motivation
On the map: Deep reinforcement learning methods → RL for robot locomotion and manipulation
Abstract (arXiv)
Methods for generative design of robot physical configurations can automatically find optimal and innovative solutions for challenging tasks in complex environments. The vast search-space includes the physical design-space and the controller parameter-space, making it a challenging problem in machine learning and optimisation in general. Evolutionary algorithms (EAs) have shown promising results in generating robot designs via gradient-free optimisation. Morpho-evolution with learning (MEL) uses EAs to concurrently generate robot designs and learn the optimal parameters of the controllers. Two main issues prevent MEL from scaling to higher complexity tasks: computational cost and premature convergence to sub-optimal designs. To address these issues, we propose combining morpho-evolution with intrinsic motivations. Intrinsically motivated behaviour arises from embodiment and simple learning rules without external guidance. We use a homeokinetic controller that generates exploratory behaviour in a few seconds with reduced knowledge of the robot's design. Homeokinesis replaces costly learning phases, reducing computational time and favouring diversity, preventing premature convergence. We compare our approach with current MEL methods in several downstream tasks. The generated designs score higher in all the tasks, are more diverse, and are quickly generated compared to morpho-evolution with static parameters.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in RL for robot locomotion and manipulation, one of 15 directions in Deep reinforcement learning methods. Builds on 13 of its 35 references that are in the map. First posted on arXiv 27 Nov 2024.
Builds on
13 of 35 references.
References · 13
- 2021Embodied Intelligence via Learning and Evolutioncited by 163
- 2023Art and the science of generative AI: A deeper divecited by 95
- 2017Intrinsically Motivated Goal Exploration Processes with Automatic Curriculum Learningcited by 83
- 2017Scalable Co-Optimization of Morphology and Control in Embodied Machinescited by 40
- 2019Data-efficient Co-Adaptation of Morphology and Behaviour with Deep Reinforcement Learningcited by 37
- 2021Task-Agnostic Morphology Evolutioncited by 24
- 2021Learn Goal-Conditioned Policy with Intrinsic Motivation for Deep Reinforcement Learningcited by 17
- 2023Efficient automatic design of robotscited by 14
- 2021The Effects of Learning in Morphologically Evolving Robot Systemscited by 11
- 2021Morpho-evolution with learning using a controller archive as an inheritance mechanismcited by 9
- 2024Investigating Premature Convergence in Co-optimization of Morphology and Control in Evolved Virtual Soft Robotscited by 9
- 2023Reinforcement learning for freeform robot designcited by 8
1 more
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Accelerated co-design of robots through morphological pretraining
- 2024RoboMorph: Evolving Robot Morphology using Large Language Models
- 2026Rapid co-design of Buoyancy-assisted robots for Challenging Locomotion using Gaussian Evolutionary Specialists ↗
- 2026Benefits of Low-Cost Bio-Inspiration in the Age of Overparametrization
- 2024DittoGym: Learning to Control Soft Shape-Shifting Robots
- 2026When Search Becomes Memory: Accelerating Robot Design Discovery with Self-Evolving Skills
- 2026Lamarckian Inheritance in Dynamic Environments: How Key Variables Affect Evolutionary Dynamics
- 2024A Talent-infused Policy-gradient Approach to Efficient Co-Design of Morphology and Task Allocation Behavior of Multi-Robot Systems ↗