Discovering Quality-Diversity Algorithms via Meta-Black-Box Optimization
Not on the map. Why?
Abstract (arXiv)
Quality-Diversity has emerged as a powerful family of evolutionary algorithms that generate diverse populations of high-performing solutions by implementing local competition principles inspired by biological evolution. While these algorithms successfully foster diversity and innovation, their specific mechanisms rely on heuristics, such as grid-based competition in MAP-Elites or nearest-neighbor competition in unstructured archives. In this work, we propose a fundamentally different approach: using meta-learning to automatically discover novel Quality-Diversity algorithms. By parameterizing the competition rules using attention-based neural architectures, we evolve new algorithms that capture complex relationships between individuals in the descriptor space. Our discovered algorithms demonstrate competitive or superior performance compared to established Quality-Diversity baselines while exhibiting strong generalization to higher dimensions, larger populations, and out-of-distribution domains like robot control. Notably, even when optimized solely for fitness, these algorithms naturally maintain diverse populations, suggesting meta-learning rediscovers that diversity is fundamental to effective optimization.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 23 of its 51 references that are in the map. First posted on arXiv 4 Feb 2025.
Builds on
23 of 51 references.
References · 23
- 2017Attention Is All You Needcited by 60,361
- 2016Learning to learn by gradient descent by gradient descentcited by 620
- 2021Brax -- A Differentiable Physics Engine for Large Scale Rigid Body Simulationcited by 407
- 2016Learning to reinforcement learncited by 377
- 2014Robots that can adapt like animalscited by 204
- 2018Meta-Gradient Reinforcement Learningcited by 159
- 2021Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learningcited by 113
- 2018Understanding and correcting pathologies in the training of learned optimizerscited by 97
- 2013A Literature Survey of Benchmark Functions For Global Optimization Problemscited by 77
- 2020Discovering Reinforcement Learning Algorithmscited by 77
- 2016Using Centroidal Voronoi Tessellations to Scale Up the Multi-dimensional Archive of Phenotypic Elites Algorithmcited by 66
- 2019Autonomous skill discovery with Quality-Diversity and Unsupervised Descriptorscited by 57
11 more
- 2020Meta-Gradient Reinforcement Learning with an Objective Discovered Onlinecited by 52
- 2021The Sensory Neuron as a Transformer: Permutation-Invariant Neural Networks for Reinforcement Learningcited by 50
- 2020Meta Learning Backpropagation And Improving Itcited by 49
- 2023Discovering Attention-Based Genetic Algorithms via Meta-Black-Box Optimizationcited by 33
- 2021Unsupervised Behaviour Discovery with Quality-Diversity Optimisationcited by 30
- 2023MAP-Elites with Descriptor-Conditioned Gradients and Archive Distillation into a Single Policycited by 20
- 2019Meta-Learning for Black-box Optimizationcited by 18
- 2023QDax: A Library for Quality-Diversity and Population-based Algorithms with Hardware Accelerationcited by 17
- 2021Meta Learning Black-Box Population-Based Optimizerscited by 13
- 2024Toward Artificial Open-Ended Evolution within Lenia using Quality-Diversitycited by 12
- 2025Dominated Novelty Search: Rethinking Local Competition in Quality-Diversitycited by 8
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.