mlsanityData to 14 Oct 2026

Discovering Quality-Diversity Algorithms via Meta-Black-Box Optimization

arXiv 2502.02190 ↗First posted 4 Feb 2025cs.NE cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Quality-Diversity has emerged as a powerful family of evolutionary algorithms that generate diverse populations of high-performing solutions by implementing local competition principles inspired by biological evolution. While these algorithms successfully foster diversity and innovation, their specific mechanisms rely on heuristics, such as grid-based competition in MAP-Elites or nearest-neighbor competition in unstructured archives. In this work, we propose a fundamentally different approach: using meta-learning to automatically discover novel Quality-Diversity algorithms. By parameterizing the competition rules using attention-based neural architectures, we evolve new algorithms that capture complex relationships between individuals in the descriptor space. Our discovered algorithms demonstrate competitive or superior performance compared to established Quality-Diversity baselines while exhibiting strong generalization to higher dimensions, larger populations, and out-of-distribution domains like robot control. Notably, even when optimized solely for fitness, these algorithms naturally maintain diverse populations, suggesting meta-learning rediscovers that diversity is fundamental to effective optimization.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 23 of its 51 references that are in the map. First posted on arXiv 4 Feb 2025.

Builds on

23 of 51 references.

References · 23

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016Learning to learn by gradient descent by gradient descentcited by 620
  3. 2021Brax -- A Differentiable Physics Engine for Large Scale Rigid Body Simulationcited by 407
  4. 2016Learning to reinforcement learncited by 377
  5. 2014Robots that can adapt like animalscited by 204
  6. 2018Meta-Gradient Reinforcement Learningcited by 159
  7. 2021Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learningcited by 113
  8. 2018Understanding and correcting pathologies in the training of learned optimizerscited by 97
  9. 2013A Literature Survey of Benchmark Functions For Global Optimization Problemscited by 77
  10. 2020Discovering Reinforcement Learning Algorithmscited by 77
  11. 2016Using Centroidal Voronoi Tessellations to Scale Up the Multi-dimensional Archive of Phenotypic Elites Algorithmcited by 66
  12. 2019Autonomous skill discovery with Quality-Diversity and Unsupervised Descriptorscited by 57
11 more
  1. 2020Meta-Gradient Reinforcement Learning with an Objective Discovered Onlinecited by 52
  2. 2021The Sensory Neuron as a Transformer: Permutation-Invariant Neural Networks for Reinforcement Learningcited by 50
  3. 2020Meta Learning Backpropagation And Improving Itcited by 49
  4. 2023Discovering Attention-Based Genetic Algorithms via Meta-Black-Box Optimizationcited by 33
  5. 2021Unsupervised Behaviour Discovery with Quality-Diversity Optimisationcited by 30
  6. 2023MAP-Elites with Descriptor-Conditioned Gradients and Archive Distillation into a Single Policycited by 20
  7. 2019Meta-Learning for Black-box Optimizationcited by 18
  8. 2023QDax: A Library for Quality-Diversity and Population-based Algorithms with Hardware Accelerationcited by 17
  9. 2021Meta Learning Black-Box Population-Based Optimizerscited by 13
  10. 2024Toward Artificial Open-Ended Evolution within Lenia using Quality-Diversitycited by 12
  11. 2025Dominated Novelty Search: Rethinking Local Competition in Quality-Diversitycited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.