mlsanityData to 7 Oct 2026

Quality-Diversity Optimization as Multi-Objective Optimization

arXiv 2602.00478 ↗First posted 31 Jan 2026cs.LG cs.AI cs.NEcited by 0

Not on the map. Why?

Abstract (arXiv)

The Quality-Diversity (QD) optimization aims to discover a collection of high-performing solutions that simultaneously exhibit diverse behaviors within a user-defined behavior space. This paradigm has stimulated significant research interest and demonstrated practical utility in domains including robot control, creative design, and adversarial sample generation. A variety of QD algorithms with distinct design principles have been proposed in recent years. Instead of proposing a new QD algorithm, this work introduces a novel reformulation by casting the QD optimization as a multi-objective optimization (MOO) problem with a huge number of optimization objectives. By establishing this connection, we enable the direct adoption of well-established MOO methods, particularly set-based scalarization techniques, to solve QD problems through a collaborative search process. We further provide a theoretical analysis demonstrating that our approach inherits theoretical guarantees from MOO while providing desirable properties for the QD optimization. Experimental studies across several QD applications confirm that our method achieves performance competitive with state-of-the-art QD algorithms.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 58 of its 113 references that are in the map. First posted on arXiv 31 Jan 2026.

Builds on

58 of 113 references.

References · 58

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  3. 2021Convex optimizationcited by 2,479
  4. 2018Multi-Task Learning as Multi-Objective Optimizationcited by 809
  5. 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 774
  6. 2015Illuminating search spaces by mapping elitescited by 406
  7. 2019Which Tasks Should Be Learned Together in Multi-task Learning?cited by 367
  8. 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
  9. 2020First return, then explorecited by 256
  10. 2019Pareto Multi-Task Learningcited by 224
  11. 2021Efficiently Identifying Task Groupings for Multi-Task Learningcited by 218
  12. 2019Go-Explore: a New Approach for Hard-Exploration Problemscited by 207
38 more
  1. 2014Robots that can adapt like animalscited by 203
  2. 2024Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Promptscited by 189
  3. 2020Minimax Pareto Fairness: A Multi Objective Perspectivecited by 152
  4. 2021MARS: Markov Molecular Sampling for Multi-objective Drug Discoverycited by 125
  5. 2020Learning the Pareto Front with Hypernetworkscited by 122
  6. 2017Quality and Diversity Optimization: A Unifying Modular Frameworkcited by 111
  7. 2019Covariance Matrix Adaptation for the Rapid Illumination of Behavior Spacecited by 78
  8. 2021Differentiable Quality Diversitycited by 71
  9. 2016Using Centroidal Voronoi Tessellations to Scale Up the Multi-dimensional Archive of Phenotypic Elites Algorithmcited by 65
  10. 2020Quality-Diversity Optimization: a novel branch of stochastic optimizationcited by 59
  11. 2020Efficient Continuous Pareto Exploration in Multi-Task Learningcited by 57
  12. 2022Pareto Set Learning for Neural Multi-objective Combinatorial Optimizationcited by 56
  13. 2022Pareto Set Learning for Expensive Multi-Objective Optimizationcited by 51
  14. 2024Smooth Tchebycheff Scalarization for Multi-Objective Optimizationcited by 50
  15. 2021Scalable Pareto Front Approximation for Deep Multi-Objective Learningcited by 45
  16. 2021Modern Evolution Strategies for Creativity: Fitting Concrete Images and Abstract Conceptscited by 40
  17. 2022Deep Surrogate Assisted Generation of Environmentscited by 40
  18. 2023Quality-Diversity through AI Feedbackcited by 40
  19. 2021Unsupervised Behaviour Discovery with Quality-Diversity Optimisationcited by 30
  20. 2023pyribs: A Bare-Bones Python Library for Quality Diversity Optimizationcited by 29
  21. 2021Deep Surrogate Assisted MAP-Elites for Automated Hearthstone Deckbuildingcited by 26
  22. 2022Covariance Matrix Adaptation MAP-Annealingcited by 24
  23. 2020Quality Diversity for Multi-task Optimizationcited by 23
  24. 2024Robust Multi-Task Learning with Excess Riskscited by 23
  25. 2023Proximal Policy Gradient Arborescence for Quality Diversity Reinforcement Learningcited by 20
  26. 2022Multi-Objective Quality Diversity Optimizationcited by 18
  27. 2020BOP-Elites, a Bayesian Optimisation algorithm for Quality-Diversity searchcited by 15
  28. 2024Quality-Weighted Vendi Scores And Their Application To Diverse Experimental Designcited by 15
  29. 2024Few for Many: Tchebycheff Set Scalarization for Many-Objective Optimizationcited by 15
  30. 2020Finding Game Levels with the Right Difficulty in a Few Trials through Intelligent Trial-and-Errorcited by 14
  31. 2024Traversing Pareto Optimal Policies: Provably Efficient Multi-Objective Reinforcement Learningcited by 13
  32. 2022Training Diverse High-Dimensional Controllers by Scaling Covariance Matrix Adaptation MAP-Annealingcited by 10
  33. 2023Arbitrarily Scalable Environment Generators via Neural Cellular Automatacited by 9
  34. 2025Quality-Diversity Red-Teaming: Automated Generation of High-Quality and Diverse Attackers for Large Language Modelscited by 8
  35. 2025Dominated Novelty Search: Rethinking Local Competition in Quality-Diversitycited by 7
  36. 2017Data-Efficient Exploration, Optimization, and Modeling of Diverse Designs through Surrogate-Assisted Illuminationcited by 6
  37. 2024Many-Objective Multi-Solution Transportcited by 5
  38. 2024Efficient Algorithms for Sum-of-Minimum Optimizationcited by 4

50 most cited of 58 All 58 (JSON)

Built on by

Not cited yet.