Quality-Diversity Optimization as Multi-Objective Optimization
Not on the map. Why?
Abstract (arXiv)
The Quality-Diversity (QD) optimization aims to discover a collection of high-performing solutions that simultaneously exhibit diverse behaviors within a user-defined behavior space. This paradigm has stimulated significant research interest and demonstrated practical utility in domains including robot control, creative design, and adversarial sample generation. A variety of QD algorithms with distinct design principles have been proposed in recent years. Instead of proposing a new QD algorithm, this work introduces a novel reformulation by casting the QD optimization as a multi-objective optimization (MOO) problem with a huge number of optimization objectives. By establishing this connection, we enable the direct adoption of well-established MOO methods, particularly set-based scalarization techniques, to solve QD problems through a collaborative search process. We further provide a theoretical analysis demonstrating that our approach inherits theoretical guarantees from MOO while providing desirable properties for the QD optimization. Experimental studies across several QD applications confirm that our method achieves performance competitive with state-of-the-art QD algorithms.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 58 of its 113 references that are in the map. First posted on arXiv 31 Jan 2026.
Builds on
58 of 113 references.
References · 58
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2021Convex optimizationcited by 2,479
- 2018Multi-Task Learning as Multi-Objective Optimizationcited by 809
- 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 774
- 2015Illuminating search spaces by mapping elitescited by 406
- 2019Which Tasks Should Be Learned Together in Multi-task Learning?cited by 367
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
- 2020First return, then explorecited by 256
- 2019Pareto Multi-Task Learningcited by 224
- 2021Efficiently Identifying Task Groupings for Multi-Task Learningcited by 218
- 2019Go-Explore: a New Approach for Hard-Exploration Problemscited by 207
38 more
- 2014Robots that can adapt like animalscited by 203
- 2024Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Promptscited by 189
- 2020Minimax Pareto Fairness: A Multi Objective Perspectivecited by 152
- 2021MARS: Markov Molecular Sampling for Multi-objective Drug Discoverycited by 125
- 2020Learning the Pareto Front with Hypernetworkscited by 122
- 2017Quality and Diversity Optimization: A Unifying Modular Frameworkcited by 111
- 2019Covariance Matrix Adaptation for the Rapid Illumination of Behavior Spacecited by 78
- 2021Differentiable Quality Diversitycited by 71
- 2016Using Centroidal Voronoi Tessellations to Scale Up the Multi-dimensional Archive of Phenotypic Elites Algorithmcited by 65
- 2020Quality-Diversity Optimization: a novel branch of stochastic optimizationcited by 59
- 2020Efficient Continuous Pareto Exploration in Multi-Task Learningcited by 57
- 2022Pareto Set Learning for Neural Multi-objective Combinatorial Optimizationcited by 56
- 2022Pareto Set Learning for Expensive Multi-Objective Optimizationcited by 51
- 2024Smooth Tchebycheff Scalarization for Multi-Objective Optimizationcited by 50
- 2021Scalable Pareto Front Approximation for Deep Multi-Objective Learningcited by 45
- 2021Modern Evolution Strategies for Creativity: Fitting Concrete Images and Abstract Conceptscited by 40
- 2022Deep Surrogate Assisted Generation of Environmentscited by 40
- 2023Quality-Diversity through AI Feedbackcited by 40
- 2021Unsupervised Behaviour Discovery with Quality-Diversity Optimisationcited by 30
- 2023pyribs: A Bare-Bones Python Library for Quality Diversity Optimizationcited by 29
- 2021Deep Surrogate Assisted MAP-Elites for Automated Hearthstone Deckbuildingcited by 26
- 2022Covariance Matrix Adaptation MAP-Annealingcited by 24
- 2020Quality Diversity for Multi-task Optimizationcited by 23
- 2024Robust Multi-Task Learning with Excess Riskscited by 23
- 2023Proximal Policy Gradient Arborescence for Quality Diversity Reinforcement Learningcited by 20
- 2022Multi-Objective Quality Diversity Optimizationcited by 18
- 2020BOP-Elites, a Bayesian Optimisation algorithm for Quality-Diversity searchcited by 15
- 2024Quality-Weighted Vendi Scores And Their Application To Diverse Experimental Designcited by 15
- 2024Few for Many: Tchebycheff Set Scalarization for Many-Objective Optimizationcited by 15
- 2020Finding Game Levels with the Right Difficulty in a Few Trials through Intelligent Trial-and-Errorcited by 14
- 2024Traversing Pareto Optimal Policies: Provably Efficient Multi-Objective Reinforcement Learningcited by 13
- 2022Training Diverse High-Dimensional Controllers by Scaling Covariance Matrix Adaptation MAP-Annealingcited by 10
- 2023Arbitrarily Scalable Environment Generators via Neural Cellular Automatacited by 9
- 2025Quality-Diversity Red-Teaming: Automated Generation of High-Quality and Diverse Attackers for Large Language Modelscited by 8
- 2025Dominated Novelty Search: Rethinking Local Competition in Quality-Diversitycited by 7
- 2017Data-Efficient Exploration, Optimization, and Modeling of Diverse Designs through Surrogate-Assisted Illuminationcited by 6
- 2024Many-Objective Multi-Solution Transportcited by 5
- 2024Efficient Algorithms for Sum-of-Minimum Optimizationcited by 4
50 most cited of 58 All 58 (JSON)
Built on by
Not cited yet.