mlsanityData to 7 Oct 2026

An Easy-to-use Real-world Multi-objective Optimization Problem Suite

arXiv 2009.12867 ↗First posted 27 Sep 2020cs.NEcited by 71

Not on the map. Why?

Abstract (arXiv)

Although synthetic test problems are widely used for the performance assessment of evolutionary multi-objective optimization algorithms, they are likely to include unrealistic properties which may lead to overestimation/underestimation. To address this issue, we present a multi-objective optimization problem suite consisting of 16 bound-constrained real-world problems. The problem suite includes various problems in terms of the number of objectives, the shape of the Pareto front, and the type of design variables. 4 out of the 16 problems are multi-objective mixed-integer optimization problems. We provide Java, C, and Matlab source codes of the 16 problems so that they are available in an off-the-shelf manner. We examine an approximated Pareto front of each test problem. We also analyze the performance of six representative evolutionary multi-objective optimization algorithms on the 16 problems. In addition to the 16 problems, we present 8 constrained multi-objective real-world problems.

Key facts. Cited by 71 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Sep 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 10; 2023: 8; 2024: 20; 2025: 16; 2026: 13.

71 papers.

Sort:

By area:

  1. 2023Unexpected Improvements to Expected Improvement for Bayesian Optimizationcited by 144
  2. 2021Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume Improvementcited by 115
  3. 2021Multi-Objective Bayesian Optimization over High-Dimensional Search Spacescited by 87
  4. 2022Pareto Set Learning for Expensive Multi-Objective Optimizationcited by 51
  5. 2024Smooth Tchebycheff Scalarization for Multi-Objective Optimizationcited by 50
  6. 2022Joint Entropy Search for Multi-objective Bayesian Optimizationcited by 45
  7. 2022Preference Exploration for Efficient Bayesian Optimization with Multiple Outcomescited by 41
  8. 2022Robust Multi-Objective Bayesian Optimization Under Input Noisecited by 36
  9. 2023Large Language Model for Multi-objective Evolutionary Optimizationcited by 29
  10. 2021Bayesian Optimization over Hybrid Spacescited by 23
  11. 2025Pareto Set Learning for Multi-Objective Reinforcement Learningcited by 18
  12. 2024ParetoFlow: Guided Flows in Multi-Objective Optimizationcited by 17
38 more
  1. 2024PROUD: PaRetO-gUided Diffusion Model for Multi-objective Generationcited by 15
  2. 2024Offline Multi-Objective Optimizationcited by 14
  3. 2025Offline Model-Based Optimization: Comprehensive Reviewcited by 14
  4. 2024Offline Model-Based Optimization by Learning to Rankcited by 13
  5. 2025Preference-Guided Diffusion for Multi-Objective Offline Optimizationcited by 12
  6. 2023qPOTS: Efficient batch multiobjective Bayesian optimization via Pareto optimal Thompson samplingcited by 11
  7. 2024Explainable Benchmarking for Iterative Optimization Heuristicscited by 10
  8. 2024Expensive Multi-Objective Bayesian Optimization Based on Diffusion Modelscited by 10
  9. 2024Constrained Multi-objective Bayesian Optimization through Optimistic Constraints Estimationcited by 6
  10. 2025User Preference Meets Pareto-Optimality in Multi-Objective Bayesian Optimizationcited by 6
  11. 2025Improving LLM-based Global Optimization with Search Space Partitioningcited by 6
  12. 2025Towards Universal Offline Black-Box Optimization via Learning Language Model Embeddingscited by 6
  13. 2022MBORE: Multi-objective Bayesian Optimisation by Density-Ratio Estimationcited by 5
  14. 2022PF2ES: Parallel Feasible Pareto Frontier Entropy Search for Multi-Objective Bayesian Optimizationcited by 5
  15. 2024A Tutorial on the Design, Experimentation and Application of Metaheuristic Algorithms to Real-World Optimization Problemscited by 5
  16. 2024Evolutionary Preference Sampling for Pareto Set Learningcited by 4
  17. 2024Improving Pareto Set Learning for Expensive Multi-objective Optimization via Stein Variational Hypernetworkscited by 4
  18. 2025(θl, θu)-Parametric Multi-Task Optimization: Joint Search in Solution and Infinite Task Spacescited by 4
  19. 2021Multi-task problems are not multi-objectivecited by 3
  20. 2022Probability Distribution of Hypervolume Improvement in Bi-objective Bayesian Optimizationcited by 3
  21. 2023Multi-objective optimisation via the R2 utilitiescited by 3
  22. 2024Metaheuristics for (Variable-Size) Mixed Optimization Problems: A Unified Taxonomy and Surveycited by 3
  23. 2024Preferential Multi-Objective Bayesian Optimizationcited by 3
  24. 2025MOBO-OSD: Batch Multi-Objective Bayesian Optimization via Orthogonal Search Directionscited by 3
  25. 2023Constrained Bayesian Optimization with Adaptive Active Learning of Unknown Constraintscited by 2
  26. 2024Random Pareto front surfacescited by 2
  27. 2025Interactive Multi-Objective Probabilistic Preference Learning with Soft and Hard Boundscited by 2
  28. 2025FoMEMO: Towards Foundation Models for Expensive Multi-objective Optimizationcited by 2
  29. 2025SPREAD: Sampling-based Pareto front Refinement via Efficient Adaptive Diffusioncited by 2
  30. 2026Pareto-Conditioned Diffusion Models for Offline Multi-Objective Optimizationcited by 2
  31. 2026Do We Really Need to Approach the Entire Pareto Front in Many-Objective Bayesian Optimisation?cited by 2
  32. 2022Component-wise Analysis of Automatically Designed Multiobjective Algorithms on Constrained Problemscited by 1
  33. 2023Achieving Diversity in Objective Space for Sample-efficient Search of Multiobjective Optimization Problemscited by 1
  34. 2024Shared active subspace for multivariate vector-valued functionscited by 1
  35. 2024UMOEA/D: A Multiobjective Evolutionary Algorithm for Uniform Pareto Objectives based on Decompositioncited by 1
  36. 2024Collaborative Pareto Set Learning in Multiple Multi-Objective Optimization Problemscited by 1
  37. 2024Scalarisation-based risk concepts for robust multi-objective optimisationcited by 1
  38. 2025Bayesian Optimization with Preference Exploration using a Monotonic Neural Network Ensemblecited by 1

50 most cited of 71 All 71 (JSON)