mlsanityData to 14 Oct 2026

Meta-Black-Box Optimization with Ensemble Surrogate Modeling for Robustness-Accuracy Trade-off within SAEA

arXiv 2606.00862 ↗First posted 30 May 2026cs.NE cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Surrogate-assisted evolutionary algorithms (SAEAs) have been widely used for expensive black-box optimization problems. However, their reliance on rigid and manually designed components limits their flexibility and generalization across tasks. Meta-black-box optimization (MetaBBO) provides a promising paradigm for adaptively configuring algorithmic components. Nevertheless, existing MetaBBO methods usually control only a single component, and few studies have investigated the unified control of multi-component optimizers such as SAEAs. Moreover, the robustness-accuracy trade-off in surrogate modeling, which is crucial for stable early-stage exploration and accurate late-stage exploitation, has rarely been explicitly considered. To address these issues, we propose AdaE-SAEA, an adaptive ensemble surrogate-assisted evolutionary algorithm for expensive multi-objective optimization. AdaE-SAEA embeds SAEA as the low-level optimizer within the MetaBBO framework and jointly controls the infill criterion and ensemble-based surrogate modeling. Specifically, bagging and boosting are designed as surrogate modeling modules to adaptively balance robustness and accuracy across different search phases, while the meta-policy simultaneously selects the infill criterion to enable adaptive sampling decisions. The meta-policy is trained through reinforcement learning with parallel sampling and centralized training, improving both training efficiency and transferability. Experiments on synthetic and real-world problems demonstrate that AdaE-SAEA outperforms state-of-the-art baselines and MetaBBO-based methods. We further verify the effectiveness of TabPFN as the base surrogate model for ensemble learning. To the best of our knowledge, this is the first work to unify the control of surrogate modeling and infill criteria in SAEAs while explicitly addressing the robustness--accuracy trade-off.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 27 of its 83 references that are in the map. First posted on arXiv 30 May 2026.

Builds on

27 of 83 references.

References · 27

  1. 2023Large Language Models as Optimizerscited by 864
  2. 2017Ray: A Distributed Framework for Emerging AI Applicationscited by 527
  3. 2021Transformers Can Do Bayesian Inferencecited by 360
  4. 2020Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimizationcited by 179
  5. 2022Amortized Inference for Causal Structure Learningcited by 90
  6. 2020An Easy-to-use Real-world Multi-objective Optimization Problem Suitecited by 71
  7. 2022Uncertainty-Aware Search Framework for Multi-Objective Bayesian Optimizationcited by 44
  8. 2019Deep Reinforcement Learning Based Parameter Control in Differential Evolutioncited by 38
  9. 2022Multi-agent Dynamic Algorithm Configurationcited by 36
  10. 2023MetaBox: A Benchmark Platform for Meta-Black-Box Optimization with Reinforcement Learningcited by 36
  11. 2017Comprehensive Feature-Based Landscape Analysis of Continuous and Constrained Optimization Problems Using the R-Package flaccocited by 27
  12. 2024Deep Reinforcement Learning for Dynamic Algorithm Selection: A Proof-of-Principle Study on Differential Evolutioncited by 24
15 more
  1. 2024Toward Automated Algorithm Design: A Survey and Practical Guide to Meta-Black-Box-Optimizationcited by 24
  2. 2024Symbol: Generating Flexible Black-Box Optimizers through Symbolic Equation Learningcited by 22
  3. 2023Large Language Model-Enhanced Algorithm Selection: Towards Comprehensive Algorithm Representationcited by 21
  4. 2024Auto-configuring Exploration-Exploitation Tradeoff in Evolutionary Computation via Deep Reinforcement Learningcited by 17
  5. 2024ConfigX: Modular Configuration for Evolutionary Algorithms via Multitask Reinforcement Learningcited by 15
  6. 2024Expensive Multi-Objective Bayesian Optimization Based on Diffusion Modelscited by 10
  7. 2024Neural Exploratory Landscape Analysis for Meta-Black-Box-Optimizationcited by 10
  8. 2025Meta-Black-Box-Optimization through Offline Q-function Learningcited by 9
  9. 2025MetaBox-v2: A Unified Benchmark Platform for Meta-Black-Box Optimizationcited by 9
  10. 2025Instance Generation for Meta-Black-Box Optimization through Latent Space Reverse Engineeringcited by 6
  11. 2025DesignX: Human-Competitive Algorithm Designer for Black-Box Optimizationcited by 5
  12. 2025Meta-Black-Box Optimization with Bi-Space Landscape Analysis and Dual-Control Mechanism for SAEAcited by 5
  13. 2022Reinforcement learning based parameters adaption method for particle swarm optimizationcited by 4
  14. 2024R2 Indicator and Deep Reinforcement Learning Enhanced Adaptive Multi-Objective Evolutionary Algorithmcited by 3
  15. 2026LLM Driven Design of Continuous Optimization Problems with Controllable High-level Propertiescited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Surrogate Learning in Meta-Black-Box Optimization: A Preliminary Study
  2. 2026Surrogate Ensemble in Expensive Multi-Objective Optimization via Deep Q-Learning
  3. 2025Offline Multi-Task Multi-Objective Data-Driven Evolutionary Algorithm with Language Surrogate Model and Implicit Q-Learning
  4. 2019Meta-Model Framework for Surrogate-Based Parameter Estimation in Dynamical Systems
  5. 2024Design Editing for Offline Model-based Optimization
  6. 2025PlatMetaX: An Integrated MATLAB platform for Meta-Black-Box Optimization
  7. 2025Machine Learning Algorithms for Improving Black Box Optimization Solvers
  8. 2025In-Context Multi-Objective Optimization