mlsanityData to 7 Oct 2026

Neural Exploratory Landscape Analysis for Meta-Black-Box-Optimization

arXiv 2408.10672 ↗First posted 20 Aug 2024cs.LG cs.NEcited by 10

Not on the map. Why?

Abstract (arXiv)

Recent research in Meta-Black-Box Optimization (MetaBBO) have shown that meta-trained neural networks can effectively guide the design of black-box optimizers, significantly reducing the need for expert tuning and delivering robust performance across complex problem distributions. Despite their success, a paradox remains: MetaBBO still rely on human-crafted Exploratory Landscape Analysis features to inform the meta-level agent about the low-level optimization progress. To address the gap, this paper proposes Neural Exploratory Landscape Analysis (NeurELA), a novel framework that dynamically profiles landscape features through a two-stage, attention-based neural network, executed in an entirely end-to-end fashion. NeurELA is pre-trained over a variety of MetaBBO algorithms using a multi-task neuroevolution strategy. Extensive experiments show that NeurELA achieves consistently superior performance when integrated into different and even unseen MetaBBO tasks and can be efficiently fine-tuned for further performance boost. This advancement marks a pivotal step in making MetaBBO algorithms more autonomous and broadly applicable. The source code of NeurELA can be accessed at https://github.com/GMC-DRL/Neur-ELA.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 29 of its 60 references that are in the map. First posted on arXiv 20 Aug 2024.

Builds on

29 of 60 references.

References · 29

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  3. 2016Layer Normalizationcited by 5,579
  4. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  5. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  6. 2017Ray: A Distributed Framework for Emerging AI Applicationscited by 516
  7. 2023EvoPrompt: Connecting LLMs with Evolutionary Algorithms Yields Powerful Prompt Optimizerscited by 189
  8. 2014A Tutorial on Principal Component Analysiscited by 139
  9. 2016COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Settingcited by 135
  10. 2018Automated Algorithm Selection: Survey and Perspectivescited by 111
  11. 2017Evolving Deep Neural Networkscited by 93
  12. 2022Discovering Evolution Strategies via Meta-Black-Box Optimizationcited by 44
17 more
  1. 2019Deep Reinforcement Learning Based Parameter Control in Differential Evolutioncited by 37
  2. 2022Multi-agent Dynamic Algorithm Configurationcited by 36
  3. 2023MetaBox: A Benchmark Platform for Meta-Black-Box Optimization with Reinforcement Learningcited by 35
  4. 2017Automated Algorithm Selection on Continuous Black-Box Problems By Combining Exploratory Landscape Analysis and Machine Learningcited by 33
  5. 2017Comprehensive Feature-Based Landscape Analysis of Continuous and Constrained Optimization Problems Using the R-Package flaccocited by 27
  6. 2020Exploratory Landscape Analysis is Strongly Sensitive to the Sampling Strategycited by 27
  7. 2021Learning adaptive differential evolution algorithm from optimization experiences by policy gradientcited by 24
  8. 2024Deep Reinforcement Learning for Dynamic Algorithm Selection: A Proof-of-Principle Study on Differential Evolutioncited by 24
  9. 2024Symbol: Generating Flexible Black-Box Optimizers through Symbolic Equation Learningcited by 22
  10. 2024Auto-configuring Exploration-Exploitation Tradeoff in Evolutionary Computation via Deep Reinforcement Learningcited by 17
  11. 2024Reinforced In-Context Black-Box Optimizationcited by 14
  12. 2023DoE2Vec: Deep-learning Based Features for Exploratory Landscape Analysiscited by 12
  13. 2024Deep-ELA: Deep Exploratory Landscape Analysis with Self-Supervised Pretrained Transformers for Single- and Multi-Objective Continuous Optimization Problemscited by 9
  14. 2024Evolution Transformer: In-Context Evolutionary Optimizationcited by 9
  15. 2022A Collection of Deep Learning-based Feature-Free Approaches for Characterizing Single-Objective Continuous Fitness Landscapescited by 8
  16. 2022PyPop7: A Pure-Python Library for Population-Based Black-Box Optimizationcited by 7
  17. 2024RLEMMO: Evolutionary Multimodal Optimization Assisted By Deep Reinforcement Learningcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 8; 2026: 2.

10 papers.