Neural Exploratory Landscape Analysis for Meta-Black-Box-Optimization
Not on the map. Why?
Abstract (arXiv)
Recent research in Meta-Black-Box Optimization (MetaBBO) have shown that meta-trained neural networks can effectively guide the design of black-box optimizers, significantly reducing the need for expert tuning and delivering robust performance across complex problem distributions. Despite their success, a paradox remains: MetaBBO still rely on human-crafted Exploratory Landscape Analysis features to inform the meta-level agent about the low-level optimization progress. To address the gap, this paper proposes Neural Exploratory Landscape Analysis (NeurELA), a novel framework that dynamically profiles landscape features through a two-stage, attention-based neural network, executed in an entirely end-to-end fashion. NeurELA is pre-trained over a variety of MetaBBO algorithms using a multi-task neuroevolution strategy. Extensive experiments show that NeurELA achieves consistently superior performance when integrated into different and even unseen MetaBBO tasks and can be efficiently fine-tuned for further performance boost. This advancement marks a pivotal step in making MetaBBO algorithms more autonomous and broadly applicable. The source code of NeurELA can be accessed at https://github.com/GMC-DRL/Neur-ELA.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 29 of its 60 references that are in the map. First posted on arXiv 20 Aug 2024.
Builds on
29 of 60 references.
References · 29
- 2017Attention Is All You Needcited by 59,932
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016Layer Normalizationcited by 5,579
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2017Ray: A Distributed Framework for Emerging AI Applicationscited by 516
- 2023EvoPrompt: Connecting LLMs with Evolutionary Algorithms Yields Powerful Prompt Optimizerscited by 189
- 2014A Tutorial on Principal Component Analysiscited by 139
- 2016COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Settingcited by 135
- 2018Automated Algorithm Selection: Survey and Perspectivescited by 111
- 2017Evolving Deep Neural Networkscited by 93
- 2022Discovering Evolution Strategies via Meta-Black-Box Optimizationcited by 44
17 more
- 2019Deep Reinforcement Learning Based Parameter Control in Differential Evolutioncited by 37
- 2022Multi-agent Dynamic Algorithm Configurationcited by 36
- 2023MetaBox: A Benchmark Platform for Meta-Black-Box Optimization with Reinforcement Learningcited by 35
- 2017Automated Algorithm Selection on Continuous Black-Box Problems By Combining Exploratory Landscape Analysis and Machine Learningcited by 33
- 2017Comprehensive Feature-Based Landscape Analysis of Continuous and Constrained Optimization Problems Using the R-Package flaccocited by 27
- 2020Exploratory Landscape Analysis is Strongly Sensitive to the Sampling Strategycited by 27
- 2021Learning adaptive differential evolution algorithm from optimization experiences by policy gradientcited by 24
- 2024Deep Reinforcement Learning for Dynamic Algorithm Selection: A Proof-of-Principle Study on Differential Evolutioncited by 24
- 2024Symbol: Generating Flexible Black-Box Optimizers through Symbolic Equation Learningcited by 22
- 2024Auto-configuring Exploration-Exploitation Tradeoff in Evolutionary Computation via Deep Reinforcement Learningcited by 17
- 2024Reinforced In-Context Black-Box Optimizationcited by 14
- 2023DoE2Vec: Deep-learning Based Features for Exploratory Landscape Analysiscited by 12
- 2024Deep-ELA: Deep Exploratory Landscape Analysis with Self-Supervised Pretrained Transformers for Single- and Multi-Objective Continuous Optimization Problemscited by 9
- 2024Evolution Transformer: In-Context Evolutionary Optimizationcited by 9
- 2022A Collection of Deep Learning-based Feature-Free Approaches for Characterizing Single-Objective Continuous Fitness Landscapescited by 8
- 2022PyPop7: A Pure-Python Library for Population-Based Black-Box Optimizationcited by 7
- 2024RLEMMO: Evolutionary Multimodal Optimization Assisted By Deep Reinforcement Learningcited by 7
Built on by
Citing papers per year: 2025: 8; 2026: 2.
10 papers.
- 2025MetaBox-v2: A Unified Benchmark Platform for Meta-Black-Box Optimizationcited by 9
- 2025DesignX: Human-Competitive Algorithm Designer for Black-Box Optimizationcited by 5
- 2025AutoEP: LLMs-Driven Automation of Hyperparameter Evolution for Metaheuristic Algorithmscited by 4
- 2025BBOPlace-Bench: Benchmarking Black-Box Optimization for Chip Placementcited by 4
- 2025Sequential Multi-Agent Dynamic Algorithm Configurationcited by 3
- 2025A Novel Two-Phase Cooperative Co-evolution Framework for Large-Scale Global Optimization with Complex Overlappingcited by 2
- 2025Learning Where, What and How to Transfer: A Multi-Role Reinforcement Learning Approach for Evolutionary Multitaskingcited by 1
- 2026Meta-Black-Box Optimization with Ensemble Surrogate Modeling for Robustness-Accuracy Trade-off within SAEAcited by 1
- 2025OPAL: Operator-Programmed Algorithms for Landscape-Aware Black-Box Optimizationcited by 0
- 2026Hyper Algorithm Design Agent: Evolving Learnable Optimizer from Zerocited by 0
- 2026Hyper Algorithm Design Agent: Evolving Learnable Optimizer from Zero28 Sep 2026
- 2026Meta-Black-Box Optimization with Ensemble Surrogate Modeling for Robustness-Accuracy Trade-off within SAEA30 May 2026
- 2025OPAL: Operator-Programmed Algorithms for Landscape-Aware Black-Box Optimization14 Dec 2025
- 2025Learning Where, What and How to Transfer: A Multi-Role Reinforcement Learning Approach for Evolutionary Multitasking19 Nov 2025
- 2025Sequential Multi-Agent Dynamic Algorithm Configuration27 Oct 2025
- 2025BBOPlace-Bench: Benchmarking Black-Box Optimization for Chip Placement27 Oct 2025
- 2025AutoEP: LLMs-Driven Automation of Hyperparameter Evolution for Metaheuristic Algorithms27 Sep 2025
- 2025DesignX: Human-Competitive Algorithm Designer for Black-Box Optimization23 May 2025
- 2025MetaBox-v2: A Unified Benchmark Platform for Meta-Black-Box Optimization23 May 2025
- 2025A Novel Two-Phase Cooperative Co-evolution Framework for Large-Scale Global Optimization with Complex Overlapping23 Mar 2025