Learning Evolution via Optimization Knowledge Adaptation
Not on the map. Why?
Abstract (arXiv)
The iterative search process of evolutionary algorithms (EAs) encapsulates optimization knowledge within historical populations and fitness evaluations. Effective utilization of this knowledge is crucial for facilitating knowledge transfer and online adaptation. However, current research typically addresses these goals in isolation and faces distinct limitations: evolutionary sequential transfer optimization often suffers from incomplete utilization of prior knowledge, while adaptive strategies, utilizing real-time knowledge, are limited to tailoring specific evolutionary operators. To simultaneously achieve these two capabilities, we introduce the Optimization Knowledge Adaptation Evolutionary Model (OKAEM), a unified learnable evolutionary framework capable of adaptively updating parameters based on available optimization knowledge. By parameterizing evolutionary operators via attention mechanisms, OKAEM enables learnable update rules that facilitate the utilization of optimization knowledge via two phases: pre-training to integrate extensive prior knowledge for efficient transfer, and adaptive optimization to dynamically update parameters based on real-time knowledge. Experimental results confirm that OKAEM significantly outperforms state-of-the-art sequential transfer methods across 12 transfer scenarios via pre-training, and surpasses advanced learnable EAs solely through its self-tuning mechanism in prior-free settings. Beyond demonstrating practical utility in prompt tuning for vision-language models, ablation studies validate the necessity of the learnable components, while visualization analyses reveal the model's capacity to autonomously discover interpretable evolutionary principles. The code can be accessed at https://gitee.com/Anonymity_Paper/code-of-okaem.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 91 references that are in the map. First posted on arXiv 4 Jan 2025.
Builds on
28 of 91 references.
References · 28
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2021Learning to Prompt for Vision-Language Modelscited by 2,269
- 2013Describing Textures in the Wildcited by 2,110
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,488
- 2023Large Language Models as Optimizerscited by 830
- 2016The CMA Evolution Strategy: A Tutorialcited by 364
- 2022Black-Box Tuning for Language-Model-as-a-Servicecited by 254
- 2017Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learningcited by 148
- 2016COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Settingcited by 135
- 2023Language Model Crossover: Variation through Few-Shot Promptingcited by 119
16 more
- 2022BBTv2: Towards a Gradient-Free Future with Large Language Modelscited by 53
- 2022Discovering Evolution Strategies via Meta-Black-Box Optimizationcited by 44
- 2022evosax: JAX-based Evolution Strategiescited by 39
- 2023Discovering Attention-Based Genetic Algorithms via Meta-Black-Box Optimizationcited by 33
- 2019Learning to Optimize in Swarmscited by 23
- 2024Toward Automated Algorithm Design: A Survey and Practical Guide to Meta-Black-Box-Optimizationcited by 23
- 2024When Large Language Models Meet Evolutionary Algorithms: Potential Enhancements and Challengescited by 20
- 2019Meta-Learning for Black-box Optimizationcited by 18
- 2020Warm Starting CMA-ES for Hyperparameter Optimizationcited by 18
- 2023B2Opt: Learning to Optimize Black-box Optimization with Little Budgetcited by 15
- 2024Pretrained Optimization Model for Zero-Shot Black Box Optimizationcited by 13
- 2022Effective Mutation Rate Adaptation through Group Elite Selectioncited by 6
- 2023A Scalable Test Problem Generator for Sequential Transfer Optimizationcited by 5
- 2024Counterfactual rewards promote collective transport using individually controlled swarm microrobotscited by 4
- 2024Knowledge-aware Evolutionary Graph Neural Architecture Searchcited by 3
- 2024Populating cellular metamaterials on the extrema of attainable elasticity through neuroevolutioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025A Theoretical Analysis of Analogy-Based Evolutionary Transfer Optimization
- 2024An investigation on the use of Large Language Models for hyperparameter tuning in Evolutionary Algorithms
- 2026PACEvolve++: Improving Test-time Learning for Evolutionary Search Agents
- 2026ES-AHD: An Evolution Strategy Framework for Automatic Heuristic Design
- 2026Understanding Evolution Strategies for LLM Reasoning: Broader Reasoning Coverage than GRPO
- 2025A Systematic Survey on Large Language Models for Evolutionary Optimization: From Modeling to Solving
- 2026ESSAM: A Novel Competitive Evolution Strategies Approach to Reinforcement Learning for Memory Efficient LLMs Fine-Tuning
- 2026MeEvo: Metacognitive Evolution Combined with Natural Evolution for Automatic Heuristic Design