Evolutionary Computation for the Design and Enrichment of General-Purpose Artificial Intelligence Systems: Survey and Prospects
Not on the map. Why?
Abstract (arXiv)
In Artificial Intelligence, there is an increasing demand for adaptive models capable of dealing with a diverse spectrum of learning tasks, surpassing the limitations of systems devised to cope with a single task. The recent emergence of General-Purpose Artificial Intelligence Systems (GPAIS) poses model configuration and adaptability challenges at far greater complexity scales than the optimal design of traditional Machine Learning models. Evolutionary Computation (EC) has been a useful tool for both the design and optimization of Machine Learning models, endowing them with the capability to configure and/or adapt themselves to the task under consideration. Therefore, their application to GPAIS is a natural choice. This paper aims to analyze the role of EC in the field of GPAIS, exploring the use of EC for their design or enrichment. We also match GPAIS properties to Machine Learning areas in which EC has had a notable contribution, highlighting recent milestones of EC for GPAIS. Furthermore, we discuss the challenges of harnessing the benefits of EC for GPAIS, presenting different strategies to both design and improve GPAIS with EC, covering tangential areas, identifying research niches, and outlining potential research directions for EC and GPAIS.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 66 of its 165 references that are in the map. First posted on arXiv 3 Jun 2024.
Builds on
66 of 165 references.
References · 66
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,330
- 2019A Comprehensive Survey on Transfer Learningcited by 1,160
- 2020Self-supervised Learning: Generative or Contrastivecited by 694
- 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 571
- 2018A Survey on Deep Transfer Learningcited by 419
- 2017Large-Scale Evolution of Image Classifierscited by 348
- 2024Evolutionary Optimization of Model Merging Recipescited by 208
- 2019Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutionscited by 192
- 2020On Hyperparameter Optimization of Machine Learning Algorithms: Theory and Practicecited by 182
- 2018Efficient Multi-objective Neural Architecture Search via Lamarckian Evolutioncited by 153
38 more
- 2020AutoML-Zero: Evolving Machine Learning Algorithms From Scratchcited by 143
- 2020A Survey on Evolutionary Neural Architecture Searchcited by 142
- 2022Evolution through Large Modelscited by 134
- 2023Large Language Models as Evolutionary Optimizerscited by 124
- 2023A Comprehensive Survey of Dataset Distillationcited by 115
- 2020Hyper-Parameter Optimization: A Review of Algorithms and Applicationscited by 114
- 2017Quality and Diversity Optimization: A Unifying Modular Frameworkcited by 113
- 2023Frontier AI Regulation: Managing Emerging Risks to Public Safetycited by 98
- 2024LLaMEA: A Large Language Model Evolutionary Algorithm for Automatically Generating Metaheuristicscited by 97
- 2017Evolving Deep Neural Networkscited by 95
- 2019A Survey of Optimization Methods from a Machine Learning Perspectivecited by 91
- 2024Evolutionary Computation in the Era of Large Language Model: Survey and Roadmapcited by 90
- 2020NSGANetV2: Evolutionary Multi-Objective Surrogate-Assisted Neural Architecture Searchcited by 76
- 2023OMNI: Open-endedness via Models of human Notions of Interestingnesscited by 70
- 2023Connecting the Dots in Trustworthy Artificial Intelligence: From AI Principles, Ethics, and Key Requirements to Responsible AI Systems and Regulationcited by 61
- 2020Neural Architecture Transfercited by 60
- 2024Large Language Models As Evolution Strategiescited by 58
- 2017Evolving Deep Convolutional Neural Networks for Image Classificationcited by 55
- 2023One Small Step for Generative AI, One Giant Leap for AGI: A Complete Survey on ChatGPT in AIGC Eracited by 55
- 2023Algorithm Evolution Using Large Language Modelcited by 53
- 2018Automatically designing CNN architectures using genetic algorithm for image classificationcited by 48
- 2024Evolving Code with A Large Language Modelcited by 43
- 2023Quality-Diversity through AI Feedbackcited by 40
- 2019Collaborative Evolutionary Reinforcement Learningcited by 37
- 2023Evolutionary Reinforcement Learning: A Surveycited by 29
- 2021NAS-OoD: Neural Architecture Search for Out-of-Distribution Generalizationcited by 28
- 2021Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Surveycited by 28
- 2023Evaluating General-Purpose AI with Psychometricscited by 23
- 2019Evolutionary Neural AutoML for Deep Learningcited by 20
- 2022Multi-Objective Quality Diversity Optimizationcited by 19
- 2018DENSER: Deep Evolutionary Network Structured Representationcited by 16
- 2022Survey on Evolutionary Deep Learning: Principles, Algorithms, Applications and Open Issuescited by 12
- 2021Multi-objective Search of Robust Neural Architectures against Multiple Types of Adversarial Attackscited by 11
- 2018Evolutionary Innovations and Where to Find Them: Routes to Open-Ended Evolution in Natural and Artificial Systemscited by 10
- 2019An Overview of Open-Ended Evolution: Editorial Introduction to the Open-Ended Evolution II Special Issuecited by 10
- 2018Evolutionary Diversity Optimization Using Multi-Objective Indicatorscited by 9
- 2020Lights and Shadows in Evolutionary Deep Learning: Taxonomy, Critical Methodological Analysis, Cases of Study, Learned Lessons, Recommendations and Challengescited by 9
- 2022Mitigating Unfairness via Evolutionary Multi-objective Ensemble Learningcited by 8
50 most cited of 66 All 66 (JSON)
Built on by
Citing papers per year: 2025: 1.
1 paper.