Guiding Evolution of Artificial Life Using Vision-Language Models
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Foundation models (FMs) have recently opened up new frontiers in the field of artificial life (ALife) by providing powerful tools to automate search through ALife simulations. Previous work aligns ALife simulations with natural language target prompts using vision-language models (VLMs). We build on Automated Search for Artificial Life (ASAL) by introducing ASAL++, a method for open-ended-like search guided by multimodal FMs. We use a second FM to propose new evolutionary targets based on a simulation's visual history. This induces an evolutionary trajectory with increasingly complex targets. We explore two strategies: (1) evolving a simulation to match a single new prompt at each iteration (Evolved Supervised Targets: EST) and (2) evolving a simulation to match the entire sequence of generated prompts (Evolved Temporal Targets: ETT). We test our method empirically in the Lenia substrate using Gemma-3 to propose evolutionary targets, and show that EST promotes greater visual novelty, while ETT fosters more coherent and interpretable evolutionary sequences. Our results suggest that ASAL++ points towards new directions for FM-driven ALife discovery with open-ended characteristics.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 20 of its 29 references that are in the map. First posted on arXiv 26 Sep 2025.
Builds on
20 of 29 references.
References · 20
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023GPT-4 Technical Reportcited by 18,396
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 651
- 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 602
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
- 2015Illuminating search spaces by mapping elitescited by 425
- 2024The Platonic Representation Hypothesiscited by 382
- 2024Open-Endedness is Essential for Artificial Superhuman Intelligencecited by 80
- 2024OMNI-EPIC: Open-endedness via Models of human Notions of Interestingness with Environments Programmed in Codecited by 74
- 2023OMNI: Open-endedness via Models of human Notions of Interestingnesscited by 70
8 more
- 2018Lenia - Biology of Artificial Lifecited by 41
- 2024Automating the Search for Artificial Life with Foundation Modelscited by 20
- 2024Toward Artificial Open-Ended Evolution within Lenia using Quality-Diversitycited by 12
- 2022Flow-Lenia: Towards open-ended evolution in cellular automata through mass conservation and parameter localizationcited by 11
- 2023Towards Large-Scale Simulations of Open-Ended Evolution in Continuous Cellular Automatacited by 10
- 2024JaxLife: An Open-Ended Agentic Simulatorcited by 6
- 2022Discovering Unsupervised Behaviours from Full-State Trajectoriescited by 2
- 2025Exploring Flow-Lenia Universes with a Curiosity-driven AI Scientist: Discovering Diverse Ecosystem Dynamicscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Towards Understanding How Knowledge Evolves in Large Vision-Language Models
- 2026CausalEvolve: Towards Open-Ended Discovery with Causal Scratchpad
- 2025Evolution 6.0: Robot Evolution through Generative Design ↗
- 2025Evolution without an Oracle: Driving Effective Evolution with LLM Judges
- 2026SEDIMA: Cross-Run Hierarchical Insight Memory for Evolutionary Search Agents
- 2026CORAL: Towards Autonomous Multi-Agent Evolution for Open-Ended Discovery
- 2026In Search of the Ingredients of Open-Endedness: Replicating Picbreeder with Large Vision-Language Models
- 2025Expedition & Expansion: Leveraging Semantic Representations for Goal-Directed Exploration in Continuous Cellular Automata