ZapGPT: Free-form Language Prompting for Simulated Cellular Control
Not on the map. Why?
Abstract (arXiv)
Human language is one of the most expressive tools for conveying intent, yet most artificial or biological systems lack mechanisms to interpret or respond meaningfully to it. Bridging this gap could enable more natural forms of control over complex, decentralized systems. In AI and artificial life, recent work explores how language can specify high-level goals, but most systems still depend on engineered rewards, task-specific supervision, or rigid command sets, limiting generalization to novel instructions. Similar constraints apply in synthetic biology and bioengineering, where the locus of control is often genomic rather than environmental perturbation. A key open question is whether artificial or biological collectives can be guided by free-form natural language alone, without task-specific tuning or carefully designed evaluation metrics. We provide one possible answer here by showing, for the first time, that simple agents' collective behavior can be guided by free-form language prompts: one AI model transforms an imperative prompt into an intervention that is applied to simulated cells; a second AI model scores how well the prompt describes the resulting cellular dynamics; and the former AI model is evolved to improve the scores generated by the latter. Unlike previous work, our method does not require engineered fitness functions or domain-specific prompt design. We show that the evolved system generalizes to unseen prompts without retraining. By treating natural language as a control layer, the system suggests a future in which spoken or written prompts could direct computational, robotic, or biological systems to desired behaviors. This work provides a concrete step toward this vision of AI-biology partnerships, in which language replaces mathematical objective functions, fixed rules, and domain-specific programming.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 39 references that are in the map. First posted on arXiv 12 Sep 2025.
Builds on
20 of 39 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
- 2023Language to Rewards for Robotic Skill Synthesiscited by 312
- 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 258
- 2023Large Language Models for Robotics: A Surveycited by 133
8 more
- 2023A Text-guided Protein Design Frameworkcited by 64
- 2021Molformer: Motif-based Transformer on 3D Heterogeneous Molecular Graphscited by 44
- 2024Automating the Search for Artificial Life with Foundation Modelscited by 20
- 2024From Text to Life: On the Reciprocal Relationship between Artificial Life and Large Language Modelscited by 8
- 2024LifeGPT: Topology-Agnostic Generative Pretrained Transformer Model for Cellular Automatacited by 8
- 2019Word2vec to behavior: morphology facilitates the grounding of language in machinescited by 3
- 2024Emergent Collective Reproduction via Evolving Neuronal Flockscited by 2
- 2025Giving Simulated Cells a Voice: Evolving Prompt-to-Intervention Models for Cellular Controlcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.