LLM2TEA: An Agentic AI Designer for Discovery with Generative Evolutionary Multitasking
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
This paper presents LLM2TEA, a Large Language Model (LLM) driven MultiTask Evolutionary Algorithm, representing the first agentic AI designer of its kind operating with generative evolutionary multitasking (GEM). LLM2TEA enables the crossbreeding of solutions from multiple domains, fostering novel solutions that transcend disciplinary boundaries. Of particular interest is the ability to discover designs that are both novel and conforming to real-world physical specifications. LLM2TEA comprises an LLM to generate genotype samples from text prompts describing target objects, a text-to-3D generative model to produce corresponding phenotypes, a classifier to interpret its semantic representations, and a computational simulator to assess its physical properties. Novel LLM-based multitask evolutionary operators are introduced to guide the search towards high-performing, practically viable designs. Experimental results in conceptual design optimization validate the effectiveness of LLM2TEA, showing 97% to 174% improvements in the diversity of novel designs over the current text-to-3D baseline. Moreover, over 73% of the generated designs outperform the top 1% of designs produced by the text-to-3D baseline in terms of physical performance. The designs produced by LLM2TEA are not only aesthetically creative but also functional in real-world contexts. Several of these designs have been successfully 3D printed, demonstrating the ability of our approach to transform AI-generated outputs into tangible, physical designs. These designs underscore the potential of LLM2TEA as a powerful tool for complex design optimization and discovery, capable of producing novel and physically viable designs.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 22 of its 49 references that are in the map. First posted on arXiv 21 Jun 2024.
Builds on
22 of 49 references.
References · 22
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023Large Language Models as Optimizerscited by 830
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 628
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
- 2023Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discoverycited by 329
- 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 323
- 2023Large Language Models as Evolutionary Optimizerscited by 122
10 more
- 2023Language Model Crossover: Variation through Few-Shot Promptingcited by 119
- 2021Deep Generative Models in Engineering Design: A Reviewcited by 103
- 2022Black-box Prompt Learning for Pre-trained Language Modelscited by 70
- 2024A Survey on Large Language Model Hallucination via a Creativity Perspectivecited by 38
- 2024AI Hallucinations: A Misnomer Worth Clarifyingcited by 34
- 2023Large Language Model for Multi-objective Evolutionary Optimizationcited by 29
- 2023Prompt Evolution for Generative AI: A Classifier-Guided Approachcited by 9
- 2024SARD: A Human-AI Collaborative Story Generationcited by 8
- 2023Large Language and Text-to-3D Models for Engineering Design Optimizationcited by 7
- 2024Generative AI-based Prompt Evolution Engineering Design Optimization With Vision-Language Modelcited by 3
Built on by
Citing papers per year: 2025: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms
- 2024AgentSquare: Automatic LLM Agent Search in Modular Design Space
- 2024AgentGym: Evolving Large Language Model-based Agents across Diverse Environments
- 2025The FM Agent
- 2024Designing Algorithms Empowered by Language Models: An Analytical Framework, Case Studies, and Insights
- 2025Language Modeling by Language Models
- 2023The Rise and Potential of Large Language Model Based Agents: A Survey
- 2025Evolution without an Oracle: Driving Effective Evolution with LLM Judges