Large Language Model Agent as a Mechanical Designer
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Conventional mechanical design follows an iterative process in which initial concepts are refined through cycles of expert assessment and resource-intensive Finite Element Method (FEM) analysis to meet performance goals. While machine learning models have been developed to assist in parts of this process, they typically require large datasets, extensive training, and are often tailored to specific tasks, limiting their generalizability. To address these limitations, we propose a framework that leverages a pretrained Large Language Model (LLM) in conjunction with an FEM module to autonomously generate, evaluate, and refine structural designs based on performance specifications and numerical feedback. The LLM operates without domain-specific fine-tuning, using general reasoning to propose design candidates, interpret FEM-derived performance metrics, and apply structurally sound modifications. Using 2D truss structures as a testbed, we show that the LLM can effectively navigate highly discrete and multi-faceted design spaces, balance competing objectives, and identify convergence when further optimization yields diminishing returns. Compared to Non-dominated Sorting Genetic Algorithm II (NSGA-II), our method achieves faster convergence and fewer FEM evaluations. Experiments with varying temperature settings (0.5, 1.0, 1.2) and model sizes (GPT-4.1 and GPT-4.1-mini) indicate that smaller models yield higher constraint satisfaction with fewer steps, while lower temperatures enhance design consistency. These results establish LLMs as a promising new class of reasoning-based, natural language-driven optimizers for autonomous design and iterative structural refinement.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 56 of its 119 references that are in the map. First posted on arXiv 26 Apr 2024.
Builds on
56 of 119 references.
References · 56
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2023A Survey of Large Language Modelscited by 2,537
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
38 more
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
- 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 486
- 2021A Survey of Transformerscited by 399
- 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 387
- 2021True Few-Shot Learning with Language Modelscited by 343
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 266
- 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
- 2022Selective Annotation Makes Language Models Better Few-Shot Learnerscited by 242
- 2022Emergent Analogical Reasoning in Large Language Modelscited by 239
- 2020pymoo: Multi-objective Optimization in Pythoncited by 196
- 2022Active Example Selection for In-Context Learningcited by 195
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 128
- 2023A Comprehensive Survey of Dataset Distillationcited by 114
- 2018MeshNet: Mesh Neural Network for 3D Shape Representationcited by 95
- 2022Diffusion Models Beat GANs on Topology Optimizationcited by 79
- 2022SolidGen: An Autoregressive Model for Direct B-rep Synthesiscited by 78
- 2021SketchGen: Generating Constrained CAD Sketchescited by 68
- 2020TopologyGAN: Topology Optimization Using Generative Adversarial Networks Based on Physical Fields Over the Initial Domaincited by 65
- 2022A Taxonomy of Prompt Modifiers for Text-To-Image Generationcited by 54
- 2023From Concept to Manufacturing: Evaluating Vision-Language Models for Engineering Designcited by 51
- 2020Geometric deep learning for computational mechanics Part I: Anisotropic Hyperelasticitycited by 49
- 2021Engineering Sketch Generation for Computer-Aided Designcited by 49
- 2023Evaluating Large Language Models on a Highly-specialized Topic, Radiation Oncology Physicscited by 49
- 2023A Practical Survey on Zero-shot Prompt Design for In-context Learningcited by 49
- 2023How Can Large Language Models Help Humans in Design and Manufacturing?cited by 41
- 2017Neural networks for topology optimizationcited by 39
- 2023MechGPT, a language-based strategy for mechanics and materials modeling that connects knowledge across scales, disciplines and modalitiescited by 38
- 2023Large Language Models as Master Key: Unlocking the Secrets of Materials Science with GPTcited by 29
- 2022Generative Transformers for Design Concept Generationcited by 21
- 2023Recent Advances and Applications of Machine Learning in Experimental Solid Mechanics: A Reviewcited by 15
- 2021Real-Time Topology Optimization in 3D via Deep Transfer Learningcited by 14
- 2023Inexpensive High Fidelity Melt Pool Models in Additive Manufacturing Using Generative Deep Diffusioncited by 11
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2024: 2; 2025: 12; 2026: 6.
20 papers.
Sort:
By area:
- 2024LLM-3D Print: Large Language Models To Monitor and Control 3D Printingcited by 18
- 2025Large Language Model Agent for Modular Task Execution in Drug Discoverycited by 12
- 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physicscited by 11
- 2024Adsorb-Agent: Autonomous Identification of Stable Adsorption Configurations via Large Language Model Agentcited by 8
- 2025NANOGPT: A Query-Driven Large Language Model Retrieval-Augmented Generation System for Nanotechnology Researchcited by 6
- 2025AdditiveLLM: Large Language Models Predict Defects in Additive Manufacturingcited by 5
- 2025LLM-Agent-Controller: A Universal Multi-Agent Large Language Model System as a Control Engineercited by 5
- 2025CFDLLMBench: A Benchmark Suite for Evaluating Large Language Models in Computational Fluid Dynamicscited by 5
- 2025Toward Autonomous Engineering Design: A Knowledge-Guided Multi-Agent Frameworkcited by 5
- 2025Generative Reliability-Based Design Optimization Using In-Context Learning Capabilities of Large Language Modelscited by 3
- 2025Generative AI for CAD Automation: Leveraging Large Language Models for 3D Modellingcited by 2
- 2025Human-in-the-Loop: Quantitative Evaluation of 3D Models Generation by Large Language Modelscited by 2
8 more
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agentscited by 2
- 2026TurboAgent: An LLM-Driven Autonomous Multi-Agent Framework for Turbomachinery Aerodynamic Designcited by 1
- 2026Foundation-Model-Based Agents in Industrial Automation: Purposes, Capabilities, and Open Challengescited by 1
- 2025AI Judges in Design: Statistical Perspectives on Achieving Human Expert Equivalence With Vision-Language Modelscited by 0
- 2026Material Database Agent: A Multimodal Agentic Framework for Scientific Literature Miningcited by 0
- 2026Self-Refining Topology Optimization via an LLM-Based Multi-Agent Frameworkcited by 0
- 2026Enhancing Creativity in 3D Generative Design via a TRIZ-Inspired Text-to-CAD Frameworkcited by 0
- 2026Large Language Models and their Awareness of Mechanics and Spatial Geometrycited by 0
- 2026Large Language Models and their Awareness of Mechanics and Spatial Geometry10 Jul 2026
- 2026Enhancing Creativity in 3D Generative Design via a TRIZ-Inspired Text-to-CAD Framework19 Jun 2026
- 2026Self-Refining Topology Optimization via an LLM-Based Multi-Agent Framework22 May 2026
- 2026Material Database Agent: A Multimodal Agentic Framework for Scientific Literature Mining5 May 2026
- 2026Foundation-Model-Based Agents in Industrial Automation: Purposes, Capabilities, and Open Challenges4 May 2026
- 2026TurboAgent: An LLM-Driven Autonomous Multi-Agent Framework for Turbomachinery Aerodynamic Design8 Apr 2026
- 2025Toward Autonomous Engineering Design: A Knowledge-Guided Multi-Agent Framework5 Nov 2025
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agents20 Oct 2025
- 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physics10 Oct 2025
- 2025CFDLLMBench: A Benchmark Suite for Evaluating Large Language Models in Computational Fluid Dynamics19 Sep 2025
- 2025Human-in-the-Loop: Quantitative Evaluation of 3D Models Generation by Large Language Models6 Sep 2025
- 2025Generative AI for CAD Automation: Leveraging Large Language Models for 3D Modelling5 Jul 2025
8 more
- 2025Large Language Model Agent for Modular Task Execution in Drug Discovery26 Jun 2025
- 2025LLM-Agent-Controller: A Universal Multi-Agent Large Language Model System as a Control Engineer26 May 2025
- 2025AI Judges in Design: Statistical Perspectives on Achieving Human Expert Equivalence With Vision-Language Models1 Apr 2025
- 2025Generative Reliability-Based Design Optimization Using In-Context Learning Capabilities of Large Language Models28 Mar 2025
- 2025NANOGPT: A Query-Driven Large Language Model Retrieval-Augmented Generation System for Nanotechnology Research27 Feb 2025
- 2025AdditiveLLM: Large Language Models Predict Defects in Additive Manufacturing29 Jan 2025
- 2024Adsorb-Agent: Autonomous Identification of Stable Adsorption Configurations via Large Language Model Agent22 Oct 2024
- 2024LLM-3D Print: Large Language Models To Monitor and Control 3D Printing26 Aug 2024
- 2025Large Language Model Agent for Modular Task Execution in Drug Discoverycited by 12
- 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physicscited by 11
- 2024Adsorb-Agent: Autonomous Identification of Stable Adsorption Configurations via Large Language Model Agentcited by 8
- 2025LLM-Agent-Controller: A Universal Multi-Agent Large Language Model System as a Control Engineercited by 5
- 2025Toward Autonomous Engineering Design: A Knowledge-Guided Multi-Agent Frameworkcited by 5
- 2026Foundation-Model-Based Agents in Industrial Automation: Purposes, Capabilities, and Open Challengescited by 1
- 2026Material Database Agent: A Multimodal Agentic Framework for Scientific Literature Miningcited by 0
- 2026Self-Refining Topology Optimization via an LLM-Based Multi-Agent Frameworkcited by 0
- 2026Self-Refining Topology Optimization via an LLM-Based Multi-Agent Framework22 May 2026
- 2026Material Database Agent: A Multimodal Agentic Framework for Scientific Literature Mining5 May 2026
- 2026Foundation-Model-Based Agents in Industrial Automation: Purposes, Capabilities, and Open Challenges4 May 2026
- 2025Toward Autonomous Engineering Design: A Knowledge-Guided Multi-Agent Framework5 Nov 2025
- 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physics10 Oct 2025
- 2025Large Language Model Agent for Modular Task Execution in Drug Discovery26 Jun 2025
- 2025LLM-Agent-Controller: A Universal Multi-Agent Large Language Model System as a Control Engineer26 May 2025
- 2024Adsorb-Agent: Autonomous Identification of Stable Adsorption Configurations via Large Language Model Agent22 Oct 2024
- 2024LLM-3D Print: Large Language Models To Monitor and Control 3D Printingcited by 18
- 2025AdditiveLLM: Large Language Models Predict Defects in Additive Manufacturingcited by 5
- 2025CFDLLMBench: A Benchmark Suite for Evaluating Large Language Models in Computational Fluid Dynamicscited by 5
- 2025Generative Reliability-Based Design Optimization Using In-Context Learning Capabilities of Large Language Modelscited by 3
- 2025Generative AI for CAD Automation: Leveraging Large Language Models for 3D Modellingcited by 2
- 2025Human-in-the-Loop: Quantitative Evaluation of 3D Models Generation by Large Language Modelscited by 2
- 2026TurboAgent: An LLM-Driven Autonomous Multi-Agent Framework for Turbomachinery Aerodynamic Designcited by 1
- 2026Enhancing Creativity in 3D Generative Design via a TRIZ-Inspired Text-to-CAD Frameworkcited by 0
- 2026Large Language Models and their Awareness of Mechanics and Spatial Geometrycited by 0
- 2026Large Language Models and their Awareness of Mechanics and Spatial Geometry10 Jul 2026
- 2026Enhancing Creativity in 3D Generative Design via a TRIZ-Inspired Text-to-CAD Framework19 Jun 2026
- 2026TurboAgent: An LLM-Driven Autonomous Multi-Agent Framework for Turbomachinery Aerodynamic Design8 Apr 2026
- 2025CFDLLMBench: A Benchmark Suite for Evaluating Large Language Models in Computational Fluid Dynamics19 Sep 2025
- 2025Human-in-the-Loop: Quantitative Evaluation of 3D Models Generation by Large Language Models6 Sep 2025
- 2025Generative AI for CAD Automation: Leveraging Large Language Models for 3D Modelling5 Jul 2025
- 2025Generative Reliability-Based Design Optimization Using In-Context Learning Capabilities of Large Language Models28 Mar 2025
- 2025AdditiveLLM: Large Language Models Predict Defects in Additive Manufacturing29 Jan 2025
- 2024LLM-3D Print: Large Language Models To Monitor and Control 3D Printing26 Aug 2024
Similar, not cited
Close in wording, no citation either way
- 2025A Multidisciplinary Design and Optimization (MDO) Agent Driven by Large Language Models
- 2025A Large Language Model-Empowered Agent for Reliable and Robust Structural Analysis
- 2025A Lightweight Large Language Model-Based Multi-Agent System for 2D Frame Structural Analysis
- 2026ALL-FEM: Agentic Large Language models Fine-tuned for Finite Element Methods
- 2025Automating modeling in mechanics: LLMs as designers of physics-constrained neural networks for constitutive modeling of materials
- 2026From Perception to Autonomous Computational Modeling: A Multi-Agent Approach
- 2026Closed-loop AI achieves certifiable engineering design
- 2025Automating Structural Engineering Workflows with Large Language Model Agents