From Perception to Autonomous Computational Modeling: A Multi-Agent Approach
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
We present a solver-agnostic framework in which coordinated large language model (LLM) agents autonomously execute the complete computational mechanics workflow, from perceptual data of an engineering component through geometry extraction, material inference, discretisation, solver execution, uncertainty quantification, and code-compliant assessment, to an engineering report with actionable recommendations. Agents are formalised as conditioned operators on a shared context space with quality gates that introduce conditional iteration between pipeline layers. We introduce a mathematical framework for extracting engineering information from perceptual data under uncertainty using interval bounds, probability densities, and fuzzy membership functions, and introduce task-dependent conservatism to resolve the ambiguity of what `conservative' means when different limit states are governed by opposing parameter trends. The framework is demonstrated through a finite element analysis pipeline applied to a photograph of a steel L-bracket, producing a 171,504-node tetrahedral mesh, seven analyses across three boundary condition hypotheses, and a code-compliant assessment revealing structural failure with a quantified redesign. All results are presented as generated in the first autonomous iteration without manual correction, reinforcing that a professional engineer must review and sign off on any such analysis.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 71 references that are in the map. First posted on arXiv 8 Apr 2026.
Builds on
23 of 71 references.
Closest ancestors · 3
Same direction, newest first
- 2026ALL-FEM: Agentic Large Language models Fine-tuned for Finite Element Methods8 Jan
- 2025FeaGPT: an End-to-End agentic-AI for Finite Element Analysis24 Oct
- 2023MechAgents: Large language model multi-agent collaborations can solve mechanics problems, generate new data, and integrate knowledge14 Nov
Other references · 20
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2023Segment Anythingcited by 8,234
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
8 more
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,392
- 2023StarCoder: may the source be with you!cited by 799
- 2022Galactica: A Large Language Model for Sciencecited by 744
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
- 2022A new family of Constitutive Artificial Neural Networks towards automated model discoverycited by 49
- 2023MechGPT, a language-based strategy for mechanics and materials modeling that connects knowledge across scales, disciplines and modalitiescited by 38
- 2025Large language model-empowered next-generation computer-aided engineeringcited by 9
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Instrumented data for causal scientific machine learningcited by 0
- 2026A Constrained Natural-Language Interface for Variational Multi-Physics Finite Element Simulations in FEniCScited by 0
- 2026A Case-Bundle Operating Model for Coding Agents in OpenFOAM-Based CFDcited by 0
- 2026From Documented Strengths to Force Limits: Material-Informed Robotic Insertion for Construction Assemblycited by 0
- 2026From Documented Strengths to Force Limits: Material-Informed Robotic Insertion for Construction Assembly18 Sep 2026
- 2026A Case-Bundle Operating Model for Coding Agents in OpenFOAM-Based CFD15 Jul 2026
- 2026A Constrained Natural-Language Interface for Variational Multi-Physics Finite Element Simulations in FEniCS9 Jun 2026
- 2026Instrumented data for causal scientific machine learning5 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025A Lightweight Large Language Model-Based Multi-Agent System for 2D Frame Structural Analysis
- 2026VFEAgent: A Multimodal Agent Framework for End-to-End Automated Finite Element Analysis
- 2025A Large Language Model-Empowered Agent for Reliable and Robust Structural Analysis
- 2025Automating Structural Engineering Workflows with Large Language Model Agents
- 2026A Multi-AI-agent Framework Enabling End-to-end Finite Element Analysis for Solid Mechanics Problems
- 2024Large Language Model Agent as a Mechanical Designer
- 2025A Multidisciplinary Design and Optimization (MDO) Agent Driven by Large Language Models
- 2024Collaboration Dynamics and Reliability Challenges of Multi-Agent LLM Systems in Finite Element Analysis