LLM experiments with simulation: Large Language Model Multi-Agent System for Simulation Model Parametrization in Digital Twins
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
This paper presents a novel design of a multi-agent system framework that applies large language models (LLMs) to automate the parametrization of simulation models in digital twins. This framework features specialized LLM agents tasked with observing, reasoning, decision-making, and summarizing, enabling them to dynamically interact with digital twin simulations to explore parametrization possibilities and determine feasible parameter settings to achieve an objective. The proposed approach enhances the usability of simulation model by infusing it with knowledge heuristics from LLM and enables autonomous search for feasible parametrization to solve a user task. Furthermore, the system has the potential to increase user-friendliness and reduce the cognitive load on human users by assisting in complex decision-making processes. The effectiveness and functionality of the system are demonstrated through a case study, and the visualized demos and codes are available at a GitHub Repository: https://github.com/YuchenXia/LLMDrivenSimulation
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 12 of its 16 references that are in the map. First posted on arXiv 28 May 2024.
Builds on
12 of 16 references.
Closest ancestors · 2
Same direction, newest first
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges21 Jan
- 2023Towards autonomous system: flexible modular production system enhanced with large language model agents28 Apr
Other references · 10
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023MetaAgents: Large Language Model Based Agents for Decision-Making on Teamingcited by 85
- 2023Large Language Models Play StarCraft II: Benchmarks and A Chain of Summarization Approachcited by 79
- 2024Generation of Asset Administration Shell with Large Language Model Agents: Toward Semantic Interoperability in Digital Twins in the Context of Industry 4.0cited by 8
- 2023A Modular System Architecture for an Offshore Off-grid Platform for Climate neutral Power-to-X Production in H2Marecited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 5; 2026: 10.
16 papers.
Sort:
By area:
- 2026A Survey on Evaluating Quality and Trustworthiness in LLM-Generated Datacited by 5
- 2026ORCH: many analyses, one merge-a deterministic multi-agent orchestrator for discrete-choice reasoning with EMA-guided routingcited by 5
- 2025Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Makingcited by 4
- 2026Digital Twin AI: Opportunities and Challenges from Large Language Models to World Modelscited by 4
- 2024SimBench: A Framework for Evaluating and Diagnosing LLM-Based Digital-Twin Generation for Multi-Physics Simulationcited by 3
- 2025Evolution in Simulation: AI-Agent School with Dual Memory for High-Fidelity Educational Dynamicscited by 3
- 2025Benchmarking Chinese Medical LLMs: A Medbench-based Analysis of Performance Gaps and Hierarchical Optimization Strategiescited by 2
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agentscited by 2
- 2026A Guide to Large Language Models in Modeling and Simulation: From Core Techniques to Critical Challengescited by 2
- 2026AutoMS: Multi-Agent Evolutionary Search for Cross-Physics Inverse Microstructure Designcited by 1
- 2026Foundation-Model-Based Agents in Industrial Automation: Purposes, Capabilities, and Open Challengescited by 1
- 2026Simulation Code Generation for Fluid Systems using Large Language Models: Benchmarking Models and Prompting Strategiescited by 1
4 more
- 2025Argus: A Multi-Agent Sensitive Information Leakage Detection Framework Based on Hierarchical Reference Relationshipscited by 0
- 2026Agri-SAGE: Simulation-Grounded Multi-Agent LLM for Context-Aware Agricultural Advisory Generationcited by 0
- 2026LLM Agents Perform Controlled Experiments Using Simulation Modelscited by 0
- 2026APEX: An Extensible Model for Agent-Assisted Production Schedulingcited by 0
- 2026APEX: An Extensible Model for Agent-Assisted Production Scheduling27 Sep 2026
- 2026LLM Agents Perform Controlled Experiments Using Simulation Models22 Aug 2026
- 2026Simulation Code Generation for Fluid Systems using Large Language Models: Benchmarking Models and Prompting Strategies31 Jul 2026
- 2026Agri-SAGE: Simulation-Grounded Multi-Agent LLM for Context-Aware Agricultural Advisory Generation1 Jul 2026
- 2026Foundation-Model-Based Agents in Industrial Automation: Purposes, Capabilities, and Open Challenges4 May 2026
- 2026AutoMS: Multi-Agent Evolutionary Search for Cross-Physics Inverse Microstructure Design28 Mar 2026
- 2026A Guide to Large Language Models in Modeling and Simulation: From Core Techniques to Critical Challenges5 Feb 2026
- 2026ORCH: many analyses, one merge-a deterministic multi-agent orchestrator for discrete-choice reasoning with EMA-guided routing2 Feb 2026
- 2026A Survey on Evaluating Quality and Trustworthiness in LLM-Generated Data25 Jan 2026
- 2026Digital Twin AI: Opportunities and Challenges from Large Language Models to World Models4 Jan 2026
- 2025Argus: A Multi-Agent Sensitive Information Leakage Detection Framework Based on Hierarchical Reference Relationships9 Dec 2025
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agents20 Oct 2025
4 more
- 2025Evolution in Simulation: AI-Agent School with Dual Memory for High-Fidelity Educational Dynamics13 Oct 2025
- 2025Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Making19 May 2025
- 2025Benchmarking Chinese Medical LLMs: A Medbench-based Analysis of Performance Gaps and Hierarchical Optimization Strategies10 Mar 2025
- 2024SimBench: A Framework for Evaluating and Diagnosing LLM-Based Digital-Twin Generation for Multi-Physics Simulation21 Aug 2024
- 2025Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Makingcited by 4
- 2025Evolution in Simulation: AI-Agent School with Dual Memory for High-Fidelity Educational Dynamicscited by 3
- 2026AutoMS: Multi-Agent Evolutionary Search for Cross-Physics Inverse Microstructure Designcited by 1
- 2026Foundation-Model-Based Agents in Industrial Automation: Purposes, Capabilities, and Open Challengescited by 1
- 2025Argus: A Multi-Agent Sensitive Information Leakage Detection Framework Based on Hierarchical Reference Relationshipscited by 0
- 2026Agri-SAGE: Simulation-Grounded Multi-Agent LLM for Context-Aware Agricultural Advisory Generationcited by 0
- 2026LLM Agents Perform Controlled Experiments Using Simulation Modelscited by 0
- 2026APEX: An Extensible Model for Agent-Assisted Production Schedulingcited by 0
- 2026APEX: An Extensible Model for Agent-Assisted Production Scheduling27 Sep 2026
- 2026LLM Agents Perform Controlled Experiments Using Simulation Models22 Aug 2026
- 2026Agri-SAGE: Simulation-Grounded Multi-Agent LLM for Context-Aware Agricultural Advisory Generation1 Jul 2026
- 2026Foundation-Model-Based Agents in Industrial Automation: Purposes, Capabilities, and Open Challenges4 May 2026
- 2026AutoMS: Multi-Agent Evolutionary Search for Cross-Physics Inverse Microstructure Design28 Mar 2026
- 2025Argus: A Multi-Agent Sensitive Information Leakage Detection Framework Based on Hierarchical Reference Relationships9 Dec 2025
- 2025Evolution in Simulation: AI-Agent School with Dual Memory for High-Fidelity Educational Dynamics13 Oct 2025
- 2025Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Making19 May 2025
- 2024SimBench: A Framework for Evaluating and Diagnosing LLM-Based Digital-Twin Generation for Multi-Physics Simulationcited by 3
- 2025Benchmarking Chinese Medical LLMs: A Medbench-based Analysis of Performance Gaps and Hierarchical Optimization Strategiescited by 2
- 2026A Guide to Large Language Models in Modeling and Simulation: From Core Techniques to Critical Challengescited by 2
- 2026Simulation Code Generation for Fluid Systems using Large Language Models: Benchmarking Models and Prompting Strategiescited by 1
- 2026Simulation Code Generation for Fluid Systems using Large Language Models: Benchmarking Models and Prompting Strategies31 Jul 2026
- 2026A Guide to Large Language Models in Modeling and Simulation: From Core Techniques to Critical Challenges5 Feb 2026
- 2025Benchmarking Chinese Medical LLMs: A Medbench-based Analysis of Performance Gaps and Hierarchical Optimization Strategies10 Mar 2025
- 2024SimBench: A Framework for Evaluating and Diagnosing LLM-Based Digital-Twin Generation for Multi-Physics Simulation21 Aug 2024
Similar, not cited
Close in wording, no citation either way
- 2024Synergistic Simulations: Multi-Agent Problem Solving with Large Language Models
- 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Application
- 2024LLM-Augmented Agent-Based Modelling for Social Simulations: Challenges and Opportunities
- 2025LLM-Agent-Controller: A Universal Multi-Agent Large Language Model System as a Control Engineer
- 2025LLMs Working in Harmony: A Survey on the Technological Aspects of Building Effective LLM-Based Multi Agent Systems
- 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey
- 2023A Survey on Large Language Model based Autonomous Agents
- 2025From Language to Action: A Review of Large Language Models as Autonomous Agents and Tool Users