GPT-Based Models Meet Simulation: How to Efficiently Use Large-Scale Pre-Trained Language Models Across Simulation Tasks
Not on the map. Why?
Abstract (arXiv)
The disruptive technology provided by large-scale pre-trained language models (LLMs) such as ChatGPT or GPT-4 has received significant attention in several application domains, often with an emphasis on high-level opportunities and concerns. This paper is the first examination regarding the use of LLMs for scientific simulations. We focus on four modeling and simulation tasks, each time assessing the expected benefits and limitations of LLMs while providing practical guidance for modelers regarding the steps involved. The first task is devoted to explaining the structure of a conceptual model to promote the engagement of participants in the modeling process. The second task focuses on summarizing simulation outputs, so that model users can identify a preferred scenario. The third task seeks to broaden accessibility to simulation platforms by conveying the insights of simulation visualizations via text. Finally, the last task evokes the possibility of explaining simulation errors and providing guidance to resolve them.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 18 of its 67 references that are in the map. First posted on arXiv 21 Jun 2023.
Builds on
18 of 67 references.
References · 18
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2020Efficient Transformers: A Surveycited by 790
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
- 2022Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Modelcited by 559
- 2022Predictability and Surprise in Large Generative Modelscited by 210
- 2017Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluationcited by 206
- 2023A Categorical Archive of ChatGPT Failurescited by 168
- 2023Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Modelscited by 148
- 2023Can large language models build causal graphs?cited by 73
- 2023Understanding Causality with Large Language Models: Feasibility and Opportunitiescited by 53
- 2023ArguGPT: evaluating, understanding and identifying argumentative essays generated by GPT modelscited by 42
6 more
- 2023Explainable Automated Debugging via Large Language Model-driven Scientific Debuggingcited by 40
- 2021Accessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic Contentcited by 39
- 2023Fully Autonomous Programming with Large Language Modelscited by 31
- 2021A Survey of Natural Language Generationcited by 13
- 2022Rich Screen Reader Experiences for Accessible Data Visualizationcited by 12
- 2022Innovations in Neural Data-to-text Generation: A Surveycited by 10
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 3; 2026: 6.
14 papers.
Sort:
By area:
- 2024Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agentscited by 48
- 2023Smart Agent-Based Modeling: On the Use of Large Language Models in Computer Simulationscited by 11
- 2024KAUCUS: Knowledge Augmented User Simulators for Training Language Model Assistantscited by 4
- 2024Large Language Models for Explainable Decisions in Dynamic Digital Twinscited by 4
- 2025Large Language Models for Agent-Based Modelling: Current and possible uses across the modelling cyclecited by 4
- 2026AI Agents as Policymakers in Simulated Epidemicscited by 4
- 2024Exploring the Potential of Conversational AI Support for Agent-Based Social Simulation Model Designcited by 2
- 2025Unlocking the Potential of Past Research: Using Generative AI to Reconstruct Healthcare Simulation Modelscited by 2
- 2025Scalable, Symbiotic, AI and Non-AI Agent Based Parallel Discrete Event Simulationscited by 1
- 2026On Integrating Resilience and Human Oversight into LLM-Assisted Modeling Workflows for Digital Twinscited by 1
- 2026Generative Artificial Intelligence (GenAI) to convert images of queuing networks into verifiable simulation models: an open-weight LLM workflow approachcited by 0
- 2026Artificial Intelligence and Modeling & Simulation: An Overviewcited by 0
2 more
- 2026Do Personality-Tuned LLMs Make Better Social Agents?18 Sep 2026
- 2026LLM-based Framework for Generating and Verifying Parallel DEVS Statecharts15 Aug 2026
- 2026Artificial Intelligence and Modeling & Simulation: An Overview1 Aug 2026
- 2026Generative Artificial Intelligence (GenAI) to convert images of queuing networks into verifiable simulation models: an open-weight LLM workflow approach27 Jul 2026
- 2026On Integrating Resilience and Human Oversight into LLM-Assisted Modeling Workflows for Digital Twins26 Mar 2026
- 2026AI Agents as Policymakers in Simulated Epidemics6 Jan 2026
- 2025Large Language Models for Agent-Based Modelling: Current and possible uses across the modelling cycle8 Jul 2025
- 2025Scalable, Symbiotic, AI and Non-AI Agent Based Parallel Discrete Event Simulations28 May 2025
- 2025Unlocking the Potential of Past Research: Using Generative AI to Reconstruct Healthcare Simulation Models27 Mar 2025
- 2024Large Language Models for Explainable Decisions in Dynamic Digital Twins23 May 2024
- 2024Exploring the Potential of Conversational AI Support for Agent-Based Social Simulation Model Design12 May 2024
- 2024Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agents19 Feb 2024
- 2024Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agentscited by 48
- 2023Smart Agent-Based Modeling: On the Use of Large Language Models in Computer Simulationscited by 11
- 2025Large Language Models for Agent-Based Modelling: Current and possible uses across the modelling cyclecited by 4
- 2026LLM-based Framework for Generating and Verifying Parallel DEVS Statechartscited by 0
- 2026Do Personality-Tuned LLMs Make Better Social Agents?cited by 0
- 2026Do Personality-Tuned LLMs Make Better Social Agents?18 Sep 2026
- 2026LLM-based Framework for Generating and Verifying Parallel DEVS Statecharts15 Aug 2026
- 2025Large Language Models for Agent-Based Modelling: Current and possible uses across the modelling cycle8 Jul 2025
- 2024Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agents19 Feb 2024
- 2023Smart Agent-Based Modeling: On the Use of Large Language Models in Computer Simulations10 Nov 2023
- 2024KAUCUS: Knowledge Augmented User Simulators for Training Language Model Assistantscited by 4
- 2024Large Language Models for Explainable Decisions in Dynamic Digital Twinscited by 4
- 2026AI Agents as Policymakers in Simulated Epidemicscited by 4
- 2024Exploring the Potential of Conversational AI Support for Agent-Based Social Simulation Model Designcited by 2
- 2025Unlocking the Potential of Past Research: Using Generative AI to Reconstruct Healthcare Simulation Modelscited by 2
- 2025Scalable, Symbiotic, AI and Non-AI Agent Based Parallel Discrete Event Simulationscited by 1
- 2026On Integrating Resilience and Human Oversight into LLM-Assisted Modeling Workflows for Digital Twinscited by 1
- 2026Generative Artificial Intelligence (GenAI) to convert images of queuing networks into verifiable simulation models: an open-weight LLM workflow approachcited by 0
- 2026Artificial Intelligence and Modeling & Simulation: An Overviewcited by 0
- 2026Artificial Intelligence and Modeling & Simulation: An Overview1 Aug 2026
- 2026Generative Artificial Intelligence (GenAI) to convert images of queuing networks into verifiable simulation models: an open-weight LLM workflow approach27 Jul 2026
- 2026On Integrating Resilience and Human Oversight into LLM-Assisted Modeling Workflows for Digital Twins26 Mar 2026
- 2026AI Agents as Policymakers in Simulated Epidemics6 Jan 2026
- 2025Scalable, Symbiotic, AI and Non-AI Agent Based Parallel Discrete Event Simulations28 May 2025
- 2025Unlocking the Potential of Past Research: Using Generative AI to Reconstruct Healthcare Simulation Models27 Mar 2025
- 2024Large Language Models for Explainable Decisions in Dynamic Digital Twins23 May 2024
- 2024Exploring the Potential of Conversational AI Support for Agent-Based Social Simulation Model Design12 May 2024
- 2024KAUCUS: Knowledge Augmented User Simulators for Training Language Model Assistants29 Jan 2024