Broadening Access to Simulations for End-Users via Large Language Models: Challenges and Opportunities
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) are becoming ubiquitous to create intelligent virtual assistants that assist users in interacting with a system, as exemplified in marketing. Although LLMs have been discussed in Modeling & Simulation (M&S), the community has focused on generating code or explaining results. We examine the possibility of using LLMs to broaden access to simulations, by enabling non-simulation end-users to ask what-if questions in everyday language. Specifically, we discuss the opportunities and challenges in designing such an end-to-end system, divided into three broad phases. First, assuming the general case in which several simulation models are available, textual queries are mapped to the most relevant model. Second, if a mapping cannot be found, the query can be automatically reformulated and clarifying questions can be generated. Finally, simulation results are produced and contextualized for decision-making. Our vision for such system articulates long-term research opportunities spanning M&S, LLMs, information retrieval, and ethics.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 25 of its 60 references that are in the map. First posted on arXiv 3 Sep 2024.
Builds on
25 of 60 references.
References · 25
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
- 2019Adversarial NLI: A New Benchmark for Natural Language Understandingcited by 798
- 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 578
- 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 550
- 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 402
- 2020Asking and Answering Questions to Evaluate the Factual Consistency of Summariescited by 376
- 2020FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarizationcited by 292
- 2023Table Meets LLM: Can Large Language Models Understand Structured Table Data? A Benchmark and Empirical Studycited by 116
- 2018Learning to Ask Good Questions: Ranking Clarification Questions using Neural Expected Value of Perfect Informationcited by 110
- 2023Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluationscited by 96
- 2024LLM-based NLG Evaluation: Current Status and Challengescited by 71
13 more
- 2024Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questionscited by 32
- 2023Generative Query Reformulation for Effective Adhoc Searchcited by 24
- 2023Exploiting Simulated User Feedback for Conversational Search: Ranking, Rewriting, and Beyondcited by 23
- 2024Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chatcited by 23
- 2024Ask Optimal Questions: Aligning Large Language Models with Retriever's Preference in Conversationcited by 23
- 2024GenQREnsemble: Zero-Shot LLM Ensemble Prompting for Generative Query Reformulationcited by 22
- 2023Generative Agent-Based Modeling: Unveiling Social System Dynamics through Coupling Mechanistic Models with Generative Artificial Intelligencecited by 19
- 2023Context Aware Query Rewriting for Text Rankers using LLMcited by 14
- 2023Large Language Model (LLM) Bias Index -- LLMBIcited by 14
- 2024From Text to Map: A System Dynamics Bot for Constructing Causal Loop Diagramscited by 7
- 2023Beyond Semantics: Learning a Behavior Augmented Relevance Model with Self-supervised Learningcited by 4
- 2024Solution-oriented Agent-based Models Generation with Verifier-assisted Iterative In-context Learningcited by 2
- 2023CloudSim Express: A Novel Framework for Rapid Low Code Simulation of Cloud Computing Environmentscited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025Unlocking the Potential of Past Research: Using Generative AI to Reconstruct Healthcare Simulation Modelscited by 2
- 2025Using (Not-so) Large Language Models to Generate Simulation Models in a Formal DSL: A Study on Reaction Networkscited by 1
- 2026Generative Artificial Intelligence (GenAI) to convert images of queuing networks into verifiable simulation models: an open-weight LLM workflow approachcited by 0
- 2026Artificial Intelligence and Modeling & Simulation: An Overviewcited by 0
- 2026Artificial Intelligence and Modeling & Simulation: An Overview1 Aug 2026
- 2026Generative Artificial Intelligence (GenAI) to convert images of queuing networks into verifiable simulation models: an open-weight LLM workflow approach27 Jul 2026
- 2025Unlocking the Potential of Past Research: Using Generative AI to Reconstruct Healthcare Simulation Models27 Mar 2025
- 2025Using (Not-so) Large Language Models to Generate Simulation Models in a Formal DSL: A Study on Reaction Networks3 Mar 2025