mlsanityData to 7 Oct 2026

Broadening Access to Simulations for End-Users via Large Language Models: Challenges and Opportunities

arXiv 2409.15290 ↗First posted 3 Sep 2024cs.HC cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) are becoming ubiquitous to create intelligent virtual assistants that assist users in interacting with a system, as exemplified in marketing. Although LLMs have been discussed in Modeling & Simulation (M&S), the community has focused on generating code or explaining results. We examine the possibility of using LLMs to broaden access to simulations, by enabling non-simulation end-users to ask what-if questions in everyday language. Specifically, we discuss the opportunities and challenges in designing such an end-to-end system, divided into three broad phases. First, assuming the general case in which several simulation models are available, textual queries are mapped to the most relevant model. Second, if a mapping cannot be found, the query can be automatically reformulated and clarifying questions can be generated. Finally, simulation results are produced and contextualized for decision-making. Our vision for such system articulates long-term research opportunities spanning M&S, LLMs, information retrieval, and ethics.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 25 of its 60 references that are in the map. First posted on arXiv 3 Sep 2024.

Builds on

25 of 60 references.

References · 25

  1. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  2. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
  3. 2019Adversarial NLI: A New Benchmark for Natural Language Understandingcited by 798
  4. 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 578
  5. 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 550
  6. 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 402
  7. 2020Asking and Answering Questions to Evaluate the Factual Consistency of Summariescited by 376
  8. 2020FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarizationcited by 292
  9. 2023Table Meets LLM: Can Large Language Models Understand Structured Table Data? A Benchmark and Empirical Studycited by 116
  10. 2018Learning to Ask Good Questions: Ranking Clarification Questions using Neural Expected Value of Perfect Informationcited by 110
  11. 2023Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluationscited by 96
  12. 2024LLM-based NLG Evaluation: Current Status and Challengescited by 71
13 more
  1. 2024Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questionscited by 32
  2. 2023Generative Query Reformulation for Effective Adhoc Searchcited by 24
  3. 2023Exploiting Simulated User Feedback for Conversational Search: Ranking, Rewriting, and Beyondcited by 23
  4. 2024Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chatcited by 23
  5. 2024Ask Optimal Questions: Aligning Large Language Models with Retriever's Preference in Conversationcited by 23
  6. 2024GenQREnsemble: Zero-Shot LLM Ensemble Prompting for Generative Query Reformulationcited by 22
  7. 2023Generative Agent-Based Modeling: Unveiling Social System Dynamics through Coupling Mechanistic Models with Generative Artificial Intelligencecited by 19
  8. 2023Context Aware Query Rewriting for Text Rankers using LLMcited by 14
  9. 2023Large Language Model (LLM) Bias Index -- LLMBIcited by 14
  10. 2024From Text to Map: A System Dynamics Bot for Constructing Causal Loop Diagramscited by 7
  11. 2023Beyond Semantics: Learning a Behavior Augmented Relevance Model with Self-supervised Learningcited by 4
  12. 2024Solution-oriented Agent-based Models Generation with Verifier-assisted Iterative In-context Learningcited by 2
  13. 2023CloudSim Express: A Novel Framework for Rapid Low Code Simulation of Cloud Computing Environmentscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.