Unlocking the Potential of Past Research: Using Generative AI to Reconstruct Healthcare Simulation Models
Not on the map. Why?
Abstract (arXiv)
Discrete-event simulation (DES) is widely used in healthcare Operations Research, but the models themselves are rarely shared. This limits their potential for reuse and long-term impact in the modelling and healthcare communities. This study explores the feasibility of using generative artificial intelligence (AI) to recreate published models using Free and Open Source Software (FOSS), based on the descriptions provided in an academic journal. Using a structured methodology, we successfully generated, tested and internally reproduced two DES models, including user interfaces. The reported results were replicated for one model, but not the other, likely due to missing information on distributions. These models are substantially more complex than AI-generated DES models published to date. Given the challenges we faced in prompt engineering, code generation, and model testing, we conclude that our iterative approach to model development, systematic comparison and testing, and the expertise of our team were necessary to the success of our recreated simulation models.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 25 of its 81 references that are in the map. First posted on arXiv 27 Mar 2025.
Builds on
25 of 81 references.
References · 25
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 759
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 692
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
13 more
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
- 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 399
- 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 332
- 2024Benchmark Data Contamination of Large Language Models: A Surveycited by 147
- 2024Seven Failure Points When Engineering a Retrieval Augmented Generation Systemcited by 139
- 2023Self-planning Code Generation with Large Language Modelscited by 124
- 2023Evaluating the Code Quality of AI-Assisted Code Generation Tools: An Empirical Study on GitHub Copilot, Amazon CodeWhisperer, and ChatGPTcited by 71
- 2024What's Wrong with Your Code Generated by Large Language Models? An Extensive Studycited by 53
- 2024Fine-Tuning and Prompt Engineering for Large Language Models-based Code Review Automationcited by 23
- 2023GPT-Based Models Meet Simulation: How to Efficiently Use Large-Scale Pre-Trained Language Models Across Simulation Taskscited by 14
- 2024Enhancing Computer Programming Education with LLMs: A Study on Effective Prompt Engineering for Python Code Generationcited by 9
- 2024Broadening Access to Simulations for End-Users via Large Language Models: Challenges and Opportunitiescited by 4
- 2022Discrete-Event Simulation in Healthcare Settings: a Reviewcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.