mlsanityData to 7 Oct 2026

Generative Artificial Intelligence (GenAI) to convert images of queuing networks into verifiable simulation models: an open-weight LLM workflow approach

arXiv 2607.24259 ↗First posted 27 Jul 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent work has explored the use of Large Language Models (LLMs) to automate simulation model building, typically by generating executable code directly from natural language descriptions. However, this raises challenges for verification and reproducibility particularly for users without programming expertise. We propose Sketch2DES, a sketch-to-simulation workflow that converts diagrammatic representations of queuing networks into verifiable discrete-event simulation models using open-weight LLMs. The workflow has three stages: (1) translation of a diagram into a semi-structured textual description using a multimodal LLM; (2) conversion into schema-validated structured data (JSON) via an LLM with a reflection-based verification loop; and (3) deterministic transformation into an executable simulation model using a software adapter. Intermediate artefacts can therefore be inspected and automatically validated before execution. We evaluate the approach on eight queuing-network diagrams of varying complexity. The workflow achieved high reliability for all stages, and results were statistically indistinguishable from human-coded and analytical benchmarks. Compared to direct code generation, the workflow improves reproducibility, transparency, and verifiability, while reducing the need for programming expertise. Limitations include restricted model scope and dependence on accurate visual interpretation. The results demonstrate the feasibility of structured, workflow-based model generation as a robust foundation for LLM-assisted simulation modelling.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 62 references that are in the map. First posted on arXiv 27 Jul 2026.

Builds on

14 of 62 references.

References · 14

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  3. 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
  4. 2024LM4OPT: Unveiling the Potential of Large Language Models in Formulating Mathematical Optimization Problemscited by 18
  5. 2024The Open Source Advantage in Large Language Models (LLMs)cited by 18
  6. 2023GPT-Based Models Meet Simulation: How to Efficiently Use Large-Scale Pre-Trained Language Models Across Simulation Taskscited by 14
  7. 2025Unified Modeling Language Code Generation from Diagram Images Using Multimodal Large Language Modelscited by 7
  8. 2025SimuGen: Multi-modal Agentic Framework for Constructing Block Diagram-Based Simulation Modelscited by 7
  9. 2024Broadening Access to Simulations for End-Users via Large Language Models: Challenges and Opportunitiescited by 4
  10. 2025Unlocking the Potential of Past Research: Using Generative AI to Reconstruct Healthcare Simulation Modelscited by 2
  11. 2025From over-reliance to smart integration: using Large-Language Models as translators between specialized modeling and simulation toolscited by 2
  12. 2026A Guide to Large Language Models in Modeling and Simulation: From Core Techniques to Critical Challengescited by 2
2 more
  1. 2025Evaluating Open-Weight Large Language Models for Structured Data Extraction from Narrative Medical Reports Across Multiple Use Cases and Languagescited by 1
  2. 2026Text-to-Image Generative AI for Modeling and Simulation: Methods, Opportunities, and Applicationscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Simulation Streams: A Programming Paradigm for Controlling Large Language Models and Building Complex Systems with Generative AI
  2. 2025Generative Digital Twins: Vision-Language Simulation Models for Executable Industrial Systems
  3. 2026Sketch2Simulation: Automating Flowsheet Generation via Multi Agent Large Language Models
  4. 2024ChainBuddy: An AI Agent System for Generating LLM Pipelines
  5. 2025Scaling LLM Planning: NL2FLOW for Parametric Problem Generation and Rigorous Evaluation
  6. 2024AutoFlow: Automated Workflow Generation for Large Language Model Agents
  7. 2026Gecko: A Simulation Environment with Stateful Feedback for Refining Agent Tool Calls
  8. 2026Simulation-in-the-Reasoning (SiR): A Conceptual Framework for Empirically Grounded AI in Autonomous Transportation