mlsanityData to 14 Oct 2026

From Natural Language to Simulations: Applying GPT-3 Codex to Automate Simulation Modeling of Logistics Systems

arXiv 2202.12107 ↗First posted 24 Feb 2022cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Our work is the first attempt to apply Natural Language Processing to automate the development of simulation models of systems vitally important for logistics. We demonstrated that the framework built on top of the fine-tuned GPT-3 Codex, a Transformer-based language model, could produce functionally valid simulations of queuing and inventory control systems given the verbal description. In conducted experiments, GPT-3 Codex demonstrated convincing expertise in Python as well as an understanding of the domain-specific vocabulary. As a result, the language model could produce simulations of a single-product inventory-control system and single-server queuing system given the domain-specific context, a detailed description of the process, and a list of variables with the corresponding values. The demonstrated results, along with the rapid improvement of language models, open the door for significant simplification of the workflow behind the simulation model development, which will allow experts to focus on the high-level consideration of the problem and holistic thinking.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 74 references that are in the map. First posted on arXiv 24 Feb 2022.

Builds on

15 of 74 references.

References · 15

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  5. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  6. 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,392
  7. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,310
  8. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
  9. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
  10. 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 606
  11. 2013Generating Sequences With Recurrent Neural Networkscited by 554
  12. 2020PyMT5: multi-mode translation of natural language and Python code with transformerscited by 80
3 more
  1. 2018Natural Language Generation for Electronic Health Recordscited by 27
  2. 2021Solving Linear Algebra by Program Synthesiscited by 14
  3. 2015A Sentence Meaning Based Alignment Method for Parallel Text Corpora Preparationcited by 1

Built on by

Not cited yet.