On Languaging a Simulation Engine
Not on the map. Why?
Abstract (arXiv)
Language model intelligence is revolutionizing the way we program materials simulations. However, the diversity of simulation scenarios renders it challenging to precisely transform human language into a tailored simulator. Here, using three functionalized types of language model, we propose a language-to-simulation (Lang2Sim) framework that enables interactive navigation on languaging a simulation engine, by taking a scenario instance of water sorption in porous matrices. Unlike line-by-line coding of a target simulator, the language models interpret each simulator as an assembly of invariant tool function and its variant input-output pair. Lang2Sim enables the precise transform of textual description by functionalizing and sequentializing the language models of, respectively, rationalizing the tool categorization, customizing its input-output combinations, and distilling the simulator input into executable format. Importantly, depending on its functionalized type, each language model features a distinct processing of chat history to best balance its memory limit and information completeness, thus leveraging the model intelligence to unstructured nature of human request. Overall, this work establishes language model as an intelligent platform to unlock the era of languaging a simulation engine.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 54 references that are in the map. First posted on arXiv 26 Feb 2024.
Builds on
25 of 54 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
- 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 776
- 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 637
13 more
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
- 2023LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Modelscited by 317
- 2023S3: Social-network Simulation System with Large Language Model-Empowered Agentscited by 228
- 2023LLM Lies: Hallucinations are not Bugs, but Features as Adversarial Examplescited by 177
- 2022GitHub Copilot AI pair programmer: Asset or Liability?cited by 150
- 2022Language Models as Agent Modelscited by 131
- 2022TalkToModel: Explaining Machine Learning Models with Interactive Natural Language Conversationscited by 65
- 2022What is it like to program with artificial intelligence?cited by 39
- 2023MechGPT, a language-based strategy for mechanics and materials modeling that connects knowledge across scales, disciplines and modalitiescited by 38
- 2023ChatGPT for Programming Numerical Methodscited by 26
- 2023xVal: A Continuous Numerical Tokenization for Scientific Language Modelscited by 26
- 2021Choose Your Programming Copilot: A Comparison of the Program Synthesis Performance of GitHub Copilot and Genetic Programmingcited by 24
- 2023From Copilot to Pilot: Towards AI Supported Software Developmentcited by 14
Built on by
Not cited yet.