G-Sim: Generative Simulations with Large Language Models and Gradient-Free Calibration
Not on the map. Why?
Abstract (arXiv)
Constructing robust simulators is essential for asking "what if?" questions and guiding policy in critical domains like healthcare and logistics. However, existing methods often struggle, either failing to generalize beyond historical data or, when using Large Language Models (LLMs), suffering from inaccuracies and poor empirical alignment. We introduce G-Sim, a hybrid framework that automates simulator construction by synergizing LLM-driven structural design with rigorous empirical calibration. G-Sim employs an LLM in an iterative loop to propose and refine a simulator's core components and causal relationships, guided by domain knowledge. This structure is then grounded in reality by estimating its parameters using flexible calibration techniques. Specifically, G-Sim can leverage methods that are both likelihood-free and gradient-free with respect to the simulator, such as gradient-free optimization for direct parameter estimation or simulation-based inference for obtaining a posterior distribution over parameters. This allows it to handle non-differentiable and stochastic simulators. By integrating domain priors with empirical evidence, G-Sim produces reliable, causally-informed simulators, mitigating data-inefficiency and enabling robust system-level interventions for complex decision-making.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 48 of its 105 references that are in the map. First posted on arXiv 10 Jun 2025.
Builds on
48 of 105 references.
References · 48
- 2017Attention Is All You Needcited by 60,361
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2018World Modelscited by 1,513
- 2022Competition-Level Code Generation with AlphaCodecited by 1,462
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2023Reasoning with Language Model is Planning with World Modelcited by 861
36 more
- 2017Evolution Strategies as a Scalable Alternative to Reinforcement Learningcited by 574
- 2019The frontier of simulation-based inferencecited by 502
- 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 431
- 2022Transformers are Sample-Efficient World Modelscited by 328
- 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 257
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 166
- 2023GenSim: Generating Robotic Simulation Tasks via Large Language Modelscited by 125
- 2018Validating Bayesian Inference Algorithms with Simulation-Based Calibrationcited by 124
- 2022Causal Transformer for Estimating Counterfactual Outcomescited by 123
- 2024Evaluating the World Model Implicit in a Generative Modelcited by 113
- 2024WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environmentcited by 107
- 2022A Review of Off-Policy Evaluation in Reinforcement Learningcited by 95
- 2020PCGRL: Procedural Content Generation via Reinforcement Learningcited by 90
- 2024OMNI-EPIC: Open-endedness via Models of human Notions of Interestingness with Environments Programmed in Codecited by 74
- 2022A Survey on Model-based Reinforcement Learningcited by 66
- 2023A Closer Look at the Intervention Procedure of Concept Bottleneck Modelscited by 64
- 2024Can Language Models Serve as Text-Based World Simulators?cited by 52
- 2021Detecting Model Misspecification in Amortized Bayesian Inference with Neural Networkscited by 49
- 2022Investigating Compounding Prediction Errors in Learned Dynamics Modelscited by 47
- 2024LLMPhy: Parameter-Identifiable Physical Reasoning Combining Large Language Models and Physics Enginescited by 30
- 2021A Trust Crisis In Simulation-Based Inference? Your Posterior Approximations Can Be Unfaithfulcited by 28
- 2024Large Language Models as Test Case Generators: Performance Evaluation and Enhancementcited by 28
- 2024Addressing Misspecification in Simulation-based Inference through Data-driven Calibrationcited by 27
- 2024WALL-E: World Alignment by Rule Learning Improves World Model-based LLM Agentscited by 26
- 2023Discovering modular solutions that generalize compositionallycited by 23
- 2024Making Large Language Models into World Models with Precondition and Effect Knowledgecited by 22
- 2020DyNODE: Neural Ordinary Differential Equations for Dynamics Modeling in Continuous Controlcited by 18
- 2024Automatically Learning Hybrid Digital Twins of Dynamical Systemscited by 14
- 2024ODE Discovery for Longitudinal Heterogeneous Treatment Effects Inferencecited by 12
- 2023Bayesian inference for misspecified generative modelscited by 11
- 2024LLM-Based World Models Can Make Decisions Solely, But Rigorous Evaluations are Neededcited by 10
- 2023EvoTorch: Scalable Evolutionary Computation in Pythoncited by 9
- 2025Simulation-based Bayesian inference under model misspecificationcited by 9
- 2024Context-Aware Testing: A New Paradigm for Model Testing with Large Language Modelscited by 8
- 2025Addressing Bias in Generative AI: Challenges and Research Opportunities in Information Managementcited by 7
- 2024Active Sequential Posterior Estimation for Sample-Efficient Simulation-Based Inferencecited by 5
Built on by
Citing papers per year: 2025: 2; 2026: 6.
8 papers.
- 2026A Probabilistic Framework for LLM-Based Model Discoverycited by 12
- 2026Separating Diagnosis from Control: Auditable Policy Adaptation in Agent-Based Simulations with LLM-Based Diagnosticscited by 1
- 2025SOCIA-Nabla: Textual Gradient Meets Multi-Agent Orchestration for Automated Simulator Generationcited by 0
- 2025A-LAMP: Agentic LLM-Based Framework for Automated MDP Modeling and Policy Generationcited by 0
- 2026Early predicting of hospital admission using machine learning algorithms: Priority queues approachcited by 0
- 2026SOCIA-EVO: Automated Simulator Construction via Dual-Anchored Bi-Level Optimizationcited by 0
- 2026Simulate, Reason, Decide: Scientific Reasoning with LLMs for Simulation-Driven Decision Makingcited by 0
- 2026Verify Claims, Not Scores: Evidence-Based Verification of Modular Agentscited by 0
- 2026Verify Claims, Not Scores: Evidence-Based Verification of Modular Agents1 Oct 2026
- 2026Simulate, Reason, Decide: Scientific Reasoning with LLMs for Simulation-Driven Decision Making3 Jun 2026
- 2026SOCIA-EVO: Automated Simulator Construction via Dual-Anchored Bi-Level Optimization19 Apr 2026
- 2026Separating Diagnosis from Control: Auditable Policy Adaptation in Agent-Based Simulations with LLM-Based Diagnostics24 Mar 2026
- 2026A Probabilistic Framework for LLM-Based Model Discovery20 Feb 2026
- 2026Early predicting of hospital admission using machine learning algorithms: Priority queues approach21 Jan 2026
- 2025A-LAMP: Agentic LLM-Based Framework for Automated MDP Modeling and Policy Generation12 Dec 2025
- 2025SOCIA-Nabla: Textual Gradient Meets Multi-Agent Orchestration for Automated Simulator Generation21 Oct 2025