mlsanityData to 14 Oct 2026

G-Sim: Generative Simulations with Large Language Models and Gradient-Free Calibration

arXiv 2506.09272 ↗First posted 10 Jun 2025cs.LG stat.MLcited by 8

Not on the map. Why?

Abstract (arXiv)

Constructing robust simulators is essential for asking "what if?" questions and guiding policy in critical domains like healthcare and logistics. However, existing methods often struggle, either failing to generalize beyond historical data or, when using Large Language Models (LLMs), suffering from inaccuracies and poor empirical alignment. We introduce G-Sim, a hybrid framework that automates simulator construction by synergizing LLM-driven structural design with rigorous empirical calibration. G-Sim employs an LLM in an iterative loop to propose and refine a simulator's core components and causal relationships, guided by domain knowledge. This structure is then grounded in reality by estimating its parameters using flexible calibration techniques. Specifically, G-Sim can leverage methods that are both likelihood-free and gradient-free with respect to the simulator, such as gradient-free optimization for direct parameter estimation or simulation-based inference for obtaining a posterior distribution over parameters. This allows it to handle non-differentiable and stochastic simulators. By integrating domain priors with empirical evidence, G-Sim produces reliable, causally-informed simulators, mitigating data-inefficiency and enabling robust system-level interventions for complex decision-making.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 48 of its 105 references that are in the map. First posted on arXiv 10 Jun 2025.

Builds on

48 of 105 references.

References · 48

  1. 2017Attention Is All You Needcited by 60,361
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  5. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  6. 2018Neural Ordinary Differential Equationscited by 3,779
  7. 2017Decoupled Weight Decay Regularizationcited by 1,831
  8. 2018World Modelscited by 1,513
  9. 2022Competition-Level Code Generation with AlphaCodecited by 1,462
  10. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
  11. 2023Mastering Diverse Domains through World Modelscited by 1,253
  12. 2023Reasoning with Language Model is Planning with World Modelcited by 861
36 more
  1. 2017Evolution Strategies as a Scalable Alternative to Reinforcement Learningcited by 574
  2. 2019The frontier of simulation-based inferencecited by 502
  3. 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 431
  4. 2022Transformers are Sample-Efficient World Modelscited by 328
  5. 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 257
  6. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 166
  7. 2023GenSim: Generating Robotic Simulation Tasks via Large Language Modelscited by 125
  8. 2018Validating Bayesian Inference Algorithms with Simulation-Based Calibrationcited by 124
  9. 2022Causal Transformer for Estimating Counterfactual Outcomescited by 123
  10. 2024Evaluating the World Model Implicit in a Generative Modelcited by 113
  11. 2024WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environmentcited by 107
  12. 2022A Review of Off-Policy Evaluation in Reinforcement Learningcited by 95
  13. 2020PCGRL: Procedural Content Generation via Reinforcement Learningcited by 90
  14. 2024OMNI-EPIC: Open-endedness via Models of human Notions of Interestingness with Environments Programmed in Codecited by 74
  15. 2022A Survey on Model-based Reinforcement Learningcited by 66
  16. 2023A Closer Look at the Intervention Procedure of Concept Bottleneck Modelscited by 64
  17. 2024Can Language Models Serve as Text-Based World Simulators?cited by 52
  18. 2021Detecting Model Misspecification in Amortized Bayesian Inference with Neural Networkscited by 49
  19. 2022Investigating Compounding Prediction Errors in Learned Dynamics Modelscited by 47
  20. 2024LLMPhy: Parameter-Identifiable Physical Reasoning Combining Large Language Models and Physics Enginescited by 30
  21. 2021A Trust Crisis In Simulation-Based Inference? Your Posterior Approximations Can Be Unfaithfulcited by 28
  22. 2024Large Language Models as Test Case Generators: Performance Evaluation and Enhancementcited by 28
  23. 2024Addressing Misspecification in Simulation-based Inference through Data-driven Calibrationcited by 27
  24. 2024WALL-E: World Alignment by Rule Learning Improves World Model-based LLM Agentscited by 26
  25. 2023Discovering modular solutions that generalize compositionallycited by 23
  26. 2024Making Large Language Models into World Models with Precondition and Effect Knowledgecited by 22
  27. 2020DyNODE: Neural Ordinary Differential Equations for Dynamics Modeling in Continuous Controlcited by 18
  28. 2024Automatically Learning Hybrid Digital Twins of Dynamical Systemscited by 14
  29. 2024ODE Discovery for Longitudinal Heterogeneous Treatment Effects Inferencecited by 12
  30. 2023Bayesian inference for misspecified generative modelscited by 11
  31. 2024LLM-Based World Models Can Make Decisions Solely, But Rigorous Evaluations are Neededcited by 10
  32. 2023EvoTorch: Scalable Evolutionary Computation in Pythoncited by 9
  33. 2025Simulation-based Bayesian inference under model misspecificationcited by 9
  34. 2024Context-Aware Testing: A New Paradigm for Model Testing with Large Language Modelscited by 8
  35. 2025Addressing Bias in Generative AI: Challenges and Research Opportunities in Information Managementcited by 7
  36. 2024Active Sequential Posterior Estimation for Sample-Efficient Simulation-Based Inferencecited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 6.

8 papers.