mlsanityData to 14 Oct 2026

Simulate, Reason, Decide: Scientific Reasoning with LLMs for Simulation-Driven Decision Making

arXiv 2606.04505 ↗First posted 3 Jun 2026cs.AIcited by 0

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Scientific simulators are increasingly being integrated into LLM-driven systems for high-stakes simulation-driven decision-making. However, existing frameworks primarily use LLMs to generate, calibrate, or execute simulators, treating them as black-box interfaces rather than as structured mechanistic systems that can be reasoned about. As a result, current approaches lack the ability to identify, represent, and reason about the assumptions and mechanisms underlying simulator behavior, limiting transparency, auditability, and decision justification. We introduce MechSim, a mechanism-grounded neuro-symbolic reasoning framework for executable scientific simulators. Unlike prior neuro-symbolic approaches that primarily reason over static symbolic structures, MechSim enables LLM agents to reason about the mechanisms, assumptions, and execution behavior of scientific simulators. Our framework represents simulators through a shared structured schema capturing assumptions, variables, mechanism dependencies, and execution traces. On top of this representation, LLM agents operate as constrained reasoning engines that generate structured, evidence-grounded explanations linking simulator outcomes to their underlying mechanisms. We evaluate our approach across multiple high-stakes domains and show that it improves mechanism-level explanation quality, simulator analysis, and downstream decision-making reliability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 22 of its 67 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

22 of 67 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning20 May

Other references · 21

  1. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  2. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  3. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  4. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
  5. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
  6. 2019ERASER: A Benchmark to Evaluate Rationalized NLP Modelscited by 530
  7. 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 210
  8. 2024TradingAgents: Multi-Agents LLM Financial Trading Frameworkcited by 188
  9. 2024MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Makingcited by 163
  10. 2026Towards End-to-End Automation of AI Researchcited by 159
  11. 2023Causal Parrots: Large Language Models May Talk Causality But Are Not Causalcited by 150
  12. 2023GenSim: Generating Robotic Simulation Tasks via Large Language Modelscited by 125
9 more
  1. 2025Curie: Toward Rigorous and Automated Scientific Experimentation with AI Agentscited by 33
  2. 2025Causal-Copilot: An Autonomous Causal Analysis Agentcited by 15
  3. 2026A Probabilistic Framework for LLM-Based Model Discoverycited by 12
  4. 2025Agent Trading Arena: A Study on Numerical Understanding in LLM-Based Agentscited by 9
  5. 2025G-Sim: Generative Simulations with Large Language Models and Gradient-Free Calibrationcited by 8
  6. 2023Context, Composition, Automation, and Communication -- The C2AC Roadmap for Modeling and Simulationcited by 4
  7. 2026AI Agents as Policymakers in Simulated Epidemicscited by 4
  8. 2025SimulRAG: Simulator-based RAG for Grounding LLMs in Long-form Scientific QAcited by 3
  9. 2026Agentic Framework for Epidemiological Modelingcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026FALSIFYBENCH: Evaluating Inductive Reasoning in LLMs with Rule Discovery Games
  2. 2025Lyria: A Genetic Algorithm-Driven Neuro-Symbolic Reasoning Framework for LLMs
  3. 2026ACED-Bench: Evaluating How LLM Agents Acquire and Act on Causal Evidence
  4. 2024LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discovery
  5. 2026Agentic Scientific Simulation: Execution-Grounded Model Construction and Reconstruction
  6. 2025Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Making
  7. 2026BioProAgent: Neuro-Symbolic Grounding for Constrained Scientific Planning
  8. 2024Cognitive LLMs: Towards Integrating Cognitive Architectures and Large Language Models for Manufacturing Decision-making