mlsanityData to 7 Oct 2026

Agentic Calibration of Grey-Box Simulation Models: An LLM-Driven Alternative

arXiv 2607.18308 ↗First posted 17 Jul 2026cs.LG cs.AIcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Calibration of grey-box simulation models is a constrained optimization problem in which model evaluations are expensive, the parameter space can be high-dimensional, and the search must respect plausibility constraints. Although the simulation code is fully available to the analyst, the joint effect of multiple parameters remains difficult to predict analytically. Classical optimizers such as Nelder--Mead (NM) are simple to deploy but sample-inefficient, particularly under constraints. Modern Bayesian Optimization methods achieve competitive solutions with far fewer evaluations but require non-trivial modeling machinery for constraint handling. We introduce an agentic calibration method in which a large language model acts as the optimizer, with constraints incorporated as a plain-language section of the system prompt. We evaluate the agentic method, NM, and Bayesian Optimization (BO) on an anal cancer simulation model under both unconstrained and clinically constrained calibration. Under unconstrained calibration, the agentic method achieves substantially lower best error than BO and NM, while requiring fewer model evaluations. Under constrained calibration, the agentic method reaches comparable error levels and both outperform NM. These results are obtained at the cost of increased inference time per iteration. Agentic calibration achieves competitive performance with substantially fewer model evaluations, and constraint handling is essentially free at the modeller-facing interface through simple textual specifications rather than additional modelling machinery. The main trade-off lies in increased per-iteration inference cost, making the approach particularly suitable when simulation time dominates. Beyond performance, the per-iteration rationale makes the search auditable and explainable, so its decisions can be scrutinised and justified to third parties.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 11 of its 24 references that are in the map. First posted on arXiv 17 Jul 2026.

Builds on

11 of 24 references.

References · 11

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 915
  4. 2023Large Language Models as Optimizerscited by 830
  5. 2019Scalable Global Optimization via Local Bayesian Optimizationcited by 359
  6. 2013Bayesian Optimization in a Billion Dimensions via Random Embeddingscited by 178
  7. 2021High-Dimensional Bayesian Optimization with Sparse Axis-Aligned Subspacescited by 139
  8. 2024Large Language Models to Enhance Bayesian Optimizationcited by 127
  9. 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 96
  10. 2023Increasing the Scope as You Learn: Adaptive Bayesian Optimization in Nested Subspacescited by 50
  11. 2024Position: Leverage Foundational Models for Black-Box Optimizationcited by 21

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Distribird: Literature-Informed Prior Distribution Design for Bayesian Model Calibration
  2. 2026Agentic Bayesian Optimization through Surrogate-Augmented Autoresearch
  3. 2025LLM-based Agent Simulation for Maternal Health Interventions: Uncertainty Estimation and Decision-focused Evaluation
  4. 2026Agentic Autoresearch for CT Reconstruction
  5. 2026Agentic Monte Carlo: Simulating Reinforcement Learning for Black-Box Agents
  6. 2026Testing-Driven Reliability Audit of Trajectory-Based Early Outcome Prediction for LLM Agents: Target-Specific Calibration Transfer Persists Within a Single Benchmark
  7. 2026Agentic High-Dimensional Bayesian Optimization with Hypothesis- and Evidence-Guided Search
  8. 2026Calibrating the Evaluator: Does Probability Calibration Mitigate Preference Coupling in LLM Agent Feedback Loops?