Distribird: Literature-Informed Prior Distribution Design for Bayesian Model Calibration
Not on the map. Why?
Abstract (arXiv)
Bayesian calibration of process-based models requires a prior distribution for each model parameter. Despite decades of methodological work, researchers almost always fall back on uniform priors. The main reason is that building informative priors from scientific literature is slow and needs both domain and statistical expertise. We present Distribird, an agentic web application that automates this process. Given a parameter name, physical description, and domain context, Distribird deploys a multi-agent pipeline that searches the literature, extracts and weights reported values by domain relevance, and fits a probability distribution via AIC model selection. When no literature is available, the system falls back to sensible uninformative alternatives, and clearly reports both the evidence behind and the confidence level of every prior it produces. It is designed for the problems where the models have physically interpretable parameters, where domain knowledge exists in the published literature. We evaluate the tool on 24~parameters across 10 scientific domains comparing three open-weight models (Qwen3.6 27B, Gemma 4 31B, Mistral Small 4 119B) with a single-prompt LLM baseline. On prior quality the full pipeline matches this baseline. Every prior is traced to the specific papers and values from which it was constructed; a built-in validity layer declines to produce priors for out-of-scope requests, whereas the single-prompt baseline returns confident but unfounded priors for them in 11 of 30~model-parameter cases; and every language-model call runs locally, so no parameter description or unpublished modelling detail is transmitted to a third-party LLM provider (only generated search terms reach the public literature databases). For scientific use, we argue these properties matter more than a marginal improvement in point-estimate accuracy.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 3 of its 32 references that are in the map. First posted on arXiv 13 Jul 2026.
Builds on
3 of 32 references.
References · 3
- 2023Emergent autonomous scientific research capabilities of large language modelscited by 132
- 2019Rank-normalization, folding, and localization: An improved widehatR for assessing convergence of MCMCcited by 93
- 2025LLM-Prior: A Framework for Knowledge-Driven Prior Elicitation and Aggregationcited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Flow Matching Calibration for Simulation-Based Inference under Model Misspecification
- 2026Agentic Calibration of Grey-Box Simulation Models: An LLM-Driven Alternative
- 2026MARGIN: Runtime Confidence Calibration for Multi-Agent Foundation Model Coordination
- 2025HiBayES: A Hierarchical Bayesian Modeling Framework for AI Evaluation Statistics
- 2026A Probabilistic Framework for LLM-Based Model Discovery
- 2025Diffusion Models in Simulation-Based Inference: A Tutorial Review
- 2026Overview of the NLPCC 2026 Shared Task 11: Agent-Based Experiment Reproduction from Scientific Papers
- 2026Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models