Validating Bayesian Inference Algorithms with Simulation-Based Calibration
Not on the map. Why?
Abstract (arXiv)
Verifying the correctness of Bayesian computation is challenging. This is especially true for complex models that are common in practice, as these require sophisticated model implementations and algorithms. In this paper we introduce simulation-based calibration (SBC), a general procedure for validating inferences from Bayesian algorithms capable of generating posterior samples. This procedure not only identifies inaccurate computation and inconsistencies in model implementations but also provides graphical summaries that can indicate the nature of the problems that arise. We argue that SBC is a critical part of a robust Bayesian workflow, as well as being a useful tool for those developing computational algorithms and statistical software.
Key facts. Cited by 124 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 16; 2023: 21; 2024: 15; 2025: 22; 2026: 42.
124 papers.
Sort:
By area:
- 2021Benchmarking Simulation-Based Inferencecited by 162
- 2021Detecting Model Misspecification in Amortized Bayesian Inference with Neural Networkscited by 49
- 2022Robust Neural Posterior Estimation and Statistical Model Criticismcited by 46
- 2023Sampling-Based Accuracy Testing of Posterior Estimators for General Inferencecited by 46
- 2022Truncated proposals for scalable and hassle-free simulation-based inferencecited by 41
- 2023JANA: Jointly Amortized Neural Approximation of Complex Bayesian Modelscited by 41
- 2024Neural Methods for Amortized Inferencecited by 39
- 2022GATSBI: Generative Adversarial Training for Simulation-Based Inferencecited by 36
- 2023BayesFlow: Amortized Bayesian Workflows With Neural Networkscited by 32
- 2025Simulation-Based Inference: A Practical Guidecited by 32
- 2021Sequential Neural Posterior and Likelihood Approximationcited by 30
- 2021A Trust Crisis In Simulation-Based Inference? Your Posterior Approximations Can Be Unfaithfulcited by 28
38 more
- 2022Towards Reliable Simulation-Based Inference with Balanced Neural Ratio Estimationcited by 28
- 2024Amortized Probabilistic Conditioning for Optimization, Simulation and Inferencecited by 23
- 2024sbi reloaded: a toolkit for simulation-based inference workflowscited by 23
- 2023Consistency Models for Scalable and Fast Simulation-Based Inferencecited by 22
- 2023Sensitivity-Aware Amortized Bayesian Inferencecited by 20
- 2023L-C2ST: Local Diagnostics for Posterior Approximations in Simulation-Based Inferencecited by 18
- 2022Likelihood-Free Inference with Generative Neural Networks via Scoring Rule Minimizationcited by 15
- 2023Leveraging Self-Consistency for Data-Efficient Amortized Bayesian Inferencecited by 14
- 2024Amortized Bayesian Multilevel Modelscited by 14
- 2022Black-box Bayesian inference for economic agent-based modelscited by 13
- 2023A Deep Learning Method for Comparing Bayesian Hierarchical Modelscited by 12
- 2021Likelihood-Free Frequentist Inference: Bridging Classical Statistics and Machine Learning for Reliable Simulator-Based Inferencecited by 11
- 2023Calibrating Neural Simulation-Based Inference with Differentiable Coverage Probabilitycited by 11
- 2025Diffusion Models in Simulation-Based Inference: A Tutorial Reviewcited by 11
- 2022Towards Instance-Wise Calibration: Local Amortized Diagnostics and Reshaping of Conditional Densities (LADaR)cited by 10
- 2023Balancing Simulation-based Inference for Conservative Posteriorscited by 10
- 2024Compositional simulation-based inference for time seriescited by 9
- 2025Multifidelity Simulation-based Inference for Computationally Expensive Simulatorscited by 9
- 2026BayesFlow 2: Multi-Backend Amortized Bayesian Inference in Pythoncited by 9
- 2021Toward a Taxonomy of Trust for Probabilistic Machine Learningcited by 8
- 2022Validation Diagnostics for SBI algorithms based on Normalizing Flowscited by 8
- 2022Are you using test log-likelihood correctly?cited by 8
- 2023Misspecification-robust Sequential Neural Likelihood for Simulation-based Inferencecited by 8
- 2023Simultaneous identification of models and parameters of scientific simulatorscited by 8
- 2023Simulation-based Inference for High-dimensional Data using Surjective Sequential Neural Likelihood Estimationcited by 8
- 2024Detecting Model Misspecification in Amortized Bayesian Inference with Neural Networks: An Extended Investigationcited by 8
- 2025G-Sim: Generative Simulations with Large Language Models and Gradient-Free Calibrationcited by 8
- 2022Calibrating Agent-based Models to Microdata with Graph Neural Networkscited by 7
- 2022Contrastive Neural Ratio Estimation for Simulation-based Inferencecited by 7
- 2024A Kernel-Based Conditional Two-Sample Test Using Nearest Neighbors (with Applications to Calibration, Regression Curves, and Simulation-Based Inference)cited by 7
- 2024Conditional diffusions for amortized neural posterior estimationcited by 7
- 2026this-that-model-1.0: A typed decision model that decides in 30 ms, for a millionth of a centcited by 7
- 2024Calibrated Computation-Aware Gaussian Processescited by 6
- 2026Learning Probabilistic Filters with Strictly Proper Scoring Rulescited by 6
- 2022Efficient identification of informative features in simulation-based inferencecited by 5
- 2022Neural Superstatistics for Bayesian Estimation of Dynamic Cognitive Modelscited by 5
- 2024Listening to the Noise: Blind Denoising with Gibbs Diffusioncited by 5
- 2023Uncertainty Quantification and Propagation in Surrogate-based Bayesian Inferencecited by 4
50 most cited of 124 All 124 (JSON)
- 2026Semi-Amortized Bayesian Inference with Reusable Local Posteriors13 Oct 2026
- 2026Joint Neural Posterior Estimation and Model Selection for Chemical Reaction Networks13 Oct 2026
- 2026Sample-Size Extrapolation in Simulation-Based Inference via Statistical Scaling12 Oct 2026
- 2026PhysDEM: Physics-Defined Energy-Matching Diffusion for Spatiotemporal Field Generation under Scarce Measurements1 Oct 2026
- 2026Amortized Bayesian Inference on Multilevel Models of Arbitrary Structure30 Sep 2026
- 2026Amortized ratio-estimation importance sampling and localized simulation-based calibration for intractable likelihoods30 Sep 2026
- 2026Mitigating Representation Gaps in Amortized Bayesian Inference with Auxiliary Supervision30 Sep 2026
- 2026PTED: A multi-dimensional two-sample test for scientific inference and generative machine learning29 Sep 2026
- 2026Recovery-Directed Symbolic Distillation of Neural Likelihoods26 Sep 2026
- 2026Bayesian Uncertainty Quantification for fMRI Functional Connectivity via Simulation-Based Inference24 Sep 2026
- 2026this-that-model-1.0: A typed decision model that decides in 30 ms, for a millionth of a cent20 Sep 2026
- 2026Auditing Bayesian Graph Alignment: Diagnostic Comparisons and Reference Failure19 Sep 2026
38 more
- 2026HB-PVI: A Hierarchical Bayesian Personalization and Value-of-Information Framework for Complex Activity Recognition4 Sep 2026
- 2026On the approximation of posterior laws in compound loss models by conditional Wasserstein GANs27 Aug 2026
- 2026Beyond Asking: A Pipeline for Personalized Game Generation that Reads Players from Behavior17 Aug 2026
- 2026Posterior Inference of Hamiltonian Parameters from RIXS Spectroscopy14 Aug 2026
- 2026A Hybrid Nested Harness for Decoupling Structure and Parameters in LLM-Driven Optimization8 Aug 2026
- 2026A Ground-Truth Framework for Uncertainty Disentanglement with Posterior Risk6 Aug 2026
- 2026Priors learned from legacy reconstructions inherit undetectable overconfidence23 Jul 2026
- 2026An Introduction to Bayesian and Frequentist Simulation-Based Inference with Machine Learning23 Jul 2026
- 2026Program Synthesis for Simulation-Based Inference: Joint Model Selection and Parameter Estimation20 Jul 2026
- 2026Sensitivity to Subjective Expected Utility Maximization: A Methodological Study, with an Illustrative Application to LLM Decision-Making8 Jul 2026
- 2026Calibration, Not Compilation: Detecting and Repairing Misspecified Probabilistic Programs Written by Language Models30 Jun 2026
- 2026Learning Probabilistic Filters with Strictly Proper Scoring Rules25 Jun 2026
- 2026Learning the Universe: Posterior Reliability of Neural Generative Models in High-Dimensional Field-Level Inference of Cosmic Initial Conditions8 Jun 2026
- 2026Conservative neural posterior estimation via distributionally robust training27 May 2026
- 2026GenSBI: Generative Methods for Simulation-Based Inference in JAX26 May 2026
- 2026Pointwise Metrics Mislead: An Evaluation Protocol for Multimodal Inverse Problems21 May 2026
- 2026Separating Intrinsic Ambiguity from Estimation Uncertainty in Deep Generative Models for Linear Inverse Problems14 May 2026
- 2026Mixed neural posterior estimation for simulators with discrete and continuous parameters13 May 2026
- 2026Pre-trained Tabular Foundation Models as Versatile Summary Networks for Neural Posterior Estimation8 May 2026
- 2026Information-Preserving Domain Transfer with Unlabeled Data in Misspecified Simulation-Based Inference7 May 2026
- 2026Neural Posterior Estimation of Terrain Parameters from Radar Sounder Data5 May 2026
- 2026MIRA: A Score for Conditional Distribution Accuracy and Model Comparison3 May 2026
- 2026Overcoming Selection Bias in Statistical Studies With Amortized Bayesian Inference20 Apr 2026
- 2026Improving moment tensor solutions under Earth structure uncertainty with simulation-based inference19 Mar 2026
- 2026Scalable Simulation-Based Model Inference with Test-Time Complexity Control16 Mar 2026
- 2026Dual-space posterior sampling for Bayesian inference in constrained inverse problems28 Feb 2026
- 2026Neural Network-Based Parameter Estimation of a Labour Market Agent-Based Model17 Feb 2026
- 2026BayesFlow 2: Multi-Backend Amortized Bayesian Inference in Python6 Feb 2026
- 2026Near-Optimal Private Tests for Simple and MLR Hypotheses29 Jan 2026
- 2026From Mice to Trains: Amortized Bayesian Inference on Graph Data5 Jan 2026
- 2025Diffusion Models in Simulation-Based Inference: A Tutorial Review22 Dec 2025
- 2025Generalized Guarantees for Variational Inference in the Presence of Even and Elliptical Symmetry2 Nov 2025
- 2025PriorGuide: Test-Time Prior Adaptation for Simulation-Based Inference15 Oct 2025
- 2025Flow Matching Calibration for Simulation-Based Inference under Model Misspecification27 Sep 2025
- 2025Fast reconstruction of degenerate populations of conductance-based neuron models from spike times16 Sep 2025
- 2025Posterior shape models revisited: Improving 3D reconstructions from partial data using target specific models6 Sep 2025
- 2025Simulation-Based Inference: A Practical Guide18 Aug 2025
- 2025CoLT: The conditional localization test for assessing the accuracy of neural posterior estimates22 Jul 2025
50 newest of 124 All 124 (JSON)
- 2023Consistency Models for Scalable and Fast Simulation-Based Inferencecited by 22
- 2025Diffusion Models in Simulation-Based Inference: A Tutorial Reviewcited by 11
- 2024Listening to the Noise: Blind Denoising with Gibbs Diffusioncited by 5
- 2025PriorGuide: Test-Time Prior Adaptation for Simulation-Based Inferencecited by 3
- 2024Flow Matching for Posterior Inference with Simulator Feedbackcited by 2
- 2025ConDiSim: Conditional Diffusion Models for Simulation Based Inferencecited by 2
- 2025Flow Matching Calibration for Simulation-Based Inference under Model Misspecificationcited by 2
- 2026GenSBI: Generative Methods for Simulation-Based Inference in JAXcited by 0
- 2026PhysDEM: Physics-Defined Energy-Matching Diffusion for Spatiotemporal Field Generation under Scarce Measurementscited by 0
- 2026PhysDEM: Physics-Defined Energy-Matching Diffusion for Spatiotemporal Field Generation under Scarce Measurements1 Oct 2026
- 2026GenSBI: Generative Methods for Simulation-Based Inference in JAX26 May 2026
- 2025Diffusion Models in Simulation-Based Inference: A Tutorial Review22 Dec 2025
- 2025PriorGuide: Test-Time Prior Adaptation for Simulation-Based Inference15 Oct 2025
- 2025Flow Matching Calibration for Simulation-Based Inference under Model Misspecification27 Sep 2025
- 2025ConDiSim: Conditional Diffusion Models for Simulation Based Inference13 May 2025
- 2024Flow Matching for Posterior Inference with Simulator Feedback29 Oct 2024
- 2024Listening to the Noise: Blind Denoising with Gibbs Diffusion29 Feb 2024
- 2023Consistency Models for Scalable and Fast Simulation-Based Inference9 Dec 2023
- 2021Benchmarking Simulation-Based Inferencecited by 162
- 2021Detecting Model Misspecification in Amortized Bayesian Inference with Neural Networkscited by 49
- 2022Robust Neural Posterior Estimation and Statistical Model Criticismcited by 46
- 2023Sampling-Based Accuracy Testing of Posterior Estimators for General Inferencecited by 46
- 2022Truncated proposals for scalable and hassle-free simulation-based inferencecited by 41
- 2023JANA: Jointly Amortized Neural Approximation of Complex Bayesian Modelscited by 41
- 2024Neural Methods for Amortized Inferencecited by 39
- 2022GATSBI: Generative Adversarial Training for Simulation-Based Inferencecited by 36
- 2023BayesFlow: Amortized Bayesian Workflows With Neural Networkscited by 32
- 2025Simulation-Based Inference: A Practical Guidecited by 32
- 2021Sequential Neural Posterior and Likelihood Approximationcited by 30
- 2021A Trust Crisis In Simulation-Based Inference? Your Posterior Approximations Can Be Unfaithfulcited by 28
12 most cited of 114 All 114 (JSON)
- 2026Semi-Amortized Bayesian Inference with Reusable Local Posteriors13 Oct 2026
- 2026Joint Neural Posterior Estimation and Model Selection for Chemical Reaction Networks13 Oct 2026
- 2026Sample-Size Extrapolation in Simulation-Based Inference via Statistical Scaling12 Oct 2026
- 2026Amortized Bayesian Inference on Multilevel Models of Arbitrary Structure30 Sep 2026
- 2026Amortized ratio-estimation importance sampling and localized simulation-based calibration for intractable likelihoods30 Sep 2026
- 2026Mitigating Representation Gaps in Amortized Bayesian Inference with Auxiliary Supervision30 Sep 2026
- 2026PTED: A multi-dimensional two-sample test for scientific inference and generative machine learning29 Sep 2026
- 2026Recovery-Directed Symbolic Distillation of Neural Likelihoods26 Sep 2026
- 2026Bayesian Uncertainty Quantification for fMRI Functional Connectivity via Simulation-Based Inference24 Sep 2026
- 2026this-that-model-1.0: A typed decision model that decides in 30 ms, for a millionth of a cent20 Sep 2026
- 2026Auditing Bayesian Graph Alignment: Diagnostic Comparisons and Reference Failure19 Sep 2026
- 2026HB-PVI: A Hierarchical Bayesian Personalization and Value-of-Information Framework for Complex Activity Recognition4 Sep 2026
12 newest of 114 All 114 (JSON)