Amortized Simulation-Based Inference in Generalized Bayes via Neural Posterior Estimation
Not on the map. Why?
Abstract (arXiv)
Generalized Bayesian Inference (GBI) tempers a loss with a temperature β > 0 to mitigate overconfidence and improve robustness under model misspecification, but existing GBI methods typically rely on costly MCMC or SDE-based samplers and must be re-run for each new dataset and each β value. We give the first fully amortized variational approximation for the tempered posterior family by training a single data- and β-conditioned neural posterior estimator that enables sampling in a single forward pass, without simulator calls or inference-time MCMC. We introduce two complementary training routes: one synthesizes off-manifold samples from the tempered joint distribution, and the other reweights a fixed base dataset using self-normalized importance sampling (SNIS). We show that the SNIS-weighted objective provides a consistent forward-KL fit to the tempered posterior with finite weight variance. Across four standard simulation-based inference benchmarks, including the chaotic Lorenz-96 system, our β-amortized estimator achieves competitive posterior approximations, in standard two-sample metrics, matching non-amortized MCMC-based power-posterior samplers over a wide range of temperatures.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 71 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
35 of 71 references.
References · 35
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2016Layer Normalizationcited by 5,579
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2019The frontier of simulation-based inferencecited by 490
- 2016Revisiting Classifier Two-Sample Testscited by 258
- 2018Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flowscited by 217
- 2019Automatic Posterior Transformation for Likelihood-Free Inferencecited by 216
23 more
- 2013A General Framework for Updating Belief Distributionscited by 172
- 2017Flexible statistical inference for mechanistic models of neural dynamicscited by 162
- 2021Benchmarking Simulation-Based Inferencecited by 160
- 2020BayesFlow: Learning complex stochastic models with invertible neural networkscited by 139
- 2020On Contrastive Learning for Likelihood-free Inferencecited by 96
- 2014Inconsistency of Bayesian Inference for Misspecified Linear Models, and a Proposal for Repairing Itcited by 92
- 2016Likelihood-free inference by ratio estimationcited by 80
- 2014Reweighted Wake-Sleepcited by 66
- 2015Bayesian Optimization for Likelihood-Free Inference of Simulator-Based Statistical Modelscited by 61
- 2022Sequential Neural Score Estimation: Likelihood-Free Inference with Conditional Score Based Diffusion Modelscited by 50
- 2017Assigning a value to a power likelihood in a general Bayesian modelcited by 46
- 2022Compositional Score Modeling for Simulation-based Inferencecited by 46
- 2022Investigating the Impact of Model Misspecification in Neural Simulation-based Inferencecited by 44
- 2022Variational methods for simulation-based inferencecited by 43
- 2015Black-box α-divergence Minimizationcited by 37
- 2017General Bayesian Updating and the Loss-Likelihood Bootstrapcited by 34
- 2021Variational Refinement for Importance Sampling Using the Forward Kullback-Leibler Divergencecited by 29
- 2015Calibrating general posterior credible regionscited by 26
- 2023Sensitivity-Aware Amortized Bayesian Inferencecited by 20
- 2023Generalized Bayesian Inference for Scientific Simulators via Amortized Cost Estimationcited by 17
- 2021Generalized Bayesian Likelihood-Free Inferencecited by 11
- 2019Adaptive Approximate Bayesian Computation Tolerance Selectioncited by 8
- 2022Scalable Semi-Modular Inference with Variational Meta-Posteriorscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.