mlsanityData to 7 Oct 2026

Amortized Simulation-Based Inference in Generalized Bayes via Neural Posterior Estimation

arXiv 2601.22367 ↗First posted 29 Jan 2026stat.ML cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Generalized Bayesian Inference (GBI) tempers a loss with a temperature β > 0 to mitigate overconfidence and improve robustness under model misspecification, but existing GBI methods typically rely on costly MCMC or SDE-based samplers and must be re-run for each new dataset and each β value. We give the first fully amortized variational approximation for the tempered posterior family by training a single data- and β-conditioned neural posterior estimator that enables sampling in a single forward pass, without simulator calls or inference-time MCMC. We introduce two complementary training routes: one synthesizes off-manifold samples from the tempered joint distribution, and the other reweights a fixed base dataset using self-normalized importance sampling (SNIS). We show that the SNIS-weighted objective provides a consistent forward-KL fit to the tempered posterior with finite weight variance. Across four standard simulation-based inference benchmarks, including the chaotic Lorenz-96 system, our β-amortized estimator achieves competitive posterior approximations, in standard two-sample metrics, matching non-amortized MCMC-based power-posterior samplers over a wide range of temperatures.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 71 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

35 of 71 references.

References · 35

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2016Layer Normalizationcited by 5,579
  5. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  6. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  7. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  8. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
  9. 2019The frontier of simulation-based inferencecited by 490
  10. 2016Revisiting Classifier Two-Sample Testscited by 258
  11. 2018Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flowscited by 217
  12. 2019Automatic Posterior Transformation for Likelihood-Free Inferencecited by 216
23 more
  1. 2013A General Framework for Updating Belief Distributionscited by 172
  2. 2017Flexible statistical inference for mechanistic models of neural dynamicscited by 162
  3. 2021Benchmarking Simulation-Based Inferencecited by 160
  4. 2020BayesFlow: Learning complex stochastic models with invertible neural networkscited by 139
  5. 2020On Contrastive Learning for Likelihood-free Inferencecited by 96
  6. 2014Inconsistency of Bayesian Inference for Misspecified Linear Models, and a Proposal for Repairing Itcited by 92
  7. 2016Likelihood-free inference by ratio estimationcited by 80
  8. 2014Reweighted Wake-Sleepcited by 66
  9. 2015Bayesian Optimization for Likelihood-Free Inference of Simulator-Based Statistical Modelscited by 61
  10. 2022Sequential Neural Score Estimation: Likelihood-Free Inference with Conditional Score Based Diffusion Modelscited by 50
  11. 2017Assigning a value to a power likelihood in a general Bayesian modelcited by 46
  12. 2022Compositional Score Modeling for Simulation-based Inferencecited by 46
  13. 2022Investigating the Impact of Model Misspecification in Neural Simulation-based Inferencecited by 44
  14. 2022Variational methods for simulation-based inferencecited by 43
  15. 2015Black-box α-divergence Minimizationcited by 37
  16. 2017General Bayesian Updating and the Loss-Likelihood Bootstrapcited by 34
  17. 2021Variational Refinement for Importance Sampling Using the Forward Kullback-Leibler Divergencecited by 29
  18. 2015Calibrating general posterior credible regionscited by 26
  19. 2023Sensitivity-Aware Amortized Bayesian Inferencecited by 20
  20. 2023Generalized Bayesian Inference for Scientific Simulators via Amortized Cost Estimationcited by 17
  21. 2021Generalized Bayesian Likelihood-Free Inferencecited by 11
  22. 2019Adaptive Approximate Bayesian Computation Tolerance Selectioncited by 8
  23. 2022Scalable Semi-Modular Inference with Variational Meta-Posteriorscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.