Variational methods for simulation-based inference
Not on the map. Why?
Abstract (arXiv)
We present Sequential Neural Variational Inference (SNVI), an approach to perform Bayesian inference in models with intractable likelihoods. SNVI combines likelihood-estimation (or likelihood-ratio-estimation) with variational inference to achieve a scalable simulation-based inference approach. SNVI maintains the flexibility of likelihood(-ratio) estimation to allow arbitrary proposals for simulations, while simultaneously providing a functional estimate of the posterior distribution without requiring MCMC sampling. We present several variants of SNVI and demonstrate that they are substantially more computationally efficient than previous algorithms, without loss of accuracy on benchmark tasks. We apply SNVI to a neuroscience model of the pyloric network in the crab and demonstrate that it can infer the posterior distribution with one order of magnitude fewer simulations than previously reported. SNVI vastly reduces the computational cost of simulation-based inference while maintaining accuracy and flexibility, making it possible to tackle problems that were previously inaccessible.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). Builds on 35 of its 64 references that are in the map. First posted on arXiv 8 Mar 2022.
Builds on
35 of 64 references.
References · 35
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2016Density estimation using Real NVPcited by 2,029
- 2016Variational Inference: A Review for Statisticianscited by 1,466
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2017Masked Autoregressive Flow for Density Estimationcited by 680
- 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 636
- 2019Neural Spline Flowscited by 590
- 2015Importance Weighted Autoencoderscited by 454
- 2018Pyro: Deep Universal Probabilistic Programmingcited by 379
- 2013Black Box Variational Inferencecited by 317
- 2016Revisiting Classifier Two-Sample Testscited by 258
- 2018Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flowscited by 217
23 more
- 2019Automatic Posterior Transformation for Likelihood-Free Inferencecited by 216
- 2017Flexible statistical inference for mechanistic models of neural dynamicscited by 162
- 2021Benchmarking Simulation-Based Inferencecited by 160
- 2016Learning in Implicit Generative Modelscited by 124
- 2016R'enyi Divergence Variational Inferencecited by 104
- 2017Sticking the Landing: Simple, Lower-Variance Gradient Estimators for Variational Inferencecited by 97
- 2020On Contrastive Learning for Likelihood-free Inferencecited by 96
- 2015Approximating Likelihood Ratios with Calibrated Discriminative Classifierscited by 87
- 2016Likelihood-free inference by ratio estimationcited by 80
- 2018Tighter Variational Bounds are Not Necessarily Bettercited by 76
- 2020Neural Approximate Sufficient Statistics for Implicit Modelscited by 72
- 2018Likelihood-free inference with emulator networkscited by 61
- 2018Importance Weighting and Variational Inferencecited by 55
- 2018Doubly Reparameterized Gradient Estimators for Monte Carlo Objectivescited by 41
- 2017Variational Inference using Implicit Distributionscited by 39
- 2020Advances in Black-Box VI: Normalizing Flows, Importance Weighting, and Optimizationcited by 37
- 2017Reinterpreting Importance-Weighted Autoencoderscited by 36
- 2021Sequential Neural Posterior and Likelihood Approximationcited by 30
- 2021Truncated Marginal Neural Ratio Estimationcited by 30
- 2021Variational Refinement for Importance Sampling Using the Forward Kullback-Leibler Divergencecited by 29
- 2020f-Divergence Variational Inferencecited by 28
- 2014Likelihood-free inference via classificationcited by 13
- 2016Variational Bayes with Synthetic Likelihoodcited by 6
Built on by
Citing papers per year: 2022: 9; 2023: 14; 2024: 11; 2025: 7; 2026: 2.
43 papers.
Sort:
By area:
- 2024All-in-one simulation-based inferencecited by 71
- 2022Sequential Neural Score Estimation: Likelihood-Free Inference with Conditional Score Based Diffusion Modelscited by 50
- 2023Learning Robust Statistics for Simulation-based Inference under Model Misspecificationcited by 48
- 2022Compositional Score Modeling for Simulation-based Inferencecited by 46
- 2023JANA: Jointly Amortized Neural Approximation of Complex Bayesian Modelscited by 41
- 2022Truncated proposals for scalable and hassle-free simulation-based inferencecited by 40
- 2024Neural Methods for Amortized Inferencecited by 36
- 2025Simulation-Based Inference: A Practical Guidecited by 30
- 2022Towards Reliable Simulation-Based Inference with Balanced Neural Ratio Estimationcited by 27
- 2024Addressing Misspecification in Simulation-based Inference through Data-driven Calibrationcited by 26
- 2024sbi reloaded: a toolkit for simulation-based inference workflowscited by 23
- 2023Sensitivity-Aware Amortized Bayesian Inferencecited by 20
31 more
- 2023Generalized Bayesian Inference for Scientific Simulators via Amortized Cost Estimationcited by 17
- 2023Leveraging Self-Consistency for Data-Efficient Amortized Bayesian Inferencecited by 14
- 2023Neural Bayes Estimators for Irregular Spatial Data using Graph Neural Networkscited by 13
- 2025Effortless, Simulation-Efficient Bayesian Inference using Tabular Foundation Modelscited by 13
- 2023Simulation-based Inference for Cardiovascular Modelscited by 11
- 2023Balancing Simulation-based Inference for Conservative Posteriorscited by 10
- 2025Does Unsupervised Domain Adaptation Improve the Robustness of Amortized Bayesian Inference? A Systematic Evaluationcited by 10
- 2023Misspecification-robust Sequential Neural Likelihood for Simulation-based Inferencecited by 8
- 2023Simulation-based Inference for High-dimensional Data using Surjective Sequential Neural Likelihood Estimationcited by 8
- 2024Compositional simulation-based inference for time seriescited by 8
- 2022Contrastive Neural Ratio Estimation for Simulation-based Inferencecited by 7
- 2022Efficient identification of informative features in simulation-based inferencecited by 5
- 2022Maximum Likelihood Learning of Unnormalized Models for Simulation-Based Inferencecited by 5
- 2024A Kernel-Based Conditional Two-Sample Test Using Nearest Neighbors (with Applications to Calibration, Regression Curves, and Simulation-Based Inference)cited by 5
- 2024Disentangling impact of capacity, objective, batchsize, estimators, and step-size on flow VIcited by 5
- 2023Simulation-based Inference with the Generalized Kullback-Leibler Divergencecited by 3
- 2023Fuse It or Lose It: Deep Fusion for Multimodal Simulation-Based Inferencecited by 3
- 2024Demonstrating the power and flexibility of variational assumptions for amortized neural posterior estimation in environmental applicationscited by 3
- 2024Amortized Bayesian Workflowcited by 3
- 2022Improving the Accuracy of Marginal Approximations in Likelihood-Free Inference via Localisationcited by 2
- 2024Variational Autoencoders for Efficient Simulation-Based Inferencecited by 2
- 2025Fast and Scalable Score-Based Kernel Calibration Testscited by 2
- 2023Goal-oriented Uncertainty Quantification for Inverse Problems via Variational Encoder-Decoder Networkscited by 1
- 2024SoftCVI: Contrastive variational inference with self-generated soft labelscited by 1
- 2025A New Stochastic Approximation Method for Gradient-based Simulated Parameter Estimationcited by 1
- 2025Causal Posterior Estimationcited by 1
- 2026Amortized Simulation-Based Inference in Generalized Bayes via Neural Posterior Estimationcited by 1
- 2022An Optimal Likelihood Free Method for Biological Model Selectioncited by 0
- 2023An efficient likelihood-free Bayesian inference method based on sequential neural posterior estimationcited by 0
- 2025Misspecification-robust amortised simulation-based inference using variational methodscited by 0
- 2026FUSE: FK-Steered Multi-Modal Flow Matching for Efficient Simulation-Based Posterior Estimationcited by 0
- 2026FUSE: FK-Steered Multi-Modal Flow Matching for Efficient Simulation-Based Posterior Estimation6 Jul 2026
- 2026Amortized Simulation-Based Inference in Generalized Bayes via Neural Posterior Estimation29 Jan 2026
- 2025Fast and Scalable Score-Based Kernel Calibration Tests16 Oct 2025
- 2025Misspecification-robust amortised simulation-based inference using variational methods6 Sep 2025
- 2025Simulation-Based Inference: A Practical Guide18 Aug 2025
- 2025Causal Posterior Estimation27 May 2025
- 2025Effortless, Simulation-Efficient Bayesian Inference using Tabular Foundation Models24 Apr 2025
- 2025A New Stochastic Approximation Method for Gradient-based Simulated Parameter Estimation24 Mar 2025
- 2025Does Unsupervised Domain Adaptation Improve the Robustness of Amortized Bayesian Inference? A Systematic Evaluation7 Feb 2025
- 2024Disentangling impact of capacity, objective, batchsize, estimators, and step-size on flow VI11 Dec 2024
- 2024sbi reloaded: a toolkit for simulation-based inference workflows26 Nov 2024
- 2024Variational Autoencoders for Efficient Simulation-Based Inference21 Nov 2024
31 more
- 2024Compositional simulation-based inference for time series5 Nov 2024
- 2024Amortized Bayesian Workflow6 Sep 2024
- 2024A Kernel-Based Conditional Two-Sample Test Using Nearest Neighbors (with Applications to Calibration, Regression Curves, and Simulation-Based Inference)23 Jul 2024
- 2024SoftCVI: Contrastive variational inference with self-generated soft labels22 Jul 2024
- 2024Addressing Misspecification in Simulation-based Inference through Data-driven Calibration14 May 2024
- 2024Neural Methods for Amortized Inference18 Apr 2024
- 2024Demonstrating the power and flexibility of variational assumptions for amortized neural posterior estimation in environmental applications16 Apr 2024
- 2024All-in-one simulation-based inference15 Apr 2024
- 2023An efficient likelihood-free Bayesian inference method based on sequential neural posterior estimation21 Nov 2023
- 2023Fuse It or Lose It: Deep Fusion for Multimodal Simulation-Based Inference17 Nov 2023
- 2023Sensitivity-Aware Amortized Bayesian Inference17 Oct 2023
- 2023Leveraging Self-Consistency for Data-Efficient Amortized Bayesian Inference6 Oct 2023
- 2023Neural Bayes Estimators for Irregular Spatial Data using Graph Neural Networks4 Oct 2023
- 2023Simulation-based Inference with the Generalized Kullback-Leibler Divergence3 Oct 2023
- 2023Simulation-based Inference for High-dimensional Data using Surjective Sequential Neural Likelihood Estimation2 Aug 2023
- 2023Simulation-based Inference for Cardiovascular Models26 Jul 2023
- 2023Learning Robust Statistics for Simulation-based Inference under Model Misspecification25 May 2023
- 2023Generalized Bayesian Inference for Scientific Simulators via Amortized Cost Estimation24 May 2023
- 2023Balancing Simulation-based Inference for Conservative Posteriors21 Apr 2023
- 2023Goal-oriented Uncertainty Quantification for Inverse Problems via Variational Encoder-Decoder Networks17 Apr 2023
- 2023JANA: Jointly Amortized Neural Approximation of Complex Bayesian Models17 Feb 2023
- 2023Misspecification-robust Sequential Neural Likelihood for Simulation-based Inference31 Jan 2023
- 2022Maximum Likelihood Learning of Unnormalized Models for Simulation-Based Inference26 Oct 2022
- 2022Efficient identification of informative features in simulation-based inference21 Oct 2022
- 2022Contrastive Neural Ratio Estimation for Simulation-based Inference11 Oct 2022
- 2022Sequential Neural Score Estimation: Likelihood-Free Inference with Conditional Score Based Diffusion Models10 Oct 2022
- 2022Truncated proposals for scalable and hassle-free simulation-based inference10 Oct 2022
- 2022Compositional Score Modeling for Simulation-based Inference28 Sep 2022
- 2022Towards Reliable Simulation-Based Inference with Balanced Neural Ratio Estimation29 Aug 2022
- 2022An Optimal Likelihood Free Method for Biological Model Selection3 Aug 2022
- 2022Improving the Accuracy of Marginal Approximations in Likelihood-Free Inference via Localisation14 Jul 2022
- 2024All-in-one simulation-based inferencecited by 71
- 2023Learning Robust Statistics for Simulation-based Inference under Model Misspecificationcited by 48
- 2022Compositional Score Modeling for Simulation-based Inferencecited by 46
- 2023JANA: Jointly Amortized Neural Approximation of Complex Bayesian Modelscited by 41
- 2022Truncated proposals for scalable and hassle-free simulation-based inferencecited by 40
- 2024Neural Methods for Amortized Inferencecited by 36
- 2025Simulation-Based Inference: A Practical Guidecited by 30
- 2022Towards Reliable Simulation-Based Inference with Balanced Neural Ratio Estimationcited by 27
- 2024Addressing Misspecification in Simulation-based Inference through Data-driven Calibrationcited by 26
- 2024sbi reloaded: a toolkit for simulation-based inference workflowscited by 23
- 2023Sensitivity-Aware Amortized Bayesian Inferencecited by 20
- 2023Generalized Bayesian Inference for Scientific Simulators via Amortized Cost Estimationcited by 17
12 most cited of 40 All 40 (JSON)
- 2026Amortized Simulation-Based Inference in Generalized Bayes via Neural Posterior Estimation29 Jan 2026
- 2025Fast and Scalable Score-Based Kernel Calibration Tests16 Oct 2025
- 2025Misspecification-robust amortised simulation-based inference using variational methods6 Sep 2025
- 2025Simulation-Based Inference: A Practical Guide18 Aug 2025
- 2025Causal Posterior Estimation27 May 2025
- 2025Effortless, Simulation-Efficient Bayesian Inference using Tabular Foundation Models24 Apr 2025
- 2025A New Stochastic Approximation Method for Gradient-based Simulated Parameter Estimation24 Mar 2025
- 2025Does Unsupervised Domain Adaptation Improve the Robustness of Amortized Bayesian Inference? A Systematic Evaluation7 Feb 2025
- 2024Disentangling impact of capacity, objective, batchsize, estimators, and step-size on flow VI11 Dec 2024
- 2024sbi reloaded: a toolkit for simulation-based inference workflows26 Nov 2024
- 2024Variational Autoencoders for Efficient Simulation-Based Inference21 Nov 2024
- 2024Compositional simulation-based inference for time series5 Nov 2024
12 newest of 40 All 40 (JSON)