mlsanityData to 7 Oct 2026

Compositional simulation-based inference for time series

arXiv 2411.02728 ↗First posted 5 Nov 2024cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

Amortized simulation-based inference (SBI) methods train neural networks on simulated data to perform Bayesian inference. While this strategy avoids the need for tractable likelihoods, it often requires a large number of simulations and has been challenging to scale to time series data. Scientific simulators frequently emulate real-world dynamics through thousands of single-state transitions over time. We propose an SBI approach that can exploit such Markovian simulators by locally identifying parameters consistent with individual state transitions. We then compose these local results to obtain a posterior over parameters that align with the entire time series observation. We focus on applying this approach to neural posterior score estimation but also show how it can be applied, e.g., to neural likelihood (ratio) estimation. We demonstrate that our approach is more simulation-efficient than directly estimating the global posterior on several synthetic benchmark tasks and simulators used in ecology and epidemiology. Finally, we validate scalability and simulation efficiency of our approach by applying it to a high-dimensional Kolmogorov flow simulator with around one million data dimensions.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 52 of its 94 references that are in the map. First posted on arXiv 5 Nov 2024.

Builds on

52 of 94 references.

References · 52

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  3. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  4. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  5. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  6. 2015Variational Inference with Normalizing Flowscited by 2,161
  7. 2017Masked Autoregressive Flow for Density Estimationcited by 680
  8. 2019Neural Spline Flowscited by 590
  9. 2019The frontier of simulation-based inferencecited by 490
  10. 2021Machine learning accelerated computational fluid dynamicscited by 461
  11. 2016Revisiting Classifier Two-Sample Testscited by 258
  12. 2018Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flowscited by 217
38 more
  1. 2019Automatic Posterior Transformation for Likelihood-Free Inferencecited by 216
  2. 2019Generalized Sliced Wasserstein Distancescited by 205
  3. 2017Flexible statistical inference for mechanistic models of neural dynamicscited by 162
  4. 2021Benchmarking Simulation-Based Inferencecited by 160
  5. 2020BayesFlow: Learning complex stochastic models with invertible neural networkscited by 139
  6. 2018Validating Bayesian Inference Algorithms with Simulation-Based Calibrationcited by 118
  7. 2022Unveiling Transformers with LEGO: a synthetic reasoning taskcited by 105
  8. 2023Flow Matching for Scalable Simulation-Based Inferencecited by 97
  9. 2020On Contrastive Learning for Likelihood-free Inferencecited by 96
  10. 2023Score-based Data Assimilationcited by 91
  11. 2021Real-time gravitational-wave science with neural posterior estimationcited by 76
  12. 2020Neural Approximate Sufficient Statistics for Implicit Modelscited by 72
  13. 2024All-in-one simulation-based inferencecited by 71
  14. 2015Bayesian Optimization for Likelihood-Free Inference of Simulator-Based Statistical Modelscited by 61
  15. 2022Sequential Neural Score Estimation: Likelihood-Free Inference with Conditional Score Based Diffusion Modelscited by 50
  16. 2020Bayesian Workflowcited by 47
  17. 2022Compositional Score Modeling for Simulation-based Inferencecited by 46
  18. 2022Investigating the Impact of Model Misspecification in Neural Simulation-based Inferencecited by 44
  19. 2022Variational methods for simulation-based inferencecited by 43
  20. 2023JANA: Jointly Amortized Neural Approximation of Complex Bayesian Modelscited by 41
  21. 2022Truncated proposals for scalable and hassle-free simulation-based inferencecited by 40
  22. 2019Approximate Bayesian computation with the Wasserstein distancecited by 34
  23. 2016Inference Compilation and Universal Probabilistic Programmingcited by 31
  24. 2018A Likelihood-Free Inference Framework for Population Genetic Data using Exchangeable Neural Networkscited by 30
  25. 2019Meta-Amortized Variational Inference and Learningcited by 21
  26. 2023Adversarial robustness of amortized Bayesian inferencecited by 17
  27. 2024Diffusion posterior sampling for simulation-based inference in tall data settingscited by 17
  28. 2022Amortized Variational Inference: A Systematic Reviewcited by 16
  29. 2024A Practical Guide to Sample-based Statistical Distances for Evaluating Generative Models in Sciencecited by 14
  30. 2021Discrepancy-based Inference for Intractable Generative Models using Quasi-Monte Carlocited by 12
  31. 2021Approximate Bayesian Computation with Path Signaturescited by 12
  32. 2020Simulation-based inference methods for particle physicscited by 11
  33. 2022Graphically Structured Diffusion Modelscited by 11
  34. 2022Amortised Likelihood-free Inference for Expensive Time-series Simulators with Signatured Ratio Estimationcited by 8
  35. 2017Modified Hamiltonian Monte Carlo for Bayesian inferencecited by 7
  36. 2023MCMC-Correction of Score-Based Diffusion Models for Model Compositioncited by 7
  37. 2024Cost-aware simulation-based inferencecited by 6
  38. 2023Recursion in Recursion: Two-Level Nested Recursion for Length Generalization with Scalabilitycited by 5

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 6; 2026: 2.

8 papers.