Robust Simulation-Based Inference under Missing Data via Neural Processes
Not on the map. Why?
Abstract (arXiv)
Simulation-based inference (SBI) methods typically require fully observed data to infer parameters of models with intractable likelihood functions. However, datasets often contain missing values due to incomplete observations, data corruptions (common in astrophysics), or instrument limitations (e.g., in high-energy physics applications). In such scenarios, missing data must be imputed before applying any SBI method. We formalize the problem of missing data in SBI and demonstrate that naive imputation methods can introduce bias in the estimation of SBI posterior. We also introduce a novel amortized method that addresses this issue by jointly learning the imputation model and the inference network within a neural posterior estimation (NPE) framework. Extensive empirical results on SBI benchmarks show that our approach provides robust inference outcomes compared to standard baselines for varying levels of missing data. Moreover, we demonstrate the merits of our imputation model on two real-world bioactivity datasets (Adrenergic and Kinase assays). Code is available at https://github.com/Aalto-QuML/RISE.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 49 of its 88 references that are in the map. First posted on arXiv 3 Mar 2025.
Builds on
49 of 88 references.
References · 49
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2017Deep Setscited by 1,421
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
- 2017Masked Autoregressive Flow for Density Estimationcited by 684
- 2019Neural Spline Flowscited by 596
- 2019The frontier of simulation-based inferencecited by 502
- 2018Conditional Neural Processescited by 426
- 2018GAIN: Missing Data Imputation using Generative Adversarial Netscited by 352
- 2016Revisiting Classifier Two-Sample Testscited by 268
- 2018Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flowscited by 221
- 2019Automatic Posterior Transformation for Likelihood-Free Inferencecited by 219
37 more
- 2019GP-VAE: Deep Probabilistic Time Series Imputationcited by 172
- 2017Flexible statistical inference for mechanistic models of neural dynamicscited by 163
- 2021Benchmarking Simulation-Based Inferencecited by 162
- 2018Handling Incomplete Heterogeneous Data using VAEscited by 149
- 2020BayesFlow: Learning complex stochastic models with invertible neural networkscited by 144
- 2020Missing Data Imputation using Optimal Transportcited by 100
- 2021Real-time gravitational-wave science with neural posterior estimationcited by 78
- 2020Meta-Learning Stationary Stochastic Process Prediction with Convolutional Neural Processescited by 76
- 2019MisGAN: Learning from Incomplete Data with Generative Adversarial Networkscited by 75
- 2020Neural Approximate Sufficient Statistics for Implicit Modelscited by 74
- 2024All-in-one simulation-based inferencecited by 74
- 2018Gaussian Process Prior Variational Autoencoderscited by 72
- 2020not-MIWAE: Deep Generative Modelling with Missing not at Random Datacited by 62
- 2021Detecting Model Misspecification in Amortized Bayesian Inference with Neural Networkscited by 49
- 2022Compositional Score Modeling for Simulation-based Inferencecited by 48
- 2023Learning Robust Statistics for Simulation-based Inference under Model Misspecificationcited by 48
- 2022Robust Neural Posterior Estimation and Statistical Model Criticismcited by 46
- 2019Statistical Inference for Generative Models with Maximum Mean Discrepancycited by 45
- 2022Robust Bayesian Inference for Simulator-based Models via the MMD Posterior Bootstrapcited by 41
- 2018Processing of missing data by neural networkscited by 37
- 2018A Likelihood-Free Inference Framework for Population Genetic Data using Exchangeable Neural Networkscited by 31
- 2023Transformed Distribution Matching for Missing Value Imputationcited by 31
- 2020VAEs in the Presence of Missing Datacited by 30
- 2021Identifiable Generative Models for Missing Not at Random Data Imputationcited by 30
- 2020Longitudinal Variational Autoencodercited by 25
- 2024Diffusion posterior sampling for simulation-based inference in tall data settingscited by 19
- 2023Adversarial robustness of amortized Bayesian inferencecited by 17
- 2023Generalized Bayesian Inference for Scientific Simulators via Amortized Cost Estimationcited by 17
- 2021Variational Selective Autoencoder: Learning from Partially-Observed Heterogeneous Datacited by 10
- 2020A General Method for Calibrating Stochastic Radio Channel Models with Kernelscited by 9
- 2022Approximate Bayesian Computation with Domain Expert in the Loopcited by 9
- 2021ABC of the Futurecited by 7
- 2024Optimal Transport for Structure Learning Under Missing Datacited by 6
- 2021Deep Generative Pattern-Set Mixture Models for Nonignorable Missingnesscited by 3
- 2023Machine-learning-based particle identification with missing datacited by 3
- 2022Monte Carlo Techniques for Addressing Large Errors and Missing Data in Simulation-based Inferencecited by 1
- 2024Latent variable model for high-dimensional point process with structured missingnesscited by 1
Built on by
Citing papers per year: 2025: 4; 2026: 1.
5 papers.
- 2025Causal Posterior Estimationcited by 1
- 2025Flexible Gravitational-Wave Parameter Estimation with Transformerscited by 1
- 2025A Review of Diffusion-based Simulation-Based Inference: Foundations and Applications in Non-Ideal Data Scenarioscited by 1
- 2025AD-NODE: Adaptive Dynamics Learning with Neural ODEs for Mobile Robots Controlcited by 0
- 2026Overcoming Selection Bias in Statistical Studies With Amortized Bayesian Inferencecited by 0
- 2026Overcoming Selection Bias in Statistical Studies With Amortized Bayesian Inference20 Apr 2026
- 2025A Review of Diffusion-based Simulation-Based Inference: Foundations and Applications in Non-Ideal Data Scenarios26 Dec 2025
- 2025Flexible Gravitational-Wave Parameter Estimation with Transformers2 Dec 2025
- 2025AD-NODE: Adaptive Dynamics Learning with Neural ODEs for Mobile Robots Control6 Oct 2025
- 2025Causal Posterior Estimation27 May 2025