Neural Approximate Sufficient Statistics for Implicit Models
Not on the map. Why?
Abstract (arXiv)
We consider the fundamental problem of how to automatically construct summary statistics for implicit generative models where the evaluation of the likelihood function is intractable, but sampling data from the model is possible. The idea is to frame the task of constructing sufficient statistics as learning mutual information maximizing representations of the data with the help of deep neural networks. The infomax learning procedure does not need to estimate any density or density ratio. We apply our approach to both traditional approximate Bayesian computation and recent neural likelihood methods, boosting their performance on a range of tasks.
Key facts. Cited by 72 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 13; 2023: 13; 2024: 10; 2025: 17; 2026: 8.
72 papers.
Sort:
- 2021Benchmarking Simulation-Based Inferencecited by 160
- 2021Implicit Deep Adaptive Design: Policy-Based Experimental Design without Likelihoodscited by 61
- 2023Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimizationcited by 57
- 2023Learning Robust Statistics for Simulation-based Inference under Model Misspecificationcited by 48
- 2022Robust Neural Posterior Estimation and Statistical Model Criticismcited by 45
- 2023Sampling-Based Accuracy Testing of Posterior Estimators for General Inferencecited by 45
- 2022Variational methods for simulation-based inferencecited by 43
- 2023JANA: Jointly Amortized Neural Approximation of Complex Bayesian Modelscited by 41
- 2024Neural Methods for Amortized Inferencecited by 36
- 2022Predictive Inference with Feature Conformal Predictioncited by 33
- 2025Simulation-Based Inference: A Practical Guidecited by 30
- 2021Gradient-based Bayesian Experimental Design for Implicit Models using Mutual Information Lower Boundscited by 26
38 more
- 2024Addressing Misspecification in Simulation-based Inference through Data-driven Calibrationcited by 26
- 2023Sensitivity-Aware Amortized Bayesian Inferencecited by 20
- 2021Learning Prototype-oriented Set Representations for Meta-Learningcited by 19
- 2021Group equivariant neural posterior estimationcited by 16
- 2022Black-box Bayesian inference for economic agent-based modelscited by 13
- 2023Neural Bayes Estimators for Irregular Spatial Data using Graph Neural Networkscited by 13
- 2025Effortless, Simulation-Efficient Bayesian Inference using Tabular Foundation Modelscited by 13
- 2024Amortized Bayesian Multilevel Modelscited by 12
- 2021Unifying Likelihood-free Inference with Black-box Optimization and Beyondcited by 10
- 2025Does Unsupervised Domain Adaptation Improve the Robustness of Amortized Bayesian Inference? A Systematic Evaluationcited by 10
- 2022Learning Summary Statistics for Bayesian Inference with Autoencoderscited by 9
- 2022Approximate Bayesian Computation with Domain Expert in the Loopcited by 9
- 2024Poly-View Contrastive Learningcited by 9
- 2025Simulation-based Bayesian inference under model misspecificationcited by 9
- 2021TIP: Task-Informed Motion Prediction for Intelligent Vehiclescited by 8
- 2022Amortised Likelihood-free Inference for Expensive Time-series Simulators with Signatured Ratio Estimationcited by 8
- 2023Scalable Infomin Learningcited by 8
- 2023Simulation-based Inference for High-dimensional Data using Surjective Sequential Neural Likelihood Estimationcited by 8
- 2024Detecting Model Misspecification in Amortized Bayesian Inference with Neural Networks: An Extended Investigationcited by 8
- 2024Compositional simulation-based inference for time seriescited by 8
- 2021A Generalizable Model-and-Data Driven Approach for Open-Set RFF Authenticationcited by 7
- 2022Statistical applications of contrastive learningcited by 5
- 2022Efficient identification of informative features in simulation-based inferencecited by 5
- 2022Embed and Emulate: Learning to estimate parameters of dynamical systems with uncertainty quantificationcited by 5
- 2024Simulation-based Inference with the Python Package sbijaxcited by 5
- 2025Robust Simulation-Based Inference under Missing Data via Neural Processescited by 5
- 2021Robust and integrative Bayesian neural networks for likelihood-free parameter inferencecited by 4
- 2021Bayesian Optimal Experimental Design for Simulator Models of Cognitioncited by 4
- 2025Inductive Domain Transfer In Misspecified Simulation-Based Inferencecited by 4
- 2025Neural Mutual Information Estimation with Vector Copulascited by 4
- 2023Designing Optimal Behavioral Experiments Using Machine Learningcited by 3
- 2023Fuse It or Lose It: Deep Fusion for Multimodal Simulation-Based Inferencecited by 3
- 2024Hybrid Summary Statisticscited by 3
- 2025Amortized Bayesian Mixture Modelscited by 3
- 2025Posterior SBC: Simulation-Based Calibration Checking Conditional on Datacited by 3
- 2025Generative Distribution Embeddings: Lifting autoencoders to the space of distributions for multiscale representation learningcited by 3
- 2026Minimum Distance Summaries for Robust Neural Posterior Estimationcited by 3
- 2023Exploiting Inferential Structure in Neural Processescited by 2
50 most cited of 72 All 72 (JSON)
- 2026Amortized ratio-estimation importance sampling and localized simulation-based calibration for intractable likelihoods30 Sep 2026
- 2026Mitigating Representation Gaps in Amortized Bayesian Inference with Auxiliary Supervision30 Sep 2026
- 2026High-Dimensional Simulation-Based Inference in Latent Spaces29 Sep 2026
- 2026Neural composite likelihood estimation: simulation based inference for time series18 Sep 2026
- 2026InfoAtlas: A Foundation Model for Zero-Shot Statistical Dependence Estimate29 May 2026
- 2026It Just Takes Two: Scaling Amortized Inference to Large Sets8 May 2026
- 2026Information-Preserving Domain Transfer with Unlabeled Data in Misspecified Simulation-Based Inference7 May 2026
- 2026Minimum Distance Summaries for Robust Neural Posterior Estimation9 Feb 2026
- 2025JADAI: Jointly Amortizing Adaptive Design and Bayesian Inference28 Dec 2025
- 2025Fast and Robust Simulation-Based Inference With Optimization Monte Carlo17 Nov 2025
- 2025Dark Energy Survey Year 3 results: Simulation-based wCDM inference from weak lensing and galaxy clustering maps with deep learning: Analysis design6 Nov 2025
- 2025Neural Mutual Information Estimation with Vector Copulas23 Oct 2025
38 more
- 2025Misspecification-robust amortised simulation-based inference using variational methods6 Sep 2025
- 2025Inductive Domain Transfer In Misspecified Simulation-Based Inference21 Aug 2025
- 2025Simulation-Based Inference: A Practical Guide18 Aug 2025
- 2025Causal Posterior Estimation27 May 2025
- 2025Generative Distribution Embeddings: Lifting autoencoders to the space of distributions for multiscale representation learning23 May 2025
- 2025Effortless, Simulation-Efficient Bayesian Inference using Tabular Foundation Models24 Apr 2025
- 2025Simulation-based inference for stochastic nonlinear mixed-effects models with applications in systems biology15 Apr 2025
- 2025Simulation-based Bayesian inference under model misspecification16 Mar 2025
- 2025Robust Simulation-Based Inference under Missing Data via Neural Processes3 Mar 2025
- 2025Meta-Statistical Learning: Supervised Learning of Statistical Estimators17 Feb 2025
- 2025Does Unsupervised Domain Adaptation Improve the Robustness of Amortized Bayesian Inference? A Systematic Evaluation7 Feb 2025
- 2025Posterior SBC: Simulation-Based Calibration Checking Conditional on Data5 Feb 2025
- 2025Amortized Bayesian Mixture Models17 Jan 2025
- 2024Compositional simulation-based inference for time series5 Nov 2024
- 2024Hybrid Summary Statistics10 Oct 2024
- 2024Simulation-based Inference with the Python Package sbijax28 Sep 2024
- 2024Amortized Bayesian Multilevel Models23 Aug 2024
- 2024Mutual Information Multinomial Estimation18 Aug 2024
- 2024Detecting Model Misspecification in Amortized Bayesian Inference with Neural Networks: An Extended Investigation5 Jun 2024
- 2024Addressing Misspecification in Simulation-based Inference through Data-driven Calibration14 May 2024
- 2024Sample-efficient neural likelihood-free Bayesian inference of implicit HMMs2 May 2024
- 2024Neural Methods for Amortized Inference18 Apr 2024
- 2024Poly-View Contrastive Learning8 Mar 2024
- 2023Fuse It or Lose It: Deep Fusion for Multimodal Simulation-Based Inference17 Nov 2023
- 2023Rare Event Probability Learning by Normalizing Flows29 Oct 2023
- 2023Sensitivity-Aware Amortized Bayesian Inference17 Oct 2023
- 2023Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimization4 Oct 2023
- 2023Neural Bayes Estimators for Irregular Spatial Data using Graph Neural Networks4 Oct 2023
- 2023Simulation-based Inference for High-dimensional Data using Surjective Sequential Neural Likelihood Estimation2 Aug 2023
- 2023Exploiting Inferential Structure in Neural Processes27 Jun 2023
- 2023Universal Approximation and the Topological Neural Network26 May 2023
- 2023Learning Robust Statistics for Simulation-based Inference under Model Misspecification25 May 2023
- 2023Designing Optimal Behavioral Experiments Using Machine Learning12 May 2023
- 2023Scalable Infomin Learning21 Feb 2023
- 2023JANA: Jointly Amortized Neural Approximation of Complex Bayesian Models17 Feb 2023
- 2023Sampling-Based Accuracy Testing of Posterior Estimators for General Inference6 Feb 2023
- 2022Embed and Emulate: Learning to estimate parameters of dynamical systems with uncertainty quantification3 Nov 2022
- 2022Efficient identification of informative features in simulation-based inference21 Oct 2022
50 newest of 72 All 72 (JSON)
- 2021Benchmarking Simulation-Based Inferencecited by 160
- 2021Implicit Deep Adaptive Design: Policy-Based Experimental Design without Likelihoodscited by 61
- 2023Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimizationcited by 57
- 2023Learning Robust Statistics for Simulation-based Inference under Model Misspecificationcited by 48
- 2022Robust Neural Posterior Estimation and Statistical Model Criticismcited by 45
- 2023Sampling-Based Accuracy Testing of Posterior Estimators for General Inferencecited by 45
- 2022Variational methods for simulation-based inferencecited by 43
- 2023JANA: Jointly Amortized Neural Approximation of Complex Bayesian Modelscited by 41
- 2024Neural Methods for Amortized Inferencecited by 36
- 2022Predictive Inference with Feature Conformal Predictioncited by 33
- 2025Simulation-Based Inference: A Practical Guidecited by 30
- 2021Gradient-based Bayesian Experimental Design for Implicit Models using Mutual Information Lower Boundscited by 26
12 most cited of 72 All 72 (JSON)
- 2026Amortized ratio-estimation importance sampling and localized simulation-based calibration for intractable likelihoods30 Sep 2026
- 2026Mitigating Representation Gaps in Amortized Bayesian Inference with Auxiliary Supervision30 Sep 2026
- 2026High-Dimensional Simulation-Based Inference in Latent Spaces29 Sep 2026
- 2026Neural composite likelihood estimation: simulation based inference for time series18 Sep 2026
- 2026InfoAtlas: A Foundation Model for Zero-Shot Statistical Dependence Estimate29 May 2026
- 2026It Just Takes Two: Scaling Amortized Inference to Large Sets8 May 2026
- 2026Information-Preserving Domain Transfer with Unlabeled Data in Misspecified Simulation-Based Inference7 May 2026
- 2026Minimum Distance Summaries for Robust Neural Posterior Estimation9 Feb 2026
- 2025JADAI: Jointly Amortizing Adaptive Design and Bayesian Inference28 Dec 2025
- 2025Fast and Robust Simulation-Based Inference With Optimization Monte Carlo17 Nov 2025
- 2025Dark Energy Survey Year 3 results: Simulation-based wCDM inference from weak lensing and galaxy clustering maps with deep learning: Analysis design6 Nov 2025
- 2025Neural Mutual Information Estimation with Vector Copulas23 Oct 2025
12 newest of 72 All 72 (JSON)