Generative Modeling: A Review
Not on the map. Why?
Abstract (arXiv)
We organize the generative-modeling literature around three classes of generators, corresponding to three distinct inferential tasks: estimating counterfactual outcome distributions in causal inference, recovering posteriors from simulated parameter--outcome pairs, and forming predictive outcome distributions. The unifying representation relies on the noise outsourcing theorem of Kallenberg, which expresses a conditional distribution as a deterministic function of its inputs and an independent noise variable. Within this organization we develop generative Bayesian computation, a method in the parameter--outcome class: a quantile neural network, trained on simulated pairs under the pinball loss, that targets the posterior of the parameter directly, without invertible architectures or density evaluation, and that serves equally as a predictive generator once the roles of parameter and outcome are exchanged. We illustrate the framework on an agent-based Ebola transmission application, where generative Bayesian computation recovers accurate posteriors at substantially lower cost than rejection-based simulation inference, while avoiding the density-evaluation and invertibility constraints of competing generators.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 33 of its 78 references that are in the map. First posted on arXiv 24 Dec 2024.
Builds on
33 of 78 references.
References · 33
- 2022Generative Adversarial Networkscited by 5,603
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2016Density estimation using Real NVPcited by 2,029
- 2014NICE: Non-linear Independent Components Estimationcited by 1,052
- 2019An Introduction to Variational Autoencoderscited by 997
- 2017Masked Autoregressive Flow for Density Estimationcited by 680
- 2017Distributional Reinforcement Learning with Quantile Regressioncited by 464
- 2017Nonparametric regression using deep neural networks with ReLU activation functioncited by 431
- 2018Implicit Quantile Networks for Distributional Reinforcement Learningcited by 362
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2018Neural Importance Samplingcited by 154
21 more
- 2019Guided Image Generation with Conditional Invertible Neural Networkscited by 147
- 2018i-RevNet: Deep Invertible Networkscited by 137
- 2018Does data interpolation contradict statistical optimality?cited by 95
- 2020Understanding and Mitigating Exploding Inverses in Invertible Neural Networkscited by 71
- 2018Conditional Density Estimation with Bayesian Normalising Flowscited by 54
- 2018Posterior Concentration for Sparse Deep Learningcited by 50
- 2019Error bounds for deep ReLU networks using the Kolmogorov--Arnold superposition theoremcited by 49
- 2023High-dimensional analysis of double descent for linear regression with random projectionscited by 47
- 2015Learning Summary Statistic for Approximate Bayesian Computation via Deep Neural Networkcited by 39
- 2019MintNet: Building Invertible Neural Networks with Masked Convolutionscited by 35
- 2019Approximate Bayesian computation with the Wasserstein distancecited by 34
- 2018Autoregressive Quantile Networks for Generative Modelingcited by 31
- 2020Quantile regression with deep ReLU Networks: Estimators and minimax ratescited by 24
- 2016Deep Learning in Financecited by 18
- 2020Towards a Theoretical Understanding of the Robustness of Variational Autoencoderscited by 17
- 2022Learning Summary Statistics for Bayesian Inference with Autoencoderscited by 9
- 2020Convolutional Neural Networks as Summary Statistics for Approximate Bayesian Computationcited by 8
- 2015Bayesian Indirect Inference Using a Parametric Auxiliary Modelcited by 7
- 2021Deep Learning Partial Least Squarescited by 5
- 2021Merging Two Cultures: Deep and Statistical Learningcited by 4
- 2022Bayesian Calibration for Activity Based Modelscited by 3
Built on by
Citing papers per year: 2025: 2.
2 papers.
- 2025Generative Learner for Distributional Causal Effectscited by 0
- 2025Generative Bayesian Hyperparameter Tuningcited by 0
- 2025Generative Bayesian Hyperparameter Tuning23 Dec 2025
- 2025Generative Learner for Distributional Causal Effects23 Mar 2025