mlsanityData to 7 Oct 2026

Generative Modeling: A Review

arXiv 2501.05458 ↗First posted 24 Dec 2024stat.CO cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

We organize the generative-modeling literature around three classes of generators, corresponding to three distinct inferential tasks: estimating counterfactual outcome distributions in causal inference, recovering posteriors from simulated parameter--outcome pairs, and forming predictive outcome distributions. The unifying representation relies on the noise outsourcing theorem of Kallenberg, which expresses a conditional distribution as a deterministic function of its inputs and an independent noise variable. Within this organization we develop generative Bayesian computation, a method in the parameter--outcome class: a quantile neural network, trained on simulated pairs under the pinball loss, that targets the posterior of the parameter directly, without invertible architectures or density evaluation, and that serves equally as a predictive generator once the roles of parameter and outcome are exchanged. We illustrate the framework on an agent-based Ebola transmission application, where generative Bayesian computation recovers accurate posteriors at substantially lower cost than rejection-based simulation inference, while avoiding the density-evaluation and invertibility constraints of competing generators.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 33 of its 78 references that are in the map. First posted on arXiv 24 Dec 2024.

Builds on

33 of 78 references.

References · 33

  1. 2022Generative Adversarial Networkscited by 5,603
  2. 2015Variational Inference with Normalizing Flowscited by 2,161
  3. 2014Conditional Generative Adversarial Netscited by 2,152
  4. 2016Density estimation using Real NVPcited by 2,029
  5. 2014NICE: Non-linear Independent Components Estimationcited by 1,052
  6. 2019An Introduction to Variational Autoencoderscited by 997
  7. 2017Masked Autoregressive Flow for Density Estimationcited by 680
  8. 2017Distributional Reinforcement Learning with Quantile Regressioncited by 464
  9. 2017Nonparametric regression using deep neural networks with ReLU activation functioncited by 431
  10. 2018Implicit Quantile Networks for Distributional Reinforcement Learningcited by 362
  11. 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
  12. 2018Neural Importance Samplingcited by 154
21 more
  1. 2019Guided Image Generation with Conditional Invertible Neural Networkscited by 147
  2. 2018i-RevNet: Deep Invertible Networkscited by 137
  3. 2018Does data interpolation contradict statistical optimality?cited by 95
  4. 2020Understanding and Mitigating Exploding Inverses in Invertible Neural Networkscited by 71
  5. 2018Conditional Density Estimation with Bayesian Normalising Flowscited by 54
  6. 2018Posterior Concentration for Sparse Deep Learningcited by 50
  7. 2019Error bounds for deep ReLU networks using the Kolmogorov--Arnold superposition theoremcited by 49
  8. 2023High-dimensional analysis of double descent for linear regression with random projectionscited by 47
  9. 2015Learning Summary Statistic for Approximate Bayesian Computation via Deep Neural Networkcited by 39
  10. 2019MintNet: Building Invertible Neural Networks with Masked Convolutionscited by 35
  11. 2019Approximate Bayesian computation with the Wasserstein distancecited by 34
  12. 2018Autoregressive Quantile Networks for Generative Modelingcited by 31
  13. 2020Quantile regression with deep ReLU Networks: Estimators and minimax ratescited by 24
  14. 2016Deep Learning in Financecited by 18
  15. 2020Towards a Theoretical Understanding of the Robustness of Variational Autoencoderscited by 17
  16. 2022Learning Summary Statistics for Bayesian Inference with Autoencoderscited by 9
  17. 2020Convolutional Neural Networks as Summary Statistics for Approximate Bayesian Computationcited by 8
  18. 2015Bayesian Indirect Inference Using a Parametric Auxiliary Modelcited by 7
  19. 2021Deep Learning Partial Least Squarescited by 5
  20. 2021Merging Two Cultures: Deep and Statistical Learningcited by 4
  21. 2022Bayesian Calibration for Activity Based Modelscited by 3

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.