Latent Variable Modelling Using Variational Autoencoders: A survey
Not on the map. Why?
Abstract (arXiv)
A probability distribution allows practitioners to uncover hidden structure in the data and build models to solve supervised learning problems using limited data. The focus of this report is on Variational autoencoders, a method to learn the probability distribution of large complex datasets. The report provides a theoretical understanding of variational autoencoders and consolidates the current research in the field. The report is divided into multiple chapters, the first chapter introduces the problem, describes variational autoencoders and identifies key research directions in the field. Chapters 2, 3, 4 and 5 dive into the details of each of the key research areas. Chapter 6 concludes the report and suggests directions for future work. A reader who has a basic idea of machine learning but wants to learn about general themes in machine learning research can benefit from the report. The report explains central ideas on learning probability distributions, what people did to make this tractable and goes into details around how deep learning is currently applied. The report also serves a gentle introduction for someone looking to contribute to this sub-field.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 33 of its 50 references that are in the map. First posted on arXiv 20 Jun 2022.
Builds on
33 of 50 references.
References · 33
- 2022Generative Adversarial Networkscited by 5,627
- 2017Neural Discrete Representation Learningcited by 4,712
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2016Density estimation using Real NVPcited by 2,042
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,148
- 2014NICE: Non-linear Independent Components Estimationcited by 1,058
- 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 640
- 2015Importance Weighted Autoencoderscited by 456
- 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
- 2013Black Box Variational Inferencecited by 319
- 2016Ladder Variational Autoencoderscited by 318
21 more
- 2016Adversarially Learned Inferencecited by 216
- 2015DRAW: A Recurrent Neural Network For Image Generationcited by 191
- 2016Variational Lossy Autoencodercited by 176
- 2016Discrete Variational Autoencoderscited by 125
- 2017InfoVAE: Information Maximizing Variational Autoencoderscited by 124
- 2013Generalized Denoising Auto-Encoders as Generative Modelscited by 113
- 2017Backpropagation through the Void: Optimizing control variates for black-box gradient estimationcited by 106
- 2017Sticking the Landing: Simple, Lower-Variance Gradient Estimators for Variational Inferencecited by 98
- 2017Filtering Variational Objectivescited by 91
- 2015Hierarchical Variational Modelscited by 89
- 2016Variational inference for Monte Carlo objectivescited by 84
- 2017REBAR: Low-variance, unbiased gradient estimates for discrete latent variable modelscited by 79
- 2016PixelVAE: A Latent Variable Model for Natural Imagescited by 70
- 2016Improving Variational Auto-Encoders using Householder Flowcited by 42
- 2017Reinterpreting Importance-Weighted Autoencoderscited by 37
- 2015The Variational Gaussian Processcited by 30
- 2016The Generalized Reparameterization Gradientcited by 30
- 2017Reducing Reparameterization Gradient Variancecited by 27
- 2016Operator Variational Inferencecited by 16
- 2017A Divergence Bound for Hybrids of MCMC and Variational Inference and an Application to Langevin Dynamics and SGVIcited by 4
- 2013Computing Upper and Lower Bounds on Likelihoods in Intractable Networkscited by 2
Built on by
Citing papers per year: 2023: 1.
1 paper.