Adversarial Variational Bayes: Unifying Variational Autoencoders and Generative Adversarial Networks
Not on the map. Why?
Abstract (arXiv)
Variational Autoencoders (VAEs) are expressive latent variable models that can be used to learn complex probability distributions from training data. However, the quality of the resulting model crucially relies on the expressiveness of the inference model. We introduce Adversarial Variational Bayes (AVB), a technique for training Variational Autoencoders with arbitrarily expressive inference models. We achieve this by introducing an auxiliary discriminative network that allows to rephrase the maximum-likelihood-problem as a two-player game, hence establishing a principled connection between VAEs and Generative Adversarial Networks (GANs). We show that in the nonparametric limit our method yields an exact maximum-likelihood assignment for the parameters of the generative model, as well as the exact posterior distribution over the latent variables given an observation. Contrary to competing approaches which combine VAEs with GANs, our approach has a clear theoretical justification, retains most advantages of standard Variational Autoencoders and is easy to implement.
Key facts. Cited by 107 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Jan 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 2; 2021: 30; 2022: 21; 2023: 24; 2024: 10; 2025: 13; 2026: 6.
107 papers.
Sort:
By area:
- 2022Generative Adversarial Networkscited by 5,603
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2018Variational Discriminator Bottleneck: Improving Imitation Learning, Inverse RL, and GANs by Constraining Information Flowcited by 103
- 2022Synthesizing Informative Training Samples with GANcited by 77
- 2021Posterior Meta-Replay for Continual Learningcited by 45
- 2021KALE Flow: A Relaxed KL Gradient Flow for Probabilities with Disjoint Supportcited by 37
- 2022GATSBI: Generative Adversarial Training for Simulation-Based Inferencecited by 36
- 2024A survey of synthetic data augmentation methods in computer visioncited by 34
- 2023A Rigorous Link between Deep Ensembles and (Variational) Bayesian Methodscited by 31
- 2021Adversarial and Contrastive Variational Autoencoder for Sequential Recommendationcited by 28
- 2022Diagnosing and Fixing Manifold Overfitting in Deep Generative Modelscited by 28
- 2022CaloMan: Fast generation of calorimeter showers with density estimation on learned manifoldscited by 28
38 more
- 2021DP-Image: Differential Privacy for Image Data in Feature Spacecited by 23
- 2023Denoising diffusion algorithm for inverse design of microstructures with fine-tuned nonlinear material propertiescited by 23
- 2023Spatiotemporal Self-supervised Learning for Point Clouds in the Wildcited by 23
- 2021Factor Analysis, Probabilistic Principal Component Analysis, Variational Inference, and Variational Autoencoder: Tutorial and Surveycited by 21
- 2020Biased Mixtures Of Experts: Enabling Computer Vision Inference Under Data Transfer Limitationscited by 20
- 2021Efficient Out-of-Distribution Detection Using Latent Space of β-VAE for Cyber-Physical Systemscited by 19
- 2021Stochastic Physics-Informed Neural Ordinary Differential Equationscited by 19
- 2023Semi-Implicit Variational Inference via Score Matchingcited by 19
- 2021Variational inference with a quantum computercited by 18
- 2021Lifelong Teacher-Student Network Learningcited by 18
- 2023Learning to Estimate 6DoF Pose from Limited Data: A Few-Shot, Generalizable Approach using RGB Imagescited by 18
- 2022Sliced Wasserstein Variational Inferencecited by 17
- 2024Sparse Inducing Points in Deep Gaussian Processes: Enhancing Modeling with Denoising Diffusion Variational Inferencecited by 16
- 2021Mind the Gap when Conditioning Amortised Inference in Sequential Latent-Variable Modelscited by 14
- 2023Hierarchical Semi-Implicit Variational Inference with Application to Diffusion Model Accelerationcited by 14
- 2025Generative Models in Decision Making: A Surveycited by 14
- 2021Function-space Inference with Sparse Implicit Processescited by 13
- 2023Uncertainty-Aware Pedestrian Trajectory Prediction via Distributional Diffusioncited by 13
- 2022Bottlenecks CLUB: Unifying Information-Theoretic Trade-offs Among Complexity, Leakage, and Utilitycited by 12
- 2023UMat: Uncertainty-Aware Single Image High Resolution Material Capturecited by 11
- 2021Variational Selective Autoencoder: Learning from Partially-Observed Heterogeneous Datacited by 10
- 2021Revisiting Bayesian Autoencoders with MCMCcited by 10
- 2020Regularized Inverse Reinforcement Learningcited by 9
- 2021Bayesian graph convolutional neural networks via tempered MCMCcited by 9
- 2023Precision-Recall Divergence Optimization for Generative Modeling with GANs and Normalizing Flowscited by 9
- 2023Supervised structure learningcited by 9
- 2021Deep Image Synthesis from Intuitive User Input: A Review and Perspectivescited by 8
- 2024Kernel Semi-Implicit Variational Inferencecited by 8
- 2021Reliable Estimation of KL Divergence using a Discriminator in Reproducing Kernel Hilbert Spacecited by 7
- 2022Gromov-Wasserstein Autoencoderscited by 7
- 2022Variational Laplace Autoencoderscited by 7
- 2021Inferential Wasserstein Generative Adversarial Networkscited by 6
- 2022Forget-me-not! Contrastive Critics for Mitigating Posterior Collapsecited by 6
- 2023Neural Operator Variational Inference based on Regularized Stein Discrepancy for Deep Gaussian Processescited by 6
- 2022Leveraging Relational Information for Learning Weakly Disentangled Representationscited by 5
- 2022Generative Bayesian Inference with GANscited by 5
- 2023Variational Classificationcited by 5
- 2023Implicit Variational Inference for High-Dimensional Posteriorscited by 5
50 most cited of 107 All 107 (JSON)
- 2026IP Protection in the Era of Visual Generative AI: A Survey13 Aug 2026
- 2026Multi-Teacher Contrastive Distillation for Edge-Efficient Pathology Foundation Models6 Jul 2026
- 2026Implicit Variational Rejection Sampling12 Jun 2026
- 2026Intermediate Representations are Strong AI-Generated Image Detectors5 May 2026
- 2026Regularized f-Divergence Kernel Tests27 Jan 2026
- 2026A Kernel Approach for Semi-implicit Variational Inference17 Jan 2026
- 2025TRIDENT: A Trimodal Cascade Generative Framework for Drug and RNA-Conditioned Cellular Morphology Synthesis23 Nov 2025
- 2025SMS: Self-supervised Model Seeding for Verification of Machine Unlearning30 Sep 2025
- 2025Sensory robustness through top-down feedback and neural stochasticity in recurrent vision models9 Aug 2025
- 2025Bridging GANs and Bayesian Neural Networks via Partial Stochasticity1 Jul 2025
- 2025Revisiting Unbiased Implicit Variational Inference4 Jun 2025
- 2025Simulating the Unseen: Crash Prediction Must Learn from What Did Not Happen27 May 2025
38 more
- 2025Joint-stochastic-approximation Random Fields with Application to Semi-supervised Learning24 May 2025
- 2025Joint-stochastic-approximation Autoencoders with Application to Semi-supervised Learning24 May 2025
- 2025Likelihood-Free Variational Autoencoders24 Apr 2025
- 2025Bayesian Computation in Deep Learning25 Feb 2025
- 2025Generative Models in Decision Making: A Survey24 Feb 2025
- 2025Generative Adversarial Networks for High-Dimensional Item Factor Analysis: A Deep Adversarial Learning Algorithm15 Feb 2025
- 2025Reinforcement-Learning Portfolio Allocation with Dynamic Embedding of Market Information29 Jan 2025
- 2024Deep Learning for Spatio-Temporal Fusion in Land Surface Temperature Estimation: A Comprehensive Survey, Experimental Analysis, and Future Trends21 Dec 2024
- 2024Self-supervised cross-modality learning for uncertainty-aware object detection and recognition in applications which lack pre-labelled training data5 Nov 2024
- 2024Variational Bayesian Phylogenetic Inference with Semi-implicit Branch Length Distributions9 Aug 2024
- 2024Sparse Inducing Points in Deep Gaussian Processes: Enhancing Modeling with Denoising Diffusion Variational Inference24 Jul 2024
- 2024SoftCVI: Contrastive variational inference with self-generated soft labels22 Jul 2024
- 2024A-SDM: Accelerating Stable Diffusion through Model Assembly and Feature Inheritance Strategies31 May 2024
- 2024Kernel Semi-Implicit Variational Inference29 May 2024
- 2024A survey of synthetic data augmentation methods in computer vision15 Mar 2024
- 2024Training Implicit Generative Models via an Invariant Statistical Loss26 Feb 2024
- 2024A Statistical Analysis of Wasserstein Autoencoders for Intrinsically Low-dimensional Data24 Feb 2024
- 2023A self-attention-based differentially private tabular GAN with high data utility20 Dec 2023
- 2023Pseudo-Likelihood Inference28 Nov 2023
- 2023Supervised structure learning17 Nov 2023
- 2023Hierarchical Semi-Implicit Variational Inference with Application to Diffusion Model Acceleration26 Oct 2023
- 2023Compressed representation of brain genetic transcription24 Oct 2023
- 2023On Unsupervised Image-to-image translation and GAN stability18 Oct 2023
- 2023Implicit Variational Inference for High-Dimensional Posteriors10 Oct 2023
- 2023Neural Operator Variational Inference based on Regularized Stein Discrepancy for Deep Gaussian Processes22 Sep 2023
- 2023Unsupervised Text Style Transfer with Deep Generative Models31 Aug 2023
- 2023A Bayesian Non-parametric Approach to Generative Models: Integrating Variational Autoencoder and Generative Adversarial Networks using Wasserstein and Maximum Mean Discrepancy27 Aug 2023
- 2023Semi-Implicit Variational Inference via Score Matching19 Aug 2023
- 2023PatchContrast: Self-Supervised Pre-training for 3D Object Detection14 Aug 2023
- 2023Symmetric Equilibrium Learning of VAEs19 Jul 2023
- 2023Variational Counterfactual Prediction under Runtime Domain Corruption23 Jun 2023
- 2023Learning to Estimate 6DoF Pose from Limited Data: A Few-Shot, Generalizable Approach using RGB Images13 Jun 2023
- 2023Contagion Effect Estimation Using Proximal Embeddings4 Jun 2023
- 2023Precision-Recall Divergence Optimization for Generative Modeling with GANs and Normalizing Flows30 May 2023
- 2023One-Line-of-Code Data Mollification Improves Optimization of Likelihood-based Generative Models30 May 2023
- 2023UMat: Uncertainty-Aware Single Image High Resolution Material Capture25 May 2023
- 2023A Rigorous Link between Deep Ensembles and (Variational) Bayesian Methods24 May 2023
- 2023Variational Classification17 May 2023
50 newest of 107 All 107 (JSON)
- 2023Denoising diffusion algorithm for inverse design of microstructures with fine-tuned nonlinear material propertiescited by 23
- 2024Sparse Inducing Points in Deep Gaussian Processes: Enhancing Modeling with Denoising Diffusion Variational Inferencecited by 16
- 2023Hierarchical Semi-Implicit Variational Inference with Application to Diffusion Model Accelerationcited by 14
- 2024A-SDM: Accelerating Stable Diffusion through Model Assembly and Feature Inheritance Strategiescited by 3
- 2024Sparse Inducing Points in Deep Gaussian Processes: Enhancing Modeling with Denoising Diffusion Variational Inference24 Jul 2024
- 2024A-SDM: Accelerating Stable Diffusion through Model Assembly and Feature Inheritance Strategies31 May 2024
- 2023Hierarchical Semi-Implicit Variational Inference with Application to Diffusion Model Acceleration26 Oct 2023
- 2023Denoising diffusion algorithm for inverse design of microstructures with fine-tuned nonlinear material properties24 Feb 2023
- 2026Regularized f-Divergence Kernel Testscited by 2
- 2025SMS: Self-supervised Model Seeding for Verification of Machine Unlearningcited by 0
- 2026Regularized f-Divergence Kernel Tests27 Jan 2026
- 2025SMS: Self-supervised Model Seeding for Verification of Machine Unlearning30 Sep 2025
- 2022Generative Adversarial Networkscited by 5,603
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2022Synthesizing Informative Training Samples with GANcited by 77
- 2021Posterior Meta-Replay for Continual Learningcited by 45
- 2021KALE Flow: A Relaxed KL Gradient Flow for Probabilities with Disjoint Supportcited by 37
- 2022GATSBI: Generative Adversarial Training for Simulation-Based Inferencecited by 36
- 2024A survey of synthetic data augmentation methods in computer visioncited by 34
- 2023A Rigorous Link between Deep Ensembles and (Variational) Bayesian Methodscited by 31
- 2021Adversarial and Contrastive Variational Autoencoder for Sequential Recommendationcited by 28
- 2022Diagnosing and Fixing Manifold Overfitting in Deep Generative Modelscited by 28
- 2022CaloMan: Fast generation of calorimeter showers with density estimation on learned manifoldscited by 28
- 2021DP-Image: Differential Privacy for Image Data in Feature Spacecited by 23
12 most cited of 98 All 98 (JSON)
- 2026IP Protection in the Era of Visual Generative AI: A Survey13 Aug 2026
- 2026Multi-Teacher Contrastive Distillation for Edge-Efficient Pathology Foundation Models6 Jul 2026
- 2026Implicit Variational Rejection Sampling12 Jun 2026
- 2026Intermediate Representations are Strong AI-Generated Image Detectors5 May 2026
- 2026A Kernel Approach for Semi-implicit Variational Inference17 Jan 2026
- 2025TRIDENT: A Trimodal Cascade Generative Framework for Drug and RNA-Conditioned Cellular Morphology Synthesis23 Nov 2025
- 2025Sensory robustness through top-down feedback and neural stochasticity in recurrent vision models9 Aug 2025
- 2025Bridging GANs and Bayesian Neural Networks via Partial Stochasticity1 Jul 2025
- 2025Revisiting Unbiased Implicit Variational Inference4 Jun 2025
- 2025Simulating the Unseen: Crash Prediction Must Learn from What Did Not Happen27 May 2025
- 2025Joint-stochastic-approximation Random Fields with Application to Semi-supervised Learning24 May 2025
- 2025Joint-stochastic-approximation Autoencoders with Application to Semi-supervised Learning24 May 2025
12 newest of 98 All 98 (JSON)