Towards Deeper Understanding of Variational Autoencoding Models
Not on the map. Why?
Abstract (arXiv)
We propose a new family of optimization criteria for variational auto-encoding models, generalizing the standard evidence lower bound. We provide conditions under which they recover the data distribution and learn latent features, and formally show that common issues such as blurry samples and uninformative latent features arise when these conditions are not met. Based on these new insights, we propose a new sequential VAE model that can generate sharp samples on the LSUN image dataset based on pixel-wise reconstruction loss, and propose an optimization criterion that encourages unsupervised learning of informative latent features.
Key facts. Cited by 56 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Feb 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 20; 2022: 15; 2023: 9; 2024: 4; 2025: 3; 2026: 4.
56 papers.
Sort:
By area:
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2019Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Modelscited by 177
- 2022Lossy Image Compression with Conditional Diffusion Modelscited by 165
- 2021High-Fidelity Pluralistic Image Completion with Transformerscited by 134
- 2021D2C: Diffusion-Denoising Models for Few-shot Conditional Generationcited by 96
- 2022HyperImpute: Generalized Iterative Imputation with Automatic Model Selectioncited by 81
- 2021Diverse Image Inpainting with Bidirectional and Autoregressive Transformerscited by 80
- 2021Greedy Hierarchical Variational Autoencoders for Large-Scale Video Predictioncited by 75
- 2023ReMasker: Imputing Tabular Data with Masked Autoencodingcited by 35
- 2021Towards Defending against Adversarial Examples via Attack-Invariant Featurescited by 25
- 2021Factor Analysis, Probabilistic Principal Component Analysis, Variational Inference, and Variational Autoencoder: Tutorial and Surveycited by 21
- 2021Creativity and Machine Learning: A Surveycited by 21
38 more
- 2021A deep generative model for probabilistic energy forecasting in power systems: normalizing flowscited by 18
- 2023DICE: Diverse Diffusion Model with Scoring for Trajectory Predictioncited by 18
- 2022Astronomia ex machina: a history, primer, and outlook on neural networks in astronomycited by 17
- 2023Precipitation Downscaling with Spatiotemporal Video Diffusioncited by 16
- 2024Inference via Interpolation: Contrastive Representations Provably Enable Planning and Inferencecited by 15
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
- 2022Hierarchical Latent Structure for Multi-Modal Vehicle Trajectory Forecastingcited by 14
- 2021Cauchy-Schwarz Regularized Autoencodercited by 13
- 2021TopicNet: Semantic Graph-Guided Topic Discoverycited by 9
- 2021Compositional Learning-based Planning for Vision POMDPscited by 8
- 2022An Adaptive Federated Relevance Framework for Spatial Temporal Graph Learningcited by 7
- 2022PAEDID: Patch Autoencoder Based Deep Image Decomposition For Pixel-level Defective Region Segmentationcited by 6
- 2022Hierarchical Residual Learning Based Vector Quantized Variational Autoencoder for Image Reconstruction and Generationcited by 6
- 2023Coupled Variational Autoencodercited by 6
- 2023Leveraging Variational Autoencoders for Parameterized MMSE Estimationcited by 6
- 2024Controllable Distortion-Perception Tradeoff Through Latent Diffusion for Neural Image Compressioncited by 6
- 2021Spread Flows for Manifold Modellingcited by 4
- 2022Continual Learning with Invertible Generative Modelscited by 3
- 2022Deterministic training of generative autoencoders using invertible layerscited by 3
- 2022Compositional Mixture Representations for Vision and Textcited by 3
- 2021Self-Supervised Delineation of Geological Structures using Orthogonal Latent Space Projectioncited by 2
- 2023Variational Diffusion Auto-encoder: Latent Space Extraction from Pre-trained Diffusion Modelscited by 2
- 2024SUICA: Learning Super-high Dimensional Sparse Implicit Neural Representations for Spatial Transcriptomicscited by 2
- 2021Momentum Contrastive Autoencoder: Using Contrastive Learning for Latent Space Distribution Matching in WAEcited by 1
- 2022Multi-modal data generation with a deep metric variational autoencodercited by 1
- 2022Variational Autoencoders Without the Variationcited by 1
- 2022A Structure-Guided Diffusion Model for Large-Hole Image Completioncited by 1
- 2025Generative AI Meets Wireless Sensing: Towards Wireless Foundation Modelcited by 1
- 2026CEPAE: Conditional Entropy-Penalized Autoencoders for Time Series Counterfactualscited by 1
- 2026Multimodal Continuous Reasoning via Asymmetric Mutual Variational Learningcited by 1
- 2021Deep Probabilistic Graphical Modelingcited by 0
- 2021Meta-learning Amidst Heterogeneity and Ambiguitycited by 0
- 2021The Effects of Invertibility on the Representational Complexity of Encoders in Variational Autoencoderscited by 0
- 2021LDC-VAE: A Latent Distribution Consistency Approach to Variational AutoEncoderscited by 0
- 2021Challenging the Semi-Supervised VAE Framework for Text Classificationcited by 0
- 2022CommsVAE: Learning the brain's macroscale communication dynamics using coupled sequential VAEscited by 0
- 2022Generalizing Multimodal Variational Methods to Setscited by 0
- 2023Interpretable Sentence Representation with Variational Autoencoders and Attentioncited by 0
50 most cited of 56 All 56 (JSON)
- 2026Multimodal Continuous Reasoning via Asymmetric Mutual Variational Learning1 Jul 2026
- 2026Unsupervised Disentanglement Without Compromises : How Functional Orthogonality Enforces Identifiability19 Jun 2026
- 2026Not Too Generative, Not Too Discriminative: The Human Alignment Sweet Spot22 May 2026
- 2026CEPAE: Conditional Entropy-Penalized Autoencoders for Time Series Counterfactuals17 Feb 2026
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmap11 Nov 2025
- 2025Generative AI Meets Wireless Sensing: Towards Wireless Foundation Model18 Sep 2025
- 2025Parameter-aware high-fidelity microstructure generation using stable diffusion1 Jul 2025
- 2024Controllable Distortion-Perception Tradeoff Through Latent Diffusion for Neural Image Compression16 Dec 2024
- 2024SUICA: Learning Super-high Dimensional Sparse Implicit Neural Representations for Spatial Transcriptomics2 Dec 2024
- 2024The Quest for Early Detection of Retinal Disease: 3D CycleGAN-based Translation of Optical Coherence Tomography into Confocal Microscopy7 Aug 2024
- 2024Inference via Interpolation: Contrastive Representations Provably Enable Planning and Inference6 Mar 2024
- 2023Denoising diffusion-based synthetic generation of three-dimensional (3D) anisotropic microstructures from two-dimensional (2D) micrographs13 Dec 2023
38 more
- 2023Precipitation Downscaling with Spatiotemporal Video Diffusion11 Dec 2023
- 2023DICE: Diverse Diffusion Model with Scoring for Trajectory Prediction23 Oct 2023
- 2023ReMasker: Imputing Tabular Data with Masked Autoencoding25 Sep 2023
- 2023Speech representation learning: Learning bidirectional encoders with single-view, multi-view, and multi-task methods25 Jul 2023
- 2023Leveraging Variational Autoencoders for Parameterized MMSE Estimation11 Jul 2023
- 2023Coupled Variational Autoencoder5 Jun 2023
- 2023Interpretable Sentence Representation with Variational Autoencoders and Attention4 May 2023
- 2023Variational Diffusion Auto-encoder: Latent Space Extraction from Pre-trained Diffusion Models24 Apr 2023
- 2022Generalizing Multimodal Variational Methods to Sets19 Dec 2022
- 2022A Structure-Guided Diffusion Model for Large-Hole Image Completion18 Nov 2022
- 2022Astronomia ex machina: a history, primer, and outlook on neural networks in astronomy7 Nov 2022
- 2022CommsVAE: Learning the brain's macroscale communication dynamics using coupled sequential VAEs7 Oct 2022
- 2022Lossy Image Compression with Conditional Diffusion Models14 Sep 2022
- 2022Hierarchical Residual Learning Based Vector Quantized Variational Autoencoder for Image Reconstruction and Generation9 Aug 2022
- 2022Hierarchical Latent Structure for Multi-Modal Vehicle Trajectory Forecasting11 Jul 2022
- 2022HyperImpute: Generalized Iterative Imputation with Automatic Model Selection15 Jun 2022
- 2022Compositional Mixture Representations for Vision and Text13 Jun 2022
- 2022An Adaptive Federated Relevance Framework for Spatial Temporal Graph Learning7 Jun 2022
- 2022Deterministic training of generative autoencoders using invertible layers19 May 2022
- 2022PAEDID: Patch Autoencoder Based Deep Image Decomposition For Pixel-level Defective Region Segmentation28 Mar 2022
- 2022Variational Autoencoders Without the Variation1 Mar 2022
- 2022Continual Learning with Invertible Generative Models11 Feb 2022
- 2022Multi-modal data generation with a deep metric variational autoencoder7 Feb 2022
- 2021Compositional Learning-based Planning for Vision POMDPs17 Dec 2021
- 2021TopicNet: Semantic Graph-Guided Topic Discovery27 Oct 2021
- 2021Momentum Contrastive Autoencoder: Using Contrastive Learning for Latent Space Distribution Matching in WAE19 Oct 2021
- 2021Spread Flows for Manifold Modelling29 Sep 2021
- 2021Challenging the Semi-Supervised VAE Framework for Text Classification27 Sep 2021
- 2021LDC-VAE: A Latent Distribution Consistency Approach to Variational AutoEncoders22 Sep 2021
- 2021Self-Supervised Delineation of Geological Structures using Orthogonal Latent Space Projection22 Aug 2021
- 2021The Effects of Invertibility on the Representational Complexity of Encoders in Variational Autoencoders9 Jul 2021
- 2021Meta-learning Amidst Heterogeneity and Ambiguity5 Jul 2021
- 2021A deep generative model for probabilistic energy forecasting in power systems: normalizing flows17 Jun 2021
- 2021D2C: Diffusion-Denoising Models for Few-shot Conditional Generation12 Jun 2021
- 2021Towards Defending against Adversarial Examples via Attack-Invariant Features9 Jun 2021
- 2021Diverse Image Inpainting with Bidirectional and Autoregressive Transformers26 Apr 2021
- 2021Deep Probabilistic Graphical Modeling25 Apr 2021
- 2021Creativity and Machine Learning: A Survey6 Apr 2021
50 newest of 56 All 56 (JSON)
- 2022Lossy Image Compression with Conditional Diffusion Modelscited by 165
- 2023DICE: Diverse Diffusion Model with Scoring for Trajectory Predictioncited by 18
- 2023Precipitation Downscaling with Spatiotemporal Video Diffusioncited by 16
- 2024Controllable Distortion-Perception Tradeoff Through Latent Diffusion for Neural Image Compressioncited by 6
- 2023Variational Diffusion Auto-encoder: Latent Space Extraction from Pre-trained Diffusion Modelscited by 2
- 2022A Structure-Guided Diffusion Model for Large-Hole Image Completioncited by 1
- 2023Denoising diffusion-based synthetic generation of three-dimensional (3D) anisotropic microstructures from two-dimensional (2D) micrographscited by 0
- 2025Parameter-aware high-fidelity microstructure generation using stable diffusioncited by 0
- 2025Parameter-aware high-fidelity microstructure generation using stable diffusion1 Jul 2025
- 2024Controllable Distortion-Perception Tradeoff Through Latent Diffusion for Neural Image Compression16 Dec 2024
- 2023Denoising diffusion-based synthetic generation of three-dimensional (3D) anisotropic microstructures from two-dimensional (2D) micrographs13 Dec 2023
- 2023Precipitation Downscaling with Spatiotemporal Video Diffusion11 Dec 2023
- 2023DICE: Diverse Diffusion Model with Scoring for Trajectory Prediction23 Oct 2023
- 2023Variational Diffusion Auto-encoder: Latent Space Extraction from Pre-trained Diffusion Models24 Apr 2023
- 2022A Structure-Guided Diffusion Model for Large-Hole Image Completion18 Nov 2022
- 2022Lossy Image Compression with Conditional Diffusion Models14 Sep 2022
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2021High-Fidelity Pluralistic Image Completion with Transformerscited by 134
- 2021D2C: Diffusion-Denoising Models for Few-shot Conditional Generationcited by 96
- 2022HyperImpute: Generalized Iterative Imputation with Automatic Model Selectioncited by 81
- 2021Diverse Image Inpainting with Bidirectional and Autoregressive Transformerscited by 80
- 2021Greedy Hierarchical Variational Autoencoders for Large-Scale Video Predictioncited by 75
- 2023ReMasker: Imputing Tabular Data with Masked Autoencodingcited by 35
- 2021Towards Defending against Adversarial Examples via Attack-Invariant Featurescited by 25
- 2021Factor Analysis, Probabilistic Principal Component Analysis, Variational Inference, and Variational Autoencoder: Tutorial and Surveycited by 21
- 2021Creativity and Machine Learning: A Surveycited by 21
- 2021A deep generative model for probabilistic energy forecasting in power systems: normalizing flowscited by 18
- 2022Astronomia ex machina: a history, primer, and outlook on neural networks in astronomycited by 17
12 most cited of 44 All 44 (JSON)
- 2026Unsupervised Disentanglement Without Compromises : How Functional Orthogonality Enforces Identifiability19 Jun 2026
- 2026Not Too Generative, Not Too Discriminative: The Human Alignment Sweet Spot22 May 2026
- 2026CEPAE: Conditional Entropy-Penalized Autoencoders for Time Series Counterfactuals17 Feb 2026
- 2025Generative AI Meets Wireless Sensing: Towards Wireless Foundation Model18 Sep 2025
- 2024SUICA: Learning Super-high Dimensional Sparse Implicit Neural Representations for Spatial Transcriptomics2 Dec 2024
- 2024The Quest for Early Detection of Retinal Disease: 3D CycleGAN-based Translation of Optical Coherence Tomography into Confocal Microscopy7 Aug 2024
- 2024Inference via Interpolation: Contrastive Representations Provably Enable Planning and Inference6 Mar 2024
- 2023ReMasker: Imputing Tabular Data with Masked Autoencoding25 Sep 2023
- 2023Speech representation learning: Learning bidirectional encoders with single-view, multi-view, and multi-task methods25 Jul 2023
- 2023Leveraging Variational Autoencoders for Parameterized MMSE Estimation11 Jul 2023
- 2023Coupled Variational Autoencoder5 Jun 2023
- 2023Interpretable Sentence Representation with Variational Autoencoders and Attention4 May 2023
12 newest of 44 All 44 (JSON)