Learning Hierarchical Priors in VAEs
Not on the map. Why?
Abstract (arXiv)
We propose to learn a hierarchical prior in the context of variational autoencoders to avoid the over-regularisation resulting from a standard normal prior distribution. To incentivise an informative latent representation of the data, we formulate the learning problem as a constrained optimisation problem by extending the Taming VAEs framework to two-level hierarchical models. We introduce a graph-based interpolation method, which shows that the topology of the learned latent representation corresponds to the topology of the data manifold---and present several examples, where desired properties of latent representation such as smoothness and simple explanatory factors are learned by the prior.
Key facts. Cited by 53 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 13; 2023: 11; 2024: 10; 2025: 4; 2026: 4.
53 papers.
Sort:
By area:
- 2022VAEL: Bridging Variational Autoencoders and Probabilistic Logic Programmingcited by 31
- 2021Data Augmentation in High Dimensional Low Sample Size Setting Using a Geometry-Based Variational Autoencodercited by 27
- 2022Efficient-VDVAE: Less is morecited by 26
- 2022Particle algorithms for maximum likelihood training of latent variable modelscited by 26
- 2022Pythae: Unifying Generative Autoencoders in Python -- A Benchmarking Use Casecited by 26
- 2024You Only Sample Once: Taming One-Step Text-to-Image Synthesis by Self-Cooperative Diffusion GANscited by 26
- 2021Conditional Image Generation by Conditioning Variational Auto-Encoderscited by 25
- 2022A Geometric Perspective on Variational Autoencoderscited by 24
- 2021Multiresolution Equivariant Graph Variational Autoencodercited by 20
- 2022Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text Generationcited by 20
- 2022NVDiff: Graph Generation through the Diffusion of Node Vectorscited by 18
- 2021Mind the Gap when Conditioning Amortised Inference in Sequential Latent-Variable Modelscited by 14
38 more
- 2021A prior-based approximate latent Riemannian metriccited by 11
- 2021On Incorporating Inductive Biases into VAEscited by 11
- 2023Revisiting Structured Variational Autoencoderscited by 11
- 2023Lewis's Signaling Game as beta-VAE For Natural Word Lengths and Segmentscited by 11
- 2021Uncertainty Estimation Using Riemannian Model Dynamics for Offline Reinforcement Learningcited by 10
- 2023VTAE: Variational Transformer Autoencoder with Manifolds Learningcited by 10
- 2023Tree Variational Autoencoderscited by 10
- 2023Diffusion Variational Autoencoder for Tackling Stochasticity in Multi-Step Regression Stock Price Predictioncited by 10
- 2024Personalized Federated Collaborative Filtering: A Variational AutoEncoder Approachcited by 9
- 2024Combining Hierachical VAEs with LLMs for clinically meaningful timeline summarisation in social mediacited by 8
- 2024Hierarchical VAE with a Diffusion-based VampPriorcited by 8
- 2021Multi-Task Neural Processescited by 7
- 2024Counterfactual Concept Bottleneck Modelscited by 7
- 2023eVAE: Evolutionary Variational Autoencodercited by 6
- 2024A Review of Bayesian Uncertainty Quantification in Deep Probabilistic Image Segmentationcited by 6
- 2021Disentangling Generative Factors of Physical Fields Using Variational Autoencoderscited by 5
- 2023Towards Flexibility and Interpretability of Gaussian Process State-Space Modelcited by 5
- 2023Variational Mixture of HyperGenerators for Learning Distributions Over Functionscited by 5
- 2023One-Line-of-Code Data Mollification Improves Optimization of Likelihood-based Generative Modelscited by 4
- 2021Hierarchical Variational Auto-Encoding for Unsupervised Domain Generalizationcited by 3
- 2022Improving Variational Autoencoders with Density Gap-based Regularizationcited by 3
- 2022Multimodal hierarchical Variational AutoEncoders with Factor Analysis latent spacecited by 2
- 2025Learning Energy-based Variational Latent Prior for VAEscited by 2
- 2026Latent Matters: Learning Deep State-Space Modelscited by 2
- 2022Deep clustering with fusion autoencodercited by 1
- 2022Flat Latent Manifolds for Human-machine Co-creation of Musiccited by 1
- 2022Structured Graph Variational Autoencoders for Indoor Furniture layout Generationcited by 1
- 2022Local Distance Preserving Auto-encoders using Continuous k-Nearest Neighbours Graphscited by 1
- 2024Guided Decoding for Robot On-line Motion Generation and Adaptioncited by 1
- 2021Symmetric Wasserstein Autoencoderscited by 0
- 2023Dior-CVAE: Pre-trained Language Models and Diffusion Priors for Variational Dialog Generationcited by 0
- 2023Learning variational autoencoders via MCMC speed measurescited by 0
- 2024Sequential Model for Predicting Patient Adherence in Subcutaneous Immunotherapy for Allergic Rhinitiscited by 0
- 2024Integrative Variational Autoencoders for Generative Modeling of an Image Outcome with Multiple Input Imagescited by 0
- 2024M-HOF-Opt: Multi-Objective Hierarchical Output Feedback Optimization via Multiplier Induced Loss Landscape Schedulingcited by 0
- 2025A Generative Deep Learning Workflow for Inverse Molecular Design of Fuelscited by 0
- 2025Why Are Parsing Actions for Understanding Message Hierarchies Not Random?cited by 0
- 2025Disentangled representations via score-based variational autoencoderscited by 0
50 most cited of 53 All 53 (JSON)
- 2026Diffusion-Driven State Space Models19 Jun 2026
- 2026Entropic Auto-Encoding via Implicit Free-Energy Minimization15 May 2026
- 2026Phase-Type Variational Autoencoders for Heavy-Tailed Data2 Mar 2026
- 2026Latent Matters: Learning Deep State-Space Models26 Feb 2026
- 2025Disentangled representations via score-based variational autoencoders18 Dec 2025
- 2025Learning Energy-based Variational Latent Prior for VAEs30 Sep 2025
- 2025Why Are Parsing Actions for Understanding Message Hierarchies Not Random?27 Jun 2025
- 2025A Generative Deep Learning Workflow for Inverse Molecular Design of Fuels16 Apr 2025
- 2024Hierarchical VAE with a Diffusion-based VampPrior2 Dec 2024
- 2024A Review of Bayesian Uncertainty Quantification in Deep Probabilistic Image Segmentation25 Nov 2024
- 2024Personalized Federated Collaborative Filtering: A Variational AutoEncoder Approach16 Aug 2024
- 2024Guided Decoding for Robot On-line Motion Generation and Adaption22 Mar 2024
38 more
- 2024M-HOF-Opt: Multi-Objective Hierarchical Output Feedback Optimization via Multiplier Induced Loss Landscape Scheduling20 Mar 2024
- 2024You Only Sample Once: Taming One-Step Text-to-Image Synthesis by Self-Cooperative Diffusion GANs19 Mar 2024
- 2024Integrative Variational Autoencoders for Generative Modeling of an Image Outcome with Multiple Input Images5 Feb 2024
- 2024Counterfactual Concept Bottleneck Models2 Feb 2024
- 2024Combining Hierachical VAEs with LLMs for clinically meaningful timeline summarisation in social media29 Jan 2024
- 2024Sequential Model for Predicting Patient Adherence in Subcutaneous Immunotherapy for Allergic Rhinitis21 Jan 2024
- 2023Lewis's Signaling Game as beta-VAE For Natural Word Lengths and Segments8 Nov 2023
- 2023Learning variational autoencoders via MCMC speed measures26 Aug 2023
- 2023Diffusion Variational Autoencoder for Tackling Stochasticity in Multi-Step Regression Stock Price Prediction18 Aug 2023
- 2023Tree Variational Autoencoders15 Jun 2023
- 2023One-Line-of-Code Data Mollification Improves Optimization of Likelihood-based Generative Models30 May 2023
- 2023Revisiting Structured Variational Autoencoders25 May 2023
- 2023Dior-CVAE: Pre-trained Language Models and Diffusion Priors for Variational Dialog Generation24 May 2023
- 2023VTAE: Variational Transformer Autoencoder with Manifolds Learning3 Apr 2023
- 2023Variational Mixture of HyperGenerators for Learning Distributions Over Functions13 Feb 2023
- 2023Towards Flexibility and Interpretability of Gaussian Process State-Space Model21 Jan 2023
- 2023eVAE: Evolutionary Variational Autoencoder1 Jan 2023
- 2022NVDiff: Graph Generation through the Diffusion of Node Vectors19 Nov 2022
- 2022Improving Variational Autoencoders with Density Gap-based Regularization1 Nov 2022
- 2022A Geometric Perspective on Variational Autoencoders15 Sep 2022
- 2022Multimodal hierarchical Variational AutoEncoders with Factor Analysis latent space19 Jul 2022
- 2022Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text Generation13 Jul 2022
- 2022Pythae: Unifying Generative Autoencoders in Python -- A Benchmarking Use Case16 Jun 2022
- 2022Local Distance Preserving Auto-encoders using Continuous k-Nearest Neighbours Graphs13 Jun 2022
- 2022Particle algorithms for maximum likelihood training of latent variable models27 Apr 2022
- 2022Structured Graph Variational Autoencoders for Indoor Furniture layout Generation11 Apr 2022
- 2022Efficient-VDVAE: Less is more25 Mar 2022
- 2022Flat Latent Manifolds for Human-machine Co-creation of Music23 Feb 2022
- 2022VAEL: Bridging Variational Autoencoders and Probabilistic Logic Programming7 Feb 2022
- 2022Deep clustering with fusion autoencoder11 Jan 2022
- 2021Multi-Task Neural Processes10 Nov 2021
- 2021Disentangling Generative Factors of Physical Fields Using Variational Autoencoders15 Sep 2021
- 2021On Incorporating Inductive Biases into VAEs25 Jun 2021
- 2021Symmetric Wasserstein Autoencoders24 Jun 2021
- 2021Multiresolution Equivariant Graph Variational Autoencoder2 Jun 2021
- 2021Data Augmentation in High Dimensional Low Sample Size Setting Using a Geometry-Based Variational Autoencoder30 Apr 2021
- 2021A prior-based approximate latent Riemannian metric9 Mar 2021
- 2021Conditional Image Generation by Conditioning Variational Auto-Encoders24 Feb 2021
50 newest of 53 All 53 (JSON)
- 2024You Only Sample Once: Taming One-Step Text-to-Image Synthesis by Self-Cooperative Diffusion GANscited by 26
- 2022NVDiff: Graph Generation through the Diffusion of Node Vectorscited by 18
- 2023Diffusion Variational Autoencoder for Tackling Stochasticity in Multi-Step Regression Stock Price Predictioncited by 10
- 2023Dior-CVAE: Pre-trained Language Models and Diffusion Priors for Variational Dialog Generationcited by 0
- 2025Disentangled representations via score-based variational autoencoderscited by 0
- 2026Diffusion-Driven State Space Modelscited by 0
- 2026Diffusion-Driven State Space Models19 Jun 2026
- 2025Disentangled representations via score-based variational autoencoders18 Dec 2025
- 2024You Only Sample Once: Taming One-Step Text-to-Image Synthesis by Self-Cooperative Diffusion GANs19 Mar 2024
- 2023Diffusion Variational Autoencoder for Tackling Stochasticity in Multi-Step Regression Stock Price Prediction18 Aug 2023
- 2023Dior-CVAE: Pre-trained Language Models and Diffusion Priors for Variational Dialog Generation24 May 2023
- 2022NVDiff: Graph Generation through the Diffusion of Node Vectors19 Nov 2022
- 2021Data Augmentation in High Dimensional Low Sample Size Setting Using a Geometry-Based Variational Autoencodercited by 27
- 2022Efficient-VDVAE: Less is morecited by 26
- 2022Particle algorithms for maximum likelihood training of latent variable modelscited by 26
- 2022Pythae: Unifying Generative Autoencoders in Python -- A Benchmarking Use Casecited by 26
- 2021Conditional Image Generation by Conditioning Variational Auto-Encoderscited by 25
- 2022A Geometric Perspective on Variational Autoencoderscited by 24
- 2021Multiresolution Equivariant Graph Variational Autoencodercited by 20
- 2022Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text Generationcited by 20
- 2021Mind the Gap when Conditioning Amortised Inference in Sequential Latent-Variable Modelscited by 14
- 2021A prior-based approximate latent Riemannian metriccited by 11
- 2021On Incorporating Inductive Biases into VAEscited by 11
- 2023Revisiting Structured Variational Autoencoderscited by 11
12 most cited of 45 All 45 (JSON)
- 2026Entropic Auto-Encoding via Implicit Free-Energy Minimization15 May 2026
- 2026Phase-Type Variational Autoencoders for Heavy-Tailed Data2 Mar 2026
- 2026Latent Matters: Learning Deep State-Space Models26 Feb 2026
- 2025Learning Energy-based Variational Latent Prior for VAEs30 Sep 2025
- 2025Why Are Parsing Actions for Understanding Message Hierarchies Not Random?27 Jun 2025
- 2025A Generative Deep Learning Workflow for Inverse Molecular Design of Fuels16 Apr 2025
- 2024Hierarchical VAE with a Diffusion-based VampPrior2 Dec 2024
- 2024A Review of Bayesian Uncertainty Quantification in Deep Probabilistic Image Segmentation25 Nov 2024
- 2024Personalized Federated Collaborative Filtering: A Variational AutoEncoder Approach16 Aug 2024
- 2024Guided Decoding for Robot On-line Motion Generation and Adaption22 Mar 2024
- 2024M-HOF-Opt: Multi-Objective Hierarchical Output Feedback Optimization via Multiplier Induced Loss Landscape Scheduling20 Mar 2024
- 2024Integrative Variational Autoencoders for Generative Modeling of an Image Outcome with Multiple Input Images5 Feb 2024
12 newest of 45 All 45 (JSON)