Learning Hierarchical Features from Generative Models
Not on the map. Why?
Abstract (arXiv)
Deep neural networks have been shown to be very successful at learning feature hierarchies in supervised learning tasks. Generative models, on the other hand, have benefited less from hierarchical models with multiple layers of latent variables. In this paper, we prove that hierarchical latent variable models do not take advantage of the hierarchical structure when trained with existing variational methods, and provide some limitations on the kind of features existing models can learn. Finally we propose an alternative architecture that do not suffer from these limitations. Our model is able to learn highly interpretable and disentangled hierarchical features on several natural image datasets with no task specific regularization or prior knowledge.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Feb 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 3; 2023: 6; 2024: 3; 2025: 4; 2026: 1.
27 papers.
Sort:
By area:
- 2022Deep Clustering: A Comprehensive Surveycited by 78
- 2021Greedy Hierarchical Variational Autoencoders for Large-Scale Video Predictioncited by 75
- 2021Clockwork Variational Autoencoderscited by 40
- 2023Understanding Masked Autoencoders via Hierarchical Latent Variable Modelscited by 39
- 2021Diagonal Attention and Style-based GAN for Content-Style Disentanglement in Image Generation and Translationcited by 35
- 2021Where and What? Examining Interpretable Disentangled Representationscited by 27
- 2021Commutative Lie Group VAE for Disentanglement Learningcited by 27
- 2023Multifactor Sequential Disentanglement via Structured Koopman Autoencoderscited by 23
- 2021Learning Interpretable Representations of Entanglement in Quantum Optics Experiments using Deep Generative Modelscited by 12
- 2021On Incorporating Inductive Biases into VAEscited by 11
- 2025Scale-wise Distillation of Diffusion Modelscited by 11
- 2021Unsupervised Learning of Neurosymbolic Encoderscited by 8
15 more
- 2023Learning Joint Latent Space EBM Prior Model for Multi-layer Generatorcited by 8
- 2021Multi-Task Neural Processescited by 7
- 2022Gromov-Wasserstein Autoencoderscited by 7
- 2023Beyond Vanilla Variational Autoencoders: Detecting Posterior Collapse in Conditional and Hierarchical Variational Autoencoderscited by 6
- 2023Learning Hierarchical Features with Joint Latent Space Energy-Based Priorcited by 6
- 2024Learning Latent Space Hierarchical EBM Diffusion Modelscited by 6
- 2024Nested Diffusion Models Using Hierarchical Latent Priorscited by 2
- 2023Computing with Categories in Machine Learningcited by 1
- 2025Evolved Hierarchical Masking for Self-Supervised Learningcited by 1
- 2021Meta-learning Amidst Heterogeneity and Ambiguitycited by 0
- 2022A Probabilistic Generative Model of Free Categoriescited by 0
- 2024CAVACHON: a hierarchical variational autoencoder to integrate multi-modal single-cell datacited by 0
- 2025Likelihood-Free Variational Autoencoderscited by 0
- 2025Contrastive Deep Learning for Variant Detection in Wastewater Genomic Sequencingcited by 0
- 2026Latent Fourier Transformcited by 0
- 2026Latent Fourier Transform20 Apr 2026
- 2025Contrastive Deep Learning for Variant Detection in Wastewater Genomic Sequencing2 Dec 2025
- 2025Likelihood-Free Variational Autoencoders24 Apr 2025
- 2025Evolved Hierarchical Masking for Self-Supervised Learning12 Apr 2025
- 2025Scale-wise Distillation of Diffusion Models20 Mar 2025
- 2024Nested Diffusion Models Using Hierarchical Latent Priors8 Dec 2024
- 2024CAVACHON: a hierarchical variational autoencoder to integrate multi-modal single-cell data28 May 2024
- 2024Learning Latent Space Hierarchical EBM Diffusion Models22 May 2024
- 2023Learning Hierarchical Features with Joint Latent Space Energy-Based Prior14 Oct 2023
- 2023Learning Joint Latent Space EBM Prior Model for Multi-layer Generator10 Jun 2023
- 2023Beyond Vanilla Variational Autoencoders: Detecting Posterior Collapse in Conditional and Hierarchical Variational Autoencoders8 Jun 2023
- 2023Understanding Masked Autoencoders via Hierarchical Latent Variable Models8 Jun 2023
15 more
- 2023Multifactor Sequential Disentanglement via Structured Koopman Autoencoders30 Mar 2023
- 2023Computing with Categories in Machine Learning7 Mar 2023
- 2022Deep Clustering: A Comprehensive Survey9 Oct 2022
- 2022Gromov-Wasserstein Autoencoders15 Sep 2022
- 2022A Probabilistic Generative Model of Free Categories9 May 2022
- 2021Multi-Task Neural Processes10 Nov 2021
- 2021Learning Interpretable Representations of Entanglement in Quantum Optics Experiments using Deep Generative Models6 Sep 2021
- 2021Unsupervised Learning of Neurosymbolic Encoders28 Jul 2021
- 2021Meta-learning Amidst Heterogeneity and Ambiguity5 Jul 2021
- 2021On Incorporating Inductive Biases into VAEs25 Jun 2021
- 2021Commutative Lie Group VAE for Disentanglement Learning7 Jun 2021
- 2021Where and What? Examining Interpretable Disentangled Representations7 Apr 2021
- 2021Diagonal Attention and Style-based GAN for Content-Style Disentanglement in Image Generation and Translation30 Mar 2021
- 2021Greedy Hierarchical Variational Autoencoders for Large-Scale Video Prediction6 Mar 2021
- 2021Clockwork Variational Autoencoders18 Feb 2021
- 2025Scale-wise Distillation of Diffusion Modelscited by 11
- 2024Learning Latent Space Hierarchical EBM Diffusion Modelscited by 6
- 2024Nested Diffusion Models Using Hierarchical Latent Priorscited by 2
- 2025Scale-wise Distillation of Diffusion Models20 Mar 2025
- 2024Nested Diffusion Models Using Hierarchical Latent Priors8 Dec 2024
- 2024Learning Latent Space Hierarchical EBM Diffusion Models22 May 2024
- 2022Deep Clustering: A Comprehensive Surveycited by 78
- 2021Greedy Hierarchical Variational Autoencoders for Large-Scale Video Predictioncited by 75
- 2021Clockwork Variational Autoencoderscited by 40
- 2023Understanding Masked Autoencoders via Hierarchical Latent Variable Modelscited by 39
- 2021Diagonal Attention and Style-based GAN for Content-Style Disentanglement in Image Generation and Translationcited by 35
- 2021Where and What? Examining Interpretable Disentangled Representationscited by 27
- 2021Commutative Lie Group VAE for Disentanglement Learningcited by 27
- 2023Multifactor Sequential Disentanglement via Structured Koopman Autoencoderscited by 23
- 2021Learning Interpretable Representations of Entanglement in Quantum Optics Experiments using Deep Generative Modelscited by 12
- 2021On Incorporating Inductive Biases into VAEscited by 11
- 2021Unsupervised Learning of Neurosymbolic Encoderscited by 8
- 2023Learning Joint Latent Space EBM Prior Model for Multi-layer Generatorcited by 8
12 most cited of 24 All 24 (JSON)
- 2026Latent Fourier Transform20 Apr 2026
- 2025Contrastive Deep Learning for Variant Detection in Wastewater Genomic Sequencing2 Dec 2025
- 2025Likelihood-Free Variational Autoencoders24 Apr 2025
- 2025Evolved Hierarchical Masking for Self-Supervised Learning12 Apr 2025
- 2024CAVACHON: a hierarchical variational autoencoder to integrate multi-modal single-cell data28 May 2024
- 2023Learning Hierarchical Features with Joint Latent Space Energy-Based Prior14 Oct 2023
- 2023Learning Joint Latent Space EBM Prior Model for Multi-layer Generator10 Jun 2023
- 2023Beyond Vanilla Variational Autoencoders: Detecting Posterior Collapse in Conditional and Hierarchical Variational Autoencoders8 Jun 2023
- 2023Understanding Masked Autoencoders via Hierarchical Latent Variable Models8 Jun 2023
- 2023Multifactor Sequential Disentanglement via Structured Koopman Autoencoders30 Mar 2023
- 2023Computing with Categories in Machine Learning7 Mar 2023
- 2022Deep Clustering: A Comprehensive Survey9 Oct 2022
12 newest of 24 All 24 (JSON)