Tree Variational Autoencoders
Not on the map. Why?
Abstract (arXiv)
We propose Tree Variational Autoencoder (TreeVAE), a new generative hierarchical clustering model that learns a flexible tree-based posterior distribution over latent variables. TreeVAE hierarchically divides samples according to their intrinsic characteristics, shedding light on hidden structures in the data. It adapts its architecture to discover the optimal tree for encoding dependencies between latent variables. The proposed tree-based generative architecture enables lightweight conditional inference and improves generative performance by utilizing specialized leaf decoders. We show that TreeVAE uncovers underlying clusters in the data and finds meaningful hierarchical relations between the different groups on a variety of datasets, including real-world imaging data. We present empirically that TreeVAE provides a more competitive log-likelihood lower bound than the sequential counterparts. Finally, due to its generative nature, TreeVAE is able to generate new samples from the discovered clusters via conditional sampling.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 37 of its 82 references that are in the map. First posted on arXiv 15 Jun 2023.
Builds on
37 of 82 references.
References · 37
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
- 2019An Introduction to Variational Autoencoderscited by 1,000
- 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 640
- 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 637
- 2016Ladder Variational Autoencoderscited by 318
- 2020Contrastive Clusteringcited by 265
- 2017Distilling a Neural Network Into a Soft Decision Treecited by 236
25 more
- 2020Federated learning with hierarchical clustering of local updates to improve training on non-IID datacited by 223
- 2016Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoderscited by 220
- 2015DRAW: A Recurrent Neural Network For Image Generationcited by 191
- 2019Continuous Hierarchical Representations with Poincar'e Variational Auto-Encoderscited by 112
- 2019BIVA: A Very Deep Hierarchy of Latent Variables for Generative Modelingcited by 109
- 2015Hierarchical Variational Modelscited by 89
- 2018Adaptive Neural Treescited by 64
- 2022Twin Contrastive Learning for Online Clusteringcited by 60
- 2019Learning Hierarchical Priors in VAEscited by 53
- 2015Scalable Sparse Subspace Clustering by Orthogonal Matching Pursuitcited by 50
- 2022On Computing Probabilistic Explanations for Decision Treescited by 35
- 2023Explicitly Minimizing the Blur Error of Variational Autoencoderscited by 31
- 2017Faithful Inversion of Generative Models for Effective Amortized Inferencecited by 29
- 2018Leveraging the Exact Likelihood of Deep Latent Variable Modelscited by 23
- 2017Nonparametric Variational Auto-encoders for Hierarchical Representation Learningcited by 22
- 2022Multi-Rate VAE: Train Once, Get the Full Rate-Distortion Curvecited by 18
- 2021Connecting Interpretability and Robustness in Decision Trees through Separationcited by 16
- 2021Deep Conditional Gaussian Mixture Model for Constrained Clusteringcited by 14
- 2022POETREE: Interpretable Policy Learning with Adaptive Decision Treescited by 14
- 2021Uniform Manifold Approximation and Projection (UMAP) and its Variants: Tutorial and Surveycited by 10
- 2023A Multi-Resolution Framework for U-Nets with Applications to Hierarchical VAEscited by 9
- 2022Unsupervised Object Representation Learning using Translation and Rotation Group Equivariant VAEcited by 8
- 2019Hierarchically Clustered Representation Learningcited by 6
- 2023Trading Information between Latents in Hierarchical Variational Autoencoderscited by 6
- 2018The LORACs prior for VAEs: Letting the Trees Speak for the Datacited by 3
Built on by
Citing papers per year: 2024: 5; 2025: 2; 2026: 3.
10 papers.
- 2024From Logits to Hierarchies: Hierarchical Clustering made Simplecited by 3
- 2024TreeDiffusion: Hierarchical Generative Clustering for Conditional Diffusioncited by 3
- 2024Weakly Augmented Variational Autoencoder in Time Series Anomaly Detectioncited by 2
- 2024scTree: Discovering Cellular Hierarchies in the Presence of Batch Effects in scRNA-seq Datacited by 2
- 2026Foundation Model for Cardiac Time Series via Masked Latent Attentioncited by 1
- 2024Structured Generations: Using Hierarchical Clusters to guide Diffusion Modelscited by 0
- 2025HDTree: Generative Modeling of Cellular Hierarchies for Robust Lineage Inferencecited by 0
- 2025Disentangled representations via score-based variational autoencoderscited by 0
- 2026Classification Fields: Arbitrarily Fine Recursive Hierarchical Clustering From Few Examplescited by 0
- 2026Diffusion Models and Concept Formationcited by 0
- 2026Diffusion Models and Concept Formation11 Sep 2026
- 2026Classification Fields: Arbitrarily Fine Recursive Hierarchical Clustering From Few Examples8 May 2026
- 2026Foundation Model for Cardiac Time Series via Masked Latent Attention27 Mar 2026
- 2025Disentangled representations via score-based variational autoencoders18 Dec 2025
- 2025HDTree: Generative Modeling of Cellular Hierarchies for Robust Lineage Inference29 Jun 2025
- 2024TreeDiffusion: Hierarchical Generative Clustering for Conditional Diffusion22 Oct 2024
- 2024From Logits to Hierarchies: Hierarchical Clustering made Simple10 Oct 2024
- 2024Structured Generations: Using Hierarchical Clusters to guide Diffusion Models8 Jul 2024
- 2024scTree: Discovering Cellular Hierarchies in the Presence of Batch Effects in scRNA-seq Data27 Jun 2024
- 2024Weakly Augmented Variational Autoencoder in Time Series Anomaly Detection7 Jan 2024