Pythae: Unifying Generative Autoencoders in Python -- A Benchmarking Use Case
Not on the map. Why?
Abstract (arXiv)
In recent years, deep generative models have attracted increasing interest due to their capacity to model complex distributions. Among those models, variational autoencoders have gained popularity as they have proven both to be computationally efficient and yield impressive results in multiple fields. Following this breakthrough, extensive research has been done in order to improve the original publication, resulting in a variety of different VAE models in response to different tasks. In this paper we present Pythae, a versatile open-source Python library providing both a unified implementation and a dedicated framework allowing straightforward, reproducible and reliable use of generative autoencoder models. We then propose to use this library to perform a case study benchmark where we present and compare 19 generative autoencoder models representative of some of the main improvements on downstream tasks such as image reconstruction, generation, classification, clustering and interpolation. The open-source library can be found at https://github.com/clementchadebec/benchmark_VAE.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 43 of its 78 references that are in the map. First posted on arXiv 16 Jun 2022.
Builds on
43 of 78 references.
References · 43
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Neural Discrete Representation Learningcited by 4,650
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2016Improved Techniques for Training GANscited by 2,938
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
- 2016Deep Variational Information Bottleneckcited by 915
- 2017Masked Autoregressive Flow for Density Estimationcited by 680
- 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 636
- 2018Disentangling by Factorisingcited by 614
- 2015Importance Weighted Autoencoderscited by 454
31 more
- 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
- 2017Wasserstein Auto-Encoderscited by 371
- 2015Adversarial Autoencoderscited by 359
- 2018Understanding disentangling in β-VAEcited by 332
- 2015MADE: Masked Autoencoder for Distribution Estimationcited by 306
- 2017VAE with a VampPriorcited by 247
- 2017Advances in Variational Inferencecited by 236
- 2018A Note on the Inception Scorecited by 225
- 2016Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoderscited by 219
- 2019Diagnosing and Enhancing VAE Modelscited by 192
- 2018Hyperspherical Variational Auto-Encoderscited by 188
- 2016Variational Lossy Autoencodercited by 175
- 2017Latent Space Oddity: on the Curvature of Deep Generative Modelscited by 169
- 2019Effectively Unbiased FID and Inception Score and where to find themcited by 161
- 2018Inference Suboptimality in Variational Autoencoderscited by 131
- 2019From Variational to Deterministic Autoencoderscited by 131
- 2017InfoVAE: Information Maximizing Variational Autoencoderscited by 124
- 2019Continuous Hierarchical Representations with Poincar'e Variational Auto-Encoderscited by 111
- 2020Learning Latent Space Energy-Based Prior Modelcited by 104
- 2018Understanding and Improving Interpolation in Autoencoders via an Adversarial Regularizercited by 87
- 2017The Riemannian Geometry of Deep Generative Modelscited by 81
- 2018How good is my GAN?cited by 74
- 2018Explorations in Homeomorphic Variational Auto-Encodingcited by 65
- 2018Resampled Priors for Variational Autoencoderscited by 56
- 2017Metrics for Deep Generative Modelscited by 53
- 2019Learning Hierarchical Priors in VAEscited by 53
- 2018Hamiltonian Variational Auto-Encodercited by 41
- 2020Variational Autoencoder with Learned Latent Structurecited by 41
- 2015Learning to Generate Images with Perceptual Similarity Metricscited by 39
- 2020Variational Autoencoders with Riemannian Brownian Motion Priorscited by 34
- 2021Data Augmentation in High Dimensional Low Sample Size Setting Using a Geometry-Based Variational Autoencodercited by 27
Built on by
Citing papers per year: 2022: 2; 2023: 9; 2024: 6; 2025: 6; 2026: 3.
26 papers.
Sort:
- 2022Multi-Rate VAE: Train Once, Get the Full Rate-Distortion Curvecited by 18
- 2023Lifting Architectural Constraints of Injective Flowscited by 17
- 2024Evaluation of pseudo-healthy image reconstruction for anomaly detection with deep generative models: Application to brain FDG PETcited by 10
- 2025An efficient probabilistic hardware architecture for diffusion-like modelscited by 8
- 2024Boosting Flow-based Generative Super-Resolution Models via Learned Priorcited by 7
- 2023Risk-Controlling Model Selection via Guided Bayesian Optimizationcited by 5
- 2025Can3Tok: Canonical 3D Tokenization and Latent Modeling of Scene-Level 3D Gaussianscited by 5
- 2023One-Line-of-Code Data Mollification Improves Optimization of Likelihood-based Generative Modelscited by 4
- 2024α-TCVAE: On the relationship between Disentanglement and Diversitycited by 4
- 2025LangVAE and LangSpace: Building and Probing for Language Model VAEscited by 3
- 2023Modeling Complex Disease Trajectories using Deep Generative Models with Semi-Supervised Latent Processescited by 2
- 2024Analyzing Generative Models by Manifold Entropic Metricscited by 2
14 more
- 2025Geodesic Calculus on Implicitly Defined Latent Manifoldscited by 2
- 2023TC-VAE: Uncovering Out-of-Distribution Data Generative Factorscited by 1
- 2023Improving Multimodal Joint Variational Autoencoders through Normalizing Flows and Correlation Analysiscited by 1
- 2025Generator-Mediated Bandits: Thompson Sampling for GenAI-Powered Adaptive Interventionscited by 1
- 2022GMM-IL: Image Classification using Incrementally Learnt, Independent Probabilistic Models for Small Sample Sizescited by 0
- 2023Simplex Autoencoderscited by 0
- 2023Variational Inference for Longitudinal Data Using Normalizing Flowscited by 0
- 2023Sampling From Autoencoders' Latent Space via Quantization And Probability Mass Function Conceptscited by 0
- 2024Semi-Supervised Generative Models for Disease Trajectories: A Case Study on Systemic Sclerosiscited by 0
- 2024An Empirical Study on Improving SimCLR's Nonlinear Projection Head using Pretrained Autoencoder Embeddingscited by 0
- 2025Bidirectional Variational Autoencoderscited by 0
- 2026Learning a Latent Pulse Shape Interface for Photoinjector Laser Systemscited by 0
- 2026How Neural Losses Shape VAE Latentscited by 0
- 2026A Multi-stage Constrained Optimization Framework for Data-driven Problemscited by 0
- 2026A Multi-stage Constrained Optimization Framework for Data-driven Problems26 Jul 2026
- 2026How Neural Losses Shape VAE Latents30 May 2026
- 2026Learning a Latent Pulse Shape Interface for Photoinjector Laser Systems19 Feb 2026
- 2025An efficient probabilistic hardware architecture for diffusion-like models28 Oct 2025
- 2025Geodesic Calculus on Implicitly Defined Latent Manifolds10 Oct 2025
- 2025Can3Tok: Canonical 3D Tokenization and Latent Modeling of Scene-Level 3D Gaussians2 Aug 2025
- 2025Generator-Mediated Bandits: Thompson Sampling for GenAI-Powered Adaptive Interventions22 May 2025
- 2025Bidirectional Variational Autoencoders21 May 2025
- 2025LangVAE and LangSpace: Building and Probing for Language Model VAEs29 Mar 2025
- 2024α-TCVAE: On the relationship between Disentanglement and Diversity1 Nov 2024
- 2024Analyzing Generative Models by Manifold Entropic Metrics25 Oct 2024
- 2024An Empirical Study on Improving SimCLR's Nonlinear Projection Head using Pretrained Autoencoder Embeddings25 Aug 2024
14 more
- 2024Semi-Supervised Generative Models for Disease Trajectories: A Case Study on Systemic Sclerosis16 Jul 2024
- 2024Boosting Flow-based Generative Super-Resolution Models via Learned Prior16 Mar 2024
- 2024Evaluation of pseudo-healthy image reconstruction for anomaly detection with deep generative models: Application to brain FDG PET29 Jan 2024
- 2023Risk-Controlling Model Selection via Guided Bayesian Optimization4 Dec 2023
- 2023Modeling Complex Disease Trajectories using Deep Generative Models with Semi-Supervised Latent Processes14 Nov 2023
- 2023Sampling From Autoencoders' Latent Space via Quantization And Probability Mass Function Concepts21 Aug 2023
- 2023Lifting Architectural Constraints of Injective Flows2 Jun 2023
- 2023One-Line-of-Code Data Mollification Improves Optimization of Likelihood-based Generative Models30 May 2023
- 2023Improving Multimodal Joint Variational Autoencoders through Normalizing Flows and Correlation Analysis19 May 2023
- 2023TC-VAE: Uncovering Out-of-Distribution Data Generative Factors8 Apr 2023
- 2023Variational Inference for Longitudinal Data Using Normalizing Flows24 Mar 2023
- 2023Simplex Autoencoders16 Jan 2023
- 2022Multi-Rate VAE: Train Once, Get the Full Rate-Distortion Curve7 Dec 2022
- 2022GMM-IL: Image Classification using Incrementally Learnt, Independent Probabilistic Models for Small Sample Sizes1 Dec 2022
- 2022Multi-Rate VAE: Train Once, Get the Full Rate-Distortion Curvecited by 18
- 2023Lifting Architectural Constraints of Injective Flowscited by 17
- 2024Evaluation of pseudo-healthy image reconstruction for anomaly detection with deep generative models: Application to brain FDG PETcited by 10
- 2025An efficient probabilistic hardware architecture for diffusion-like modelscited by 8
- 2024Boosting Flow-based Generative Super-Resolution Models via Learned Priorcited by 7
- 2023Risk-Controlling Model Selection via Guided Bayesian Optimizationcited by 5
- 2025Can3Tok: Canonical 3D Tokenization and Latent Modeling of Scene-Level 3D Gaussianscited by 5
- 2023One-Line-of-Code Data Mollification Improves Optimization of Likelihood-based Generative Modelscited by 4
- 2024α-TCVAE: On the relationship between Disentanglement and Diversitycited by 4
- 2025LangVAE and LangSpace: Building and Probing for Language Model VAEscited by 3
- 2023Modeling Complex Disease Trajectories using Deep Generative Models with Semi-Supervised Latent Processescited by 2
- 2024Analyzing Generative Models by Manifold Entropic Metricscited by 2
12 most cited of 26 All 26 (JSON)
- 2026A Multi-stage Constrained Optimization Framework for Data-driven Problems26 Jul 2026
- 2026How Neural Losses Shape VAE Latents30 May 2026
- 2026Learning a Latent Pulse Shape Interface for Photoinjector Laser Systems19 Feb 2026
- 2025An efficient probabilistic hardware architecture for diffusion-like models28 Oct 2025
- 2025Geodesic Calculus on Implicitly Defined Latent Manifolds10 Oct 2025
- 2025Can3Tok: Canonical 3D Tokenization and Latent Modeling of Scene-Level 3D Gaussians2 Aug 2025
- 2025Generator-Mediated Bandits: Thompson Sampling for GenAI-Powered Adaptive Interventions22 May 2025
- 2025Bidirectional Variational Autoencoders21 May 2025
- 2025LangVAE and LangSpace: Building and Probing for Language Model VAEs29 Mar 2025
- 2024α-TCVAE: On the relationship between Disentanglement and Diversity1 Nov 2024
- 2024Analyzing Generative Models by Manifold Entropic Metrics25 Oct 2024
- 2024An Empirical Study on Improving SimCLR's Nonlinear Projection Head using Pretrained Autoencoder Embeddings25 Aug 2024
12 newest of 26 All 26 (JSON)