VAEM: a Deep Generative Model for Heterogeneous Mixed Type Data
Not on the map. Why?
Abstract (arXiv)
Deep generative models often perform poorly in real-world applications due to the heterogeneity of natural data sets. Heterogeneity arises from data containing different types of features (categorical, ordinal, continuous, etc.) and features of the same type having different marginal distributions. We propose an extension of variational autoencoders (VAEs) called VAEM to handle such heterogeneous data. VAEM is a deep generative model that is trained in a two stage manner such that the first stage provides a more uniform representation of the data to the second stage, thereby sidestepping the problems caused by heterogeneous data. We provide extensions of VAEM to handle partially observed data, and demonstrate its performance in data generation, missing data prediction and sequential feature selection tasks. Our results show that VAEM broadens the range of real-world applications where deep generative models can be successfully deployed.
Key facts. Cited by 66 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 11; 2023: 11; 2024: 14; 2025: 11; 2026: 13.
66 papers.
Sort:
By area:
- 2021Deep Neural Networks and Tabular Data: A Surveycited by 489
- 2022Language Models are Realistic Tabular Data Generatorscited by 290
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 157
- 2022HyperImpute: Generalized Iterative Imputation with Automatic Model Selectioncited by 81
- 2023Generative Table Pre-training Empowers Models for Tabular Predictioncited by 55
- 2023Learning to Maximize Mutual Information for Dynamic Feature Selectioncited by 54
- 2023MissDiff: Training Diffusion Models on Tabular Data with Missing Valuescited by 38
- 2022Mitigating Modality Collapse in Multimodal VAEs via Impartial Optimizationcited by 32
- 2021Identifiable Generative Models for Missing Not at Random Data Imputationcited by 30
- 2025A Comprehensive Survey of Synthetic Tabular Data Generationcited by 27
- 2025A Closer Look at Multimodal Representation Collapsecited by 25
- 2023Estimating Conditional Mutual Information for Dynamic Feature Selectioncited by 20
38 more
- 2022Missing Data Imputation and Acquisition with Deep Hierarchical Models and Hamiltonian Monte Carlocited by 19
- 2024DiffPuter: Empowering Diffusion Models for Missing Data Imputationcited by 17
- 2023Continuous Diffusion for Mixed-Type Tabular Datacited by 16
- 2021Out-of-Distribution Detection for Medical Applications: Guidelines for Practical Evaluationcited by 15
- 2024An improved tabular data generator with VAE-GMM integrationcited by 13
- 2024Balanced Mixed-Type Tabular Data Synthesis with Diffusion Modelscited by 12
- 2024Generative AI and Process Systems Engineering: The Next Frontiercited by 8
- 2024Structured Evaluation of Synthetic Tabular Datacited by 7
- 2024Causality for Tabular Data Synthesis: A High-Order Structure Causal Benchmark Frameworkcited by 7
- 2022Uncertainty-Autoencoder-Based Privacy and Utility Preserving Data Type Conscious Transformationcited by 5
- 2023Variational Mixture of HyperGenerators for Learning Distributions Over Functionscited by 5
- 2024How Deep is your Guess? A Fresh Perspective on Deep Learning for Medical Time-Series Imputationcited by 5
- 2024Data Augmentation with Variational Autoencoder for Imbalanced Datasetcited by 5
- 2021Medical data wrangling with sequential variational autoencoderscited by 4
- 2022GEDI: A Graph-based End-to-end Data Imputation Frameworkcited by 4
- 2023Predictive World Models from Real-World Partial Observationscited by 4
- 2023MargCTGAN: A "Marginally'' Better CTGAN for the Low Sample Regimecited by 4
- 2023Generalized Oversampling for Learning from Imbalanced datasets and Associated Theorycited by 4
- 2024P-TA: Using Proximal Policy Optimization to Enhance Tabular Data Augmentation via Large Language Modelscited by 4
- 2026Cascaded Flow Matching for Heterogeneous Tabular Data with Mixed-Type Featurescited by 4
- 2021Causally Constrained Data Synthesis for Private Data Releasecited by 3
- 2021Bi-Discriminator Class-Conditional Tabular GANcited by 3
- 2022Generative Modeling of Complex Datacited by 3
- 2022Leveraging variational autoencoders for multiple data imputationcited by 3
- 2023Differentially Private Synthetic Data Generation via Lipschitz-Regularised Variational Autoencoderscited by 3
- 2023Generative Inverse Design of Metamaterials with Functional Responses by Interpretable Learningcited by 3
- 2024Tree-Regularized Tabular Embeddingscited by 3
- 2022A Variational Autoencoder for Heterogeneous Temporal and Longitudinal Datacited by 2
- 2022Discovery and density estimation of latent confounders in Bayesian networks with evidence lower boundcited by 2
- 2024Boarding for ISS: Imbalanced Self-Supervised: Discovery of a Scaled Autoencoder for Mixed Tabular Datasetscited by 2
- 2024A Unified Framework for Tabular Generative Modeling: Loss Functions, Benchmarks, and Improved Multi-objective Bayesian Optimization Approachescited by 2
- 2025Evaluating Generative Models for Tabular Data: Novel Metrics and Benchmarkingcited by 2
- 2025Incomplete Data, Complete Dynamics: A Diffusion Approachcited by 2
- 2022GLACIAL: Granger and Learning-based Causality Analysis for Longitudinal Imaging Studiescited by 1
- 2024Artificial Inductive Bias for Synthetic Tabular Data Generation in Data-Scarce Scenarioscited by 1
- 2025A Generalized Theory of Mixup for Structure-Preserving Synthetic Datacited by 1
- 2025LLMSynthor: Macro-Aligned Micro-Records Synthesis with Large Language Modelscited by 1
- 2025IVGAE: Handling Incomplete Heterogeneous Data with a Variational Graph Autoencodercited by 1
50 most cited of 66 All 66 (JSON)
- 2026Learning the Geometry of Admissible Hypotheses through Inductive Bias in Training Distributions31 Aug 2026
- 2026Building2Building: A Large Scale Benchmark for Generalizable Real-World Reinforcement Learning17 Jul 2026
- 2026Pattern-Aware Graph Neural Networks for Handling Missing Data9 Jul 2026
- 2026Distributionally Faithful Imputation via Positive Semi-Definite Kernel Density Estimation8 Jul 2026
- 2026AugMask: Training Diffusion Models on Incomplete Tabular Data via Stochastic Augmentation and Masking2 Jun 2026
- 2026Order-Agnostic Autoregressive Modelling with Missing Data7 May 2026
- 2026Expert-Guided Class-Conditional Goodness-of-Fit Scores for Interpretable Classification with Informative Missingness: An Application to Seismic Monitoring16 Apr 2026
- 2026Extending Tabular Denoising Diffusion Probabilistic Models for Time-Series Data Generation6 Apr 2026
- 2026A Sobering Look at Tabular Data Generation via Probabilistic Circuits24 Mar 2026
- 2026Quantifying Membership Disclosure Risk for Tabular Synthetic Data Using Kernel Density Estimators11 Mar 2026
- 2026Bayesian Generative Adversarial Networks via Gaussian Approximation for Tabular Data Synthesis25 Feb 2026
- 2026Cascaded Flow Matching for Heterogeneous Tabular Data with Mixed-Type Features30 Jan 2026
38 more
- 2026Exploring Transformer Placement in Variational Autoencoders for Tabular Data Generation28 Jan 2026
- 2025Weighted Conformal Prediction Provides Adaptive and Valid Mask-Conditional Coverage for General Missing Data Mechanisms16 Dec 2025
- 2025IVGAE: Handling Incomplete Heterogeneous Data with a Variational Graph Autoencoder27 Nov 2025
- 2025What-If Decision Support for Product Line Extension Using Conditional Deep Generative Models10 Nov 2025
- 2025Incomplete Data, Complete Dynamics: A Diffusion Approach24 Sep 2025
- 2025A Closer Look at Multimodal Representation Collapse28 May 2025
- 2025Masked Conditioning for Deep Generative Models22 May 2025
- 2025LLMSynthor: Macro-Aligned Micro-Records Synthesis with Large Language Models20 May 2025
- 2025A Tutorial on Discriminative Clustering and Mutual Information7 May 2025
- 2025Evaluating Generative Models for Tabular Data: Novel Metrics and Benchmarking29 Apr 2025
- 2025A Comprehensive Survey of Synthetic Tabular Data Generation23 Apr 2025
- 2025A Generalized Theory of Mixup for Structure-Preserving Synthetic Data3 Mar 2025
- 2024Data Augmentation with Variational Autoencoder for Imbalanced Dataset9 Dec 2024
- 2024How Deep is your Guess? A Fresh Perspective on Deep Learning for Medical Time-Series Imputation11 Jul 2024
- 2024Artificial Inductive Bias for Synthetic Tabular Data Generation in Data-Scarce Scenarios3 Jul 2024
- 2024P-TA: Using Proximal Policy Optimization to Enhance Tabular Data Augmentation via Large Language Models17 Jun 2024
- 2024Causality for Tabular Data Synthesis: A High-Order Structure Causal Benchmark Framework12 Jun 2024
- 2024DiffPuter: Empowering Diffusion Models for Missing Data Imputation31 May 2024
- 2024A Unified Framework for Tabular Generative Modeling: Loss Functions, Benchmarks, and Improved Multi-objective Bayesian Optimization Approaches27 May 2024
- 2024An improved tabular data generator with VAE-GMM integration12 Apr 2024
- 2024Balanced Mixed-Type Tabular Data Synthesis with Diffusion Models12 Apr 2024
- 2024Boarding for ISS: Imbalanced Self-Supervised: Discovery of a Scaled Autoencoder for Mixed Tabular Datasets23 Mar 2024
- 2024Structured Evaluation of Synthetic Tabular Data15 Mar 2024
- 2024Tree-Regularized Tabular Embeddings1 Mar 2024
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey27 Feb 2024
- 2024Generative AI and Process Systems Engineering: The Next Frontier15 Feb 2024
- 2023Continuous Diffusion for Mixed-Type Tabular Data16 Dec 2023
- 2023Generative Inverse Design of Metamaterials with Functional Responses by Interpretable Learning8 Dec 2023
- 2023Generalized Oversampling for Learning from Imbalanced datasets and Associated Theory5 Aug 2023
- 2023MargCTGAN: A "Marginally'' Better CTGAN for the Low Sample Regime16 Jul 2023
- 2023MissDiff: Training Diffusion Models on Tabular Data with Missing Values2 Jul 2023
- 2023Estimating Conditional Mutual Information for Dynamic Feature Selection5 Jun 2023
- 2023Generative Table Pre-training Empowers Models for Tabular Prediction16 May 2023
- 2023Differentially Private Synthetic Data Generation via Lipschitz-Regularised Variational Autoencoders22 Apr 2023
- 2023Variational Mixture of HyperGenerators for Learning Distributions Over Functions13 Feb 2023
- 2023Predictive World Models from Real-World Partial Observations12 Jan 2023
- 2023Learning to Maximize Mutual Information for Dynamic Feature Selection2 Jan 2023
- 2022GLACIAL: Granger and Learning-based Causality Analysis for Longitudinal Imaging Studies13 Oct 2022
50 newest of 66 All 66 (JSON)
- 2023MissDiff: Training Diffusion Models on Tabular Data with Missing Valuescited by 38
- 2025A Comprehensive Survey of Synthetic Tabular Data Generationcited by 27
- 2024DiffPuter: Empowering Diffusion Models for Missing Data Imputationcited by 17
- 2023Continuous Diffusion for Mixed-Type Tabular Datacited by 16
- 2024Balanced Mixed-Type Tabular Data Synthesis with Diffusion Modelscited by 12
- 2026Cascaded Flow Matching for Heterogeneous Tabular Data with Mixed-Type Featurescited by 4
- 2026AugMask: Training Diffusion Models on Incomplete Tabular Data via Stochastic Augmentation and Maskingcited by 1
- 2026Extending Tabular Denoising Diffusion Probabilistic Models for Time-Series Data Generationcited by 0
- 2026AugMask: Training Diffusion Models on Incomplete Tabular Data via Stochastic Augmentation and Masking2 Jun 2026
- 2026Extending Tabular Denoising Diffusion Probabilistic Models for Time-Series Data Generation6 Apr 2026
- 2026Cascaded Flow Matching for Heterogeneous Tabular Data with Mixed-Type Features30 Jan 2026
- 2025A Comprehensive Survey of Synthetic Tabular Data Generation23 Apr 2025
- 2024DiffPuter: Empowering Diffusion Models for Missing Data Imputation31 May 2024
- 2024Balanced Mixed-Type Tabular Data Synthesis with Diffusion Models12 Apr 2024
- 2023Continuous Diffusion for Mixed-Type Tabular Data16 Dec 2023
- 2023MissDiff: Training Diffusion Models on Tabular Data with Missing Values2 Jul 2023
- 2021Causally Constrained Data Synthesis for Private Data Release27 May 2021
- 2023Predictive World Models from Real-World Partial Observations12 Jan 2023
- 2021Deep Neural Networks and Tabular Data: A Surveycited by 489
- 2022Language Models are Realistic Tabular Data Generatorscited by 290
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 157
- 2022HyperImpute: Generalized Iterative Imputation with Automatic Model Selectioncited by 81
- 2023Generative Table Pre-training Empowers Models for Tabular Predictioncited by 55
- 2023Learning to Maximize Mutual Information for Dynamic Feature Selectioncited by 54
- 2022Mitigating Modality Collapse in Multimodal VAEs via Impartial Optimizationcited by 32
- 2021Identifiable Generative Models for Missing Not at Random Data Imputationcited by 30
- 2025A Closer Look at Multimodal Representation Collapsecited by 25
- 2023Estimating Conditional Mutual Information for Dynamic Feature Selectioncited by 20
- 2022Missing Data Imputation and Acquisition with Deep Hierarchical Models and Hamiltonian Monte Carlocited by 19
- 2021Out-of-Distribution Detection for Medical Applications: Guidelines for Practical Evaluationcited by 15
12 most cited of 56 All 56 (JSON)
- 2026Learning the Geometry of Admissible Hypotheses through Inductive Bias in Training Distributions31 Aug 2026
- 2026Building2Building: A Large Scale Benchmark for Generalizable Real-World Reinforcement Learning17 Jul 2026
- 2026Pattern-Aware Graph Neural Networks for Handling Missing Data9 Jul 2026
- 2026Distributionally Faithful Imputation via Positive Semi-Definite Kernel Density Estimation8 Jul 2026
- 2026Order-Agnostic Autoregressive Modelling with Missing Data7 May 2026
- 2026Expert-Guided Class-Conditional Goodness-of-Fit Scores for Interpretable Classification with Informative Missingness: An Application to Seismic Monitoring16 Apr 2026
- 2026A Sobering Look at Tabular Data Generation via Probabilistic Circuits24 Mar 2026
- 2026Quantifying Membership Disclosure Risk for Tabular Synthetic Data Using Kernel Density Estimators11 Mar 2026
- 2026Bayesian Generative Adversarial Networks via Gaussian Approximation for Tabular Data Synthesis25 Feb 2026
- 2026Exploring Transformer Placement in Variational Autoencoders for Tabular Data Generation28 Jan 2026
- 2025Weighted Conformal Prediction Provides Adaptive and Valid Mask-Conditional Coverage for General Missing Data Mechanisms16 Dec 2025
- 2025IVGAE: Handling Incomplete Heterogeneous Data with a Variational Graph Autoencoder27 Nov 2025
12 newest of 56 All 56 (JSON)