Transformed Distribution Matching for Missing Value Imputation
Not on the map. Why?
Abstract (arXiv)
We study the problem of imputing missing values in a dataset, which has important applications in many domains. The key to missing value imputation is to capture the data distribution with incomplete samples and impute the missing values accordingly. In this paper, by leveraging the fact that any two batches of data with missing values come from the same data distribution, we propose to impute the missing values of two batches of samples by transforming them into a latent space through deep invertible functions and matching them distributionally. To learn the transformations and impute the missing values simultaneously, a simple and well-motivated algorithm is proposed. Our algorithm has fewer hyperparameters to fine-tune and generates high-quality imputations regardless of how missing values are generated. Extensive experiments over a large number of datasets and competing benchmark algorithms show that our method achieves state-of-the-art performance.
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Builds on 54 of its 91 references that are in the map. First posted on arXiv 20 Feb 2023.
Builds on
54 of 91 references.
References · 54
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2022Generative Adversarial Networkscited by 5,627
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2016Density estimation using Real NVPcited by 2,042
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,273
- 2014NICE: Non-linear Independent Components Estimationcited by 1,058
- 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 734
- 2017Self-Normalizing Neural Networkscited by 598
- 2019On Variational Bounds of Mutual Informationcited by 559
- 2015Importance Weighted Autoencoderscited by 456
38 more
- 2018GAIN: Missing Data Imputation using Generative Adversarial Netscited by 352
- 2019On Mutual Information Maximization for Representation Learningcited by 316
- 2017Learning Generative Models with Sinkhorn Divergencescited by 314
- 2018Analyzing Inverse Problems with Invertible Neural Networkscited by 242
- 2017Near-linear time approximation algorithms for optimal transport via Sinkhorn iterationcited by 223
- 2017The Reversible Residual Network: Backpropagation Without Storing Activationscited by 217
- 2013Fast Computation of Wasserstein Barycenterscited by 216
- 2021OTA: Optimal Transport Assignment for Object Detectioncited by 178
- 2018Handling Incomplete Heterogeneous Data using VAEscited by 149
- 2020Handling Missing Data with Graph Representation Learningcited by 133
- 2018Computational Optimal Transport: Complexity by Accelerated Gradient Descent Is Better Than by Sinkhorn's Algorithmcited by 112
- 2014Matrix Completion and Low-Rank SVD via Fast Alternating Least Squarescited by 104
- 2020Missing Data Imputation using Optimal Transportcited by 100
- 2022HyperImpute: Generalized Iterative Imputation with Automatic Model Selectioncited by 83
- 2019MisGAN: Learning from Incomplete Data with Generative Adversarial Networkscited by 75
- 2018Variational Autoencoder with Arbitrary Conditioningcited by 68
- 2018Excessive Invariance Causes Adversarial Vulnerabilitycited by 66
- 2021MIRACLE: Causally-Aware Imputation via Learning Missing Data Mechanismscited by 51
- 2020Neural Topic Model via Optimal Transportcited by 50
- 2020DeepEMD: Differentiable Earth Mover's Distance for Few-Shot Learningcited by 49
- 2020MCFlow: Monte Carlo Flow Models for Data Imputationcited by 37
- 2022A Unified Wasserstein Distributional Robustness Framework for Adversarial Trainingcited by 36
- 2022Representing Mixtures of Word Embeddings with Mixtures of Topic Embeddingscited by 36
- 2022Learning to Re-weight Examples with Optimal Transport for Imbalanced Classificationcited by 23
- 2023Vector Quantized Wasserstein Auto-Encodercited by 22
- 2017MIDA: Multiple Imputation using Denoising Autoencoderscited by 20
- 2021Learning Prototype-oriented Set Representations for Meta-Learningcited by 19
- 2022Missing Data Imputation and Acquisition with Deep Hierarchical Models and Hamiltonian Monte Carlocited by 19
- 2013What Is Meant by "Missing at Random"?cited by 16
- 2021Simultaneous Missing Value Imputation and Structure Learning with Groupscited by 16
- 2021Multiple Imputation via Generative Adversarial Network for High-dimensional Blockwise Missing Value Problemscited by 15
- 2022Adaptive Distribution Calibration for Few-Shot Learning with Hierarchical Optimal Transportcited by 14
- 2022Handling Missing Data via Max-Entropy Regularized Graph Autoencodercited by 12
- 2021Variational Selective Autoencoder: Learning from Partially-Observed Heterogeneous Datacited by 10
- 2019R-miss-tastic: a unified platform for missing values methods and workflowscited by 8
- 2021EMFlow: Data Imputation in Latent Space via EM and Deep Flow Modelscited by 6
- 2022GEDI: A Graph-based End-to-end Data Imputation Frameworkcited by 5
- 2022FragmGAN: Generative Adversarial Nets for Fragmentary Data Imputation and Predictioncited by 4
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2024: 14; 2025: 8; 2026: 9.
31 papers.
Sort:
By area:
- 2024LLM-Forest: Ensemble Learning of LLMs with Graph-Augmented Prompts for Data Imputationcited by 25
- 2024DiffPuter: Empowering Diffusion Models for Missing Data Imputationcited by 19
- 2024LLM Reading Tea Leaves: Automatically Evaluating Topic Models with Large Language Modelscited by 11
- 2025On LLM-Enhanced Mixed-Type Data Imputation with High-Order Message Passingcited by 11
- 2024Neural Topic Modeling with Large Language Models in the Loopcited by 10
- 2024Higher-order Spatio-temporal Physics-incorporated Graph Neural Network for Multivariate Time Series Imputationcited by 8
- 2024Optimal Transport for Structure Learning Under Missing Datacited by 6
- 2025Missing Data Imputation by Reducing Mutual Information with Rectified Flowscited by 6
- 2024A Context-Aware Approach for Enhancing Data Imputation with Pre-trained Language Modelscited by 5
- 2025Robust Simulation-Based Inference under Missing Data via Neural Processescited by 5
- 2026Cascaded Flow Matching for Heterogeneous Tabular Data with Mixed-Type Featurescited by 4
- 2024Rethinking the Diffusion Models for Numerical Tabular Data Imputation from the Perspective of Wasserstein Gradient Flowcited by 3
19 more
- 2025Impute-MACFM: Imputation based on Mask-Aware Flow Matchingcited by 2
- 2024Scalable Numerical Embeddings for Multivariate Time Series: Enhancing Healthcare Data Representation Learningcited by 1
- 2024Masked Language Modeling Becomes Conditional Density Estimation for Tabular Data Synthesiscited by 1
- 2024Still More Shades of Null: An Evaluation Suite for Responsible Missing Value Imputationcited by 1
- 2024mDAE : modified Denoising AutoEncoder for missing data imputationcited by 1
- 2025OASIS: Harnessing Diffusion Adversarial Network for Ocean Salinity Imputation using Sparse Drifter Trajectoriescited by 1
- 2024A parameter-free clustering algorithm for missing datasetscited by 0
- 2024A Survey and Benchmarking of Spatial-Temporal Traffic Data Imputation Modelscited by 0
- 2025IMAGIC-500: IMputation benchmark on A Generative Imaginary Country (500k samples)cited by 0
- 2025Leveraging AI Graders for Missing Score Imputation to Achieve Accurate Ability Estimation in Constructed-Response Testscited by 0
- 2025An Interdisciplinary and Cross-Task Review on Missing Data Imputationcited by 0
- 2026Nearly Optimal Bayesian Inference for Structural Missingnesscited by 0
- 2026Analyzing and Improving Diffusion Models for Time-Series Data Imputation: A Proximal Recursion Perspectivecited by 0
- 2026Theoretical Analysis of Measure Consistency Regularization for Partially Observed Datacited by 0
- 2026Harpoon: Generalised Manifold Guidance for Conditional Tabular Diffusioncited by 0
- 2026Neural Optimal Transport in Hilbert Spaces: Characterizing Spurious Solutions and Gaussian Smoothingcited by 0
- 2026Missing Pattern Recognized Diffusion Imputation Model for Missing Not At Randomcited by 0
- 2026SafeImpute: Reliable Clinical Data Imputation via Conformal Selectioncited by 0
- 2026Imputation Meets Clustering: Exploiting Latent Subgroup Structure for Missing Data Recoverycited by 0
- 2026Imputation Meets Clustering: Exploiting Latent Subgroup Structure for Missing Data Recovery8 Jul 2026
- 2026SafeImpute: Reliable Clinical Data Imputation via Conformal Selection6 Jul 2026
- 2026Missing Pattern Recognized Diffusion Imputation Model for Missing Not At Random25 May 2026
- 2026Neural Optimal Transport in Hilbert Spaces: Characterizing Spurious Solutions and Gaussian Smoothing15 Feb 2026
- 2026Harpoon: Generalised Manifold Guidance for Conditional Tabular Diffusion8 Feb 2026
- 2026Theoretical Analysis of Measure Consistency Regularization for Partially Observed Data1 Feb 2026
- 2026Analyzing and Improving Diffusion Models for Time-Series Data Imputation: A Proximal Recursion Perspective1 Feb 2026
- 2026Cascaded Flow Matching for Heterogeneous Tabular Data with Mixed-Type Features30 Jan 2026
- 2026Nearly Optimal Bayesian Inference for Structural Missingness26 Jan 2026
- 2025An Interdisciplinary and Cross-Task Review on Missing Data Imputation3 Nov 2025
- 2025Impute-MACFM: Imputation based on Mask-Aware Flow Matching27 Sep 2025
- 2025OASIS: Harnessing Diffusion Adversarial Network for Ocean Salinity Imputation using Sparse Drifter Trajectories29 Aug 2025
19 more
- 2025Leveraging AI Graders for Missing Score Imputation to Achieve Accurate Ability Estimation in Constructed-Response Tests25 Jun 2025
- 2025IMAGIC-500: IMputation benchmark on A Generative Imaginary Country (500k samples)10 Jun 2025
- 2025Missing Data Imputation by Reducing Mutual Information with Rectified Flows16 May 2025
- 2025Robust Simulation-Based Inference under Missing Data via Neural Processes3 Mar 2025
- 2025On LLM-Enhanced Mixed-Type Data Imputation with High-Order Message Passing4 Jan 2025
- 2024A Survey and Benchmarking of Spatial-Temporal Traffic Data Imputation Models6 Dec 2024
- 2024mDAE : modified Denoising AutoEncoder for missing data imputation19 Nov 2024
- 2024Neural Topic Modeling with Large Language Models in the Loop13 Nov 2024
- 2024LLM-Forest: Ensemble Learning of LLMs with Graph-Augmented Prompts for Data Imputation28 Oct 2024
- 2024Still More Shades of Null: An Evaluation Suite for Responsible Missing Value Imputation11 Sep 2024
- 2024Rethinking the Diffusion Models for Numerical Tabular Data Imputation from the Perspective of Wasserstein Gradient Flow22 Jun 2024
- 2024LLM Reading Tea Leaves: Automatically Evaluating Topic Models with Large Language Models13 Jun 2024
- 2024DiffPuter: Empowering Diffusion Models for Missing Data Imputation31 May 2024
- 2024Masked Language Modeling Becomes Conditional Density Estimation for Tabular Data Synthesis31 May 2024
- 2024A Context-Aware Approach for Enhancing Data Imputation with Pre-trained Language Models28 May 2024
- 2024Scalable Numerical Embeddings for Multivariate Time Series: Enhancing Healthcare Data Representation Learning26 May 2024
- 2024Higher-order Spatio-temporal Physics-incorporated Graph Neural Network for Multivariate Time Series Imputation16 May 2024
- 2024A parameter-free clustering algorithm for missing datasets8 Apr 2024
- 2024Optimal Transport for Structure Learning Under Missing Data23 Feb 2024
- 2024DiffPuter: Empowering Diffusion Models for Missing Data Imputationcited by 19
- 2025Missing Data Imputation by Reducing Mutual Information with Rectified Flowscited by 6
- 2026Cascaded Flow Matching for Heterogeneous Tabular Data with Mixed-Type Featurescited by 4
- 2024Rethinking the Diffusion Models for Numerical Tabular Data Imputation from the Perspective of Wasserstein Gradient Flowcited by 3
- 2025Impute-MACFM: Imputation based on Mask-Aware Flow Matchingcited by 2
- 2026Analyzing and Improving Diffusion Models for Time-Series Data Imputation: A Proximal Recursion Perspectivecited by 0
- 2026Analyzing and Improving Diffusion Models for Time-Series Data Imputation: A Proximal Recursion Perspective1 Feb 2026
- 2026Cascaded Flow Matching for Heterogeneous Tabular Data with Mixed-Type Features30 Jan 2026
- 2025Impute-MACFM: Imputation based on Mask-Aware Flow Matching27 Sep 2025
- 2025Missing Data Imputation by Reducing Mutual Information with Rectified Flows16 May 2025
- 2024Rethinking the Diffusion Models for Numerical Tabular Data Imputation from the Perspective of Wasserstein Gradient Flow22 Jun 2024
- 2024DiffPuter: Empowering Diffusion Models for Missing Data Imputation31 May 2024
- 2024LLM-Forest: Ensemble Learning of LLMs with Graph-Augmented Prompts for Data Imputationcited by 25
- 2024LLM Reading Tea Leaves: Automatically Evaluating Topic Models with Large Language Modelscited by 11
- 2025On LLM-Enhanced Mixed-Type Data Imputation with High-Order Message Passingcited by 11
- 2024Neural Topic Modeling with Large Language Models in the Loopcited by 10
- 2024Higher-order Spatio-temporal Physics-incorporated Graph Neural Network for Multivariate Time Series Imputationcited by 8
- 2024Optimal Transport for Structure Learning Under Missing Datacited by 6
- 2024A Context-Aware Approach for Enhancing Data Imputation with Pre-trained Language Modelscited by 5
- 2025Robust Simulation-Based Inference under Missing Data via Neural Processescited by 5
- 2024Scalable Numerical Embeddings for Multivariate Time Series: Enhancing Healthcare Data Representation Learningcited by 1
- 2024Still More Shades of Null: An Evaluation Suite for Responsible Missing Value Imputationcited by 1
- 2024mDAE : modified Denoising AutoEncoder for missing data imputationcited by 1
- 2025OASIS: Harnessing Diffusion Adversarial Network for Ocean Salinity Imputation using Sparse Drifter Trajectoriescited by 1
12 most cited of 24 All 24 (JSON)
- 2026Imputation Meets Clustering: Exploiting Latent Subgroup Structure for Missing Data Recovery8 Jul 2026
- 2026SafeImpute: Reliable Clinical Data Imputation via Conformal Selection6 Jul 2026
- 2026Missing Pattern Recognized Diffusion Imputation Model for Missing Not At Random25 May 2026
- 2026Neural Optimal Transport in Hilbert Spaces: Characterizing Spurious Solutions and Gaussian Smoothing15 Feb 2026
- 2026Harpoon: Generalised Manifold Guidance for Conditional Tabular Diffusion8 Feb 2026
- 2026Theoretical Analysis of Measure Consistency Regularization for Partially Observed Data1 Feb 2026
- 2026Nearly Optimal Bayesian Inference for Structural Missingness26 Jan 2026
- 2025An Interdisciplinary and Cross-Task Review on Missing Data Imputation3 Nov 2025
- 2025OASIS: Harnessing Diffusion Adversarial Network for Ocean Salinity Imputation using Sparse Drifter Trajectories29 Aug 2025
- 2025Leveraging AI Graders for Missing Score Imputation to Achieve Accurate Ability Estimation in Constructed-Response Tests25 Jun 2025
- 2025IMAGIC-500: IMputation benchmark on A Generative Imaginary Country (500k samples)10 Jun 2025
- 2025Robust Simulation-Based Inference under Missing Data via Neural Processes3 Mar 2025
12 newest of 24 All 24 (JSON)