Parameter Estimation in DAGs from Incomplete Data via Optimal Transport
Not on the map. Why?
Abstract (arXiv)
Estimating the parameters of a probabilistic directed graphical model from incomplete data is a long-standing challenge. This is because, in the presence of latent variables, both the likelihood function and posterior distribution are intractable without assumptions about structural dependencies or model classes. While existing learning methods are fundamentally based on likelihood maximization, here we offer a new view of the parameter learning problem through the lens of optimal transport. This perspective licenses a general framework that operates on any directed graphs without making unrealistic assumptions on the posterior over the latent variables or resorting to variational approximations. We develop a theoretical framework and support it with extensive empirical evidence demonstrating the versatility and robustness of our approach. Across experiments, we show that not only can our method effectively recover the ground-truth parameters but it also performs comparably or better than competing baselines on downstream applications.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 40 of its 93 references that are in the map. First posted on arXiv 25 May 2023.
Builds on
40 of 93 references.
References · 40
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Generative Adversarial Networkscited by 5,627
- 2017Neural Discrete Representation Learningcited by 4,712
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2015Fast R-CNNcited by 2,933
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,148
- 2018Computational Optimal Transportcited by 780
- 2018Image Transformercited by 772
- 2021Vector-quantized Image Modeling with Improved VQGANcited by 658
- 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 640
- 2017Wasserstein Auto-Encoderscited by 373
28 more
- 2019DAG-GNN: DAG Structure Learning with Graph Neural Networkscited by 331
- 2013Black Box Variational Inferencecited by 319
- 2017Autoencoding Variational Inference For Topic Modelscited by 169
- 2016R'enyi Divergence Variational Inferencecited by 104
- 2022Deep End-to-end Causal Inferencecited by 95
- 2015Hierarchical Variational Modelscited by 89
- 2022SQ-VAE: Variational Bayes on Discrete Representation with Self-annealed Stochastic Quantizationcited by 68
- 2018Banach Wasserstein GANcited by 56
- 2018Semi-Implicit Variational Inferencecited by 55
- 2019The Usual Suspects? Reassessing Blame for VAE Posterior Collapsecited by 52
- 2021Topic Modelling Meets Deep Neural Networks: A Surveycited by 51
- 2020Neural Topic Model via Optimal Transportcited by 50
- 2017Multilevel Clustering via Wasserstein Meanscited by 49
- 2018Variance reduction properties of the reparameterization trickcited by 41
- 2015Black-box α-divergence Minimizationcited by 37
- 2022A Unified Wasserstein Distributional Robustness Framework for Adversarial Trainingcited by 36
- 2022Representing Mixtures of Word Embeddings with Mixtures of Topic Embeddingscited by 36
- 2018Unbiased Implicit Variational Inferencecited by 33
- 2016The Generalized Reparameterization Gradientcited by 30
- 2020f-Divergence Variational Inferencecited by 28
- 2014Structured Stochastic Variational Inferencecited by 22
- 2020Automatic structured variational inferencecited by 22
- 2023Vector Quantized Wasserstein Auto-Encodercited by 22
- 2018Doubly Semi-Implicit Variational Inferencecited by 19
- 2018Wasserstein Variational Inferencecited by 17
- 2014Stochastic Variational Inference for Hidden Markov Modelscited by 12
- 2020Sinkhorn EM: An Expectation-Maximization algorithm based on entropic optimal transportcited by 9
- 2017Convergence Rates of Latent Topic Models Under Relaxed Identifiability Conditionscited by 2
Built on by
Citing papers per year: 2024: 1.
1 paper.
- 2024Optimal Transport for Structure Learning Under Missing Data23 Feb 2024