mlsanityData to 14 Oct 2026

Parameter Estimation in DAGs from Incomplete Data via Optimal Transport

arXiv 2305.15927 ↗First posted 25 May 2023cs.LG cs.SIcited by 1

Not on the map. Why?

Abstract (arXiv)

Estimating the parameters of a probabilistic directed graphical model from incomplete data is a long-standing challenge. This is because, in the presence of latent variables, both the likelihood function and posterior distribution are intractable without assumptions about structural dependencies or model classes. While existing learning methods are fundamentally based on likelihood maximization, here we offer a new view of the parameter learning problem through the lens of optimal transport. This perspective licenses a general framework that operates on any directed graphs without making unrealistic assumptions on the posterior over the latent variables or resorting to variational approximations. We develop a theoretical framework and support it with extensive empirical evidence demonstrating the versatility and robustness of our approach. Across experiments, we show that not only can our method effectively recover the ground-truth parameters but it also performs comparably or better than competing baselines on downstream applications.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 40 of its 93 references that are in the map. First posted on arXiv 25 May 2023.

Builds on

40 of 93 references.

References · 40

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2022Generative Adversarial Networkscited by 5,627
  3. 2017Neural Discrete Representation Learningcited by 4,712
  4. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  5. 2015Fast R-CNNcited by 2,933
  6. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
  7. 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,148
  8. 2018Computational Optimal Transportcited by 780
  9. 2018Image Transformercited by 772
  10. 2021Vector-quantized Image Modeling with Improved VQGANcited by 658
  11. 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 640
  12. 2017Wasserstein Auto-Encoderscited by 373
28 more
  1. 2019DAG-GNN: DAG Structure Learning with Graph Neural Networkscited by 331
  2. 2013Black Box Variational Inferencecited by 319
  3. 2017Autoencoding Variational Inference For Topic Modelscited by 169
  4. 2016R'enyi Divergence Variational Inferencecited by 104
  5. 2022Deep End-to-end Causal Inferencecited by 95
  6. 2015Hierarchical Variational Modelscited by 89
  7. 2022SQ-VAE: Variational Bayes on Discrete Representation with Self-annealed Stochastic Quantizationcited by 68
  8. 2018Banach Wasserstein GANcited by 56
  9. 2018Semi-Implicit Variational Inferencecited by 55
  10. 2019The Usual Suspects? Reassessing Blame for VAE Posterior Collapsecited by 52
  11. 2021Topic Modelling Meets Deep Neural Networks: A Surveycited by 51
  12. 2020Neural Topic Model via Optimal Transportcited by 50
  13. 2017Multilevel Clustering via Wasserstein Meanscited by 49
  14. 2018Variance reduction properties of the reparameterization trickcited by 41
  15. 2015Black-box α-divergence Minimizationcited by 37
  16. 2022A Unified Wasserstein Distributional Robustness Framework for Adversarial Trainingcited by 36
  17. 2022Representing Mixtures of Word Embeddings with Mixtures of Topic Embeddingscited by 36
  18. 2018Unbiased Implicit Variational Inferencecited by 33
  19. 2016The Generalized Reparameterization Gradientcited by 30
  20. 2020f-Divergence Variational Inferencecited by 28
  21. 2014Structured Stochastic Variational Inferencecited by 22
  22. 2020Automatic structured variational inferencecited by 22
  23. 2023Vector Quantized Wasserstein Auto-Encodercited by 22
  24. 2018Doubly Semi-Implicit Variational Inferencecited by 19
  25. 2018Wasserstein Variational Inferencecited by 17
  26. 2014Stochastic Variational Inference for Hidden Markov Modelscited by 12
  27. 2020Sinkhorn EM: An Expectation-Maximization algorithm based on entropic optimal transportcited by 9
  28. 2017Convergence Rates of Latent Topic Models Under Relaxed Identifiability Conditionscited by 2

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.