# Score-Based Causal Discovery of Latent Variable Causal Models

arXiv: https://arxiv.org/abs/2605.20396 · HTML: https://mlsanity.com/paper/2605.20396/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 33 of its 91 references that are in the map.
- First posted on arXiv 19 May 2026.

## Builds on (most cited first, 30 of 33)

- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [Categorical Reparameterization with Gumbel-Softmax](https://mlsanity.com/paper/1611.01144/) (2016)
- [The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables](https://mlsanity.com/paper/1611.00712/) (2016)
- [DAGs with NO TEARS: Continuous Optimization for Structure Learning](https://mlsanity.com/paper/1803.01422/) (2018)
- [Differentiable Causal Discovery from Interventional Data](https://mlsanity.com/paper/2007.01754/) (2020)
- [D'ya like DAGs? A Survey on Structure Learning and Causal Discovery](https://mlsanity.com/paper/2103.02582/) (2021)
- [Towards Causal Representation Learning](https://mlsanity.com/paper/2102.11107/) (2021)
- [On the Role of Sparsity and DAG Constraints for Learning Linear DAGs](https://mlsanity.com/paper/2006.10201/) (2020)
- [Causal Inference in the Presence of Latent Variables and Selection Bias](https://mlsanity.com/paper/1302.4983/) (2013)
- [Masked Gradient-Based Causal Structure Learning](https://mlsanity.com/paper/1910.08527/) (2019)
- [Linear Causal Disentanglement via Interventions](https://mlsanity.com/paper/2211.16467/) (2022)
- [Causal Representation Learning from Multiple Distributions: A General Setting](https://mlsanity.com/paper/2402.05052/) (2024)
- [Identifiability of latent-variable and structural-equation models: from linear to nonlinear](https://mlsanity.com/paper/2302.02672/) (2023)
- [Differentiable Causal Discovery Under Unmeasured Confounding](https://mlsanity.com/paper/2010.06978/) (2020)
- [Learning latent causal graphs via mixture oracles](https://mlsanity.com/paper/2106.15563/) (2021)
- [Latent Hierarchical Causal Structure Discovery with Rank Constraints](https://mlsanity.com/paper/2210.01798/) (2022)
- [Learning Sparse Causal Models is not NP-hard](https://mlsanity.com/paper/1309.6824/) (2013)
- [High-dimensional consistency in score-based and hybrid structure learning](https://mlsanity.com/paper/1507.02608/) (2015)
- [Learning Linear Non-Gaussian Causal Models in the Presence of Latent Variables](https://mlsanity.com/paper/1908.03932/) (2019)
- [Structure Learning with Continuous Optimization: A Sober Look and Beyond](https://mlsanity.com/paper/2304.02146/) (2023)
- [A Versatile Causal Discovery Framework to Allow Causally-Related Hidden Variables](https://mlsanity.com/paper/2312.11001/) (2023)
- [Unpaired Multi-Domain Causal Representation Learning](https://mlsanity.com/paper/2302.00993/) (2023)
- [Recursive Causal Structure Learning in the Presence of Latent Variables and Selection Bias](https://mlsanity.com/paper/2110.12036/) (2021)
- [Ordering-Based Causal Structure Learning in the Presence of Latent Variables](https://mlsanity.com/paper/1910.09014/) (2019)
- [Causal Discovery with Unobserved Confounding and non-Gaussian Data](https://mlsanity.com/paper/2007.11131/) (2020)
- [Structure Learning for Cyclic Linear Causal Models](https://mlsanity.com/paper/2006.05978/) (2020)
- [Causal Discovery with Multi-Domain LiNGAM for Latent Factors](https://mlsanity.com/paper/2009.09176/) (2020)
- [Independence Testing-Based Approach to Causal Discovery under Measurement Error and Linear Non-Gaussian Models](https://mlsanity.com/paper/2210.11021/) (2022)
- [Deconfounded Score Method: Scoring DAGs with Dense Unobserved Confounding](https://mlsanity.com/paper/2103.15106/) (2021)
- [Distributional Equivalence and Structure Learning for Bow-free Acyclic Path Diagrams](https://mlsanity.com/paper/1508.01717/) (2015)

## Built on by (most cited first, 3 of 3)

- [Provable Guarantees and Efficient Learning of Structural Equation Models with Latent Confounders](https://mlsanity.com/paper/2609.18535/) (2026)
- [Hessian Rank Constraint for Learning Structure of Nonlinear Latent Variable Models](https://mlsanity.com/paper/2609.24241/) (2026)
- [DAG-CLIP: A DAG Learning Framework in the Presence of Latent Variables](https://mlsanity.com/paper/2610.06086/) (2026)

## Abstract (arXiv)

Identifying latent variables and the causal structure involving them is essential across various scientific fields. While many existing works fall under the category of constraint-based methods (with e.g. conditional independence or rank deficiency tests), they may face empirical challenges such as testing-order dependency, error propagation, and choosing an appropriate significance level. These issues can potentially be mitigated by properly designed score-based methods, such as Greedy Equivalence Search (GES) (Chickering, 2002) in the specific setting without latent variables. Yet, formulating score-based methods with latent variables is highly challenging. In this work, we develop score-based methods that are capable of identifying causal structures containing causally-related latent variables with identifiability guarantees. Specifically, we show that a properly formulated scoring function can achieve score equivalence and consistency for structure learning of latent variable causal models. We further provide a characterization of the degrees of freedom for the marginal over the observed variables under multiple structural assumptions considered in the literature, and accordingly develop both exact and continuous score-based methods. This offers a unified view of several existing constraint-based methods with different structural assumptions. Experimental results validate the effectiveness of the proposed methods.
