Learning linear structural equation models in polynomial time and sample complexity
Not on the map. Why?
Abstract (arXiv)
The problem of learning structural equation models (SEMs) from data is a fundamental problem in causal inference. We develop a new algorithm --- which is computationally and statistically efficient and works in the high-dimensional regime --- for learning linear SEMs from purely observational data with arbitrary noise distribution. We consider three aspects of the problem: identifiability, computational efficiency, and statistical efficiency. We show that when data is generated from a linear SEM over p nodes and maximum degree d, our algorithm recovers the directed acyclic graph (DAG) structure of the SEM under an identifiability condition that is more general than those considered in the literature, and without faithfulness assumptions. In the population setting, our algorithm recovers the DAG structure in O(p(d2 + log p)) operations. In the finite sample setting, if the estimated precision matrix is sparse, our algorithm has a smoothed complexity of widetildeO(p3 + pd7), while if the estimated precision matrix is dense, our algorithm has a smoothed complexity of widetildeO(p5). For sub-Gaussian noise, we show that our algorithm has a sample complexity of O(fracd8varepsilon2 log (fracp√δ)) to achieve varepsilon element-wise additive error with respect to the true autoregression matrix with probability at most 1 - δ, while for noise with bounded (4m)-th moment, with m being a positive integer, our algorithm has a sample complexity of O(fracd8varepsilon2 (fracp2δ)1/m).
Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Jul 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 8; 2023: 13; 2024: 9; 2025: 3; 2026: 7.
49 papers.
Sort:
By area:
- 2021Beware of the Simulated DAG! Causal Discovery Benchmarks May Be Easy To Gamecited by 159
- 2022DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity Characterizationcited by 135
- 2022Score matching enables causal discovery of nonlinear additive noise modelscited by 108
- 2021BCD Nets: Scalable Variational Approaches for Bayesian Causal Discoverycited by 68
- 2022Diffusion Models for Causal Discovery via Topological Orderingcited by 64
- 2023A Scale-Invariant Sorting Criterion to Find a Causal Order in Additive Noise Modelscited by 28
- 2022MissDAG: Causal Discovery in the Presence of Missing Data with Continuous Additive Noise Modelscited by 21
- 2023Optimizing NOTEARS Objectives via Topological Swapscited by 17
- 2023Sample Complexity Bounds for Score-Matching: Causal Discovery and Generative Modelingcited by 15
- 2021Efficient Bayesian network structure learning via local Markov boundary searchcited by 14
- 2022Optimal estimation of Gaussian DAG modelscited by 14
- 2024Ordering-Based Causal Discovery for Linear and Nonlinear Relationscited by 11
37 more
- 2021Structure learning in polynomial time: Greedy algorithms, Bregman information, and exponential familiescited by 10
- 2021Scalable Intervention Target Estimation in Linear Modelscited by 10
- 2024Score matching through the roof: linear, nonlinear, and latent variables causal discoverycited by 8
- 2023Heteroscedastic Causal Structure Learningcited by 6
- 2024Markov Equivalence and Consistency in Differentiable Structure Learningcited by 6
- 2021Learning linear non-Gaussian directed acyclic graph with diverging number of nodescited by 5
- 2022Learning Latent Structural Causal Modelscited by 5
- 2023iSCAN: Identifying Causal Mechanism Shifts among Nonlinear Additive Noise Modelscited by 5
- 2024Linear Causal Bandits: Unknown Graph and Soft Interventionscited by 5
- 2023Order-based Structure Learning with Normalizing Flowscited by 4
- 2024Integer Programming for Learning Directed Acyclic Graphs from Non-identifiable Gaussian Modelscited by 4
- 2026Causal Representation Learning from General Environments under Nonparametric Mixingcited by 4
- 2024Optimal estimation of Gaussian (poly)treescited by 3
- 2024Learning Directed Acyclic Graphs from Partial Orderingscited by 2
- 2021Definite Non-Ancestral Relations and Structure Learningcited by 1
- 2021Learning Linear Polytree Structural Equation Modelscited by 1
- 2022Latent Variable Models for Bayesian Causal Discoverycited by 1
- 2022Learning Large Causal Structures from Inverse Covariance Matrix via Sparse Matrix Decompositioncited by 1
- 2023Hierarchical Topological Ordering with Conditional Independence Test for Limited Time Seriescited by 1
- 2023Information Theoretically Optimal Sample Complexity of Learning Dynamical Directed Acyclic Graphscited by 1
- 2023Recovering Linear Causal Models with Latent Variables via Cholesky Factorization of Covariance Matrixcited by 1
- 2024LoSAM: Local Search in Additive Noise Models with Mixed Mechanisms and General Noise for Global Causal Discoverycited by 1
- 2025Identifiability of the minimum-trace directed acyclic graph and hill climbing algorithms without strict local optima under weakly increasing error variancescited by 1
- 2025Causal Ordering for Structure Learning from Time Seriescited by 1
- 2025Learning Gaussian DAG Models without Condition Number Boundscited by 1
- 2026Ordering-based Causal Discovery via Generalized Score Matchingcited by 1
- 2026Order-based Rehearsal Learningcited by 1
- 2021Identifiability of AMP chain graph modelscited by 0
- 2023Structural transfer learning of non-Gaussian DAGcited by 0
- 2023Distributionally Robust Skeleton Learning of Discrete Bayesian Networkscited by 0
- 2023Bayesian Approach to Linear Bayesian Networkscited by 0
- 2023Inconsistency of cross-validation for structure learning in Gaussian graphical modelscited by 0
- 2024Generalized Criterion for Identifiability of Additive Noise Models Using Majorizationcited by 0
- 2026Sparse Additive Model Pruning for Order-Based Causal Structure Learningcited by 0
- 2026Provable Guarantees and Efficient Learning of Structural Equation Models with Latent Confounderscited by 0
- 2026The Statistical Cost of Causal Discovery with Feedbackcited by 0
- 2026Discrete Score Matching Enables Causal Discovery from Count Datacited by 0
- 2026Discrete Score Matching Enables Causal Discovery from Count Data30 Sep 2026
- 2026The Statistical Cost of Causal Discovery with Feedback28 Sep 2026
- 2026Provable Guarantees and Efficient Learning of Structural Equation Models with Latent Confounders16 Sep 2026
- 2026Order-based Rehearsal Learning6 May 2026
- 2026Causal Representation Learning from General Environments under Nonparametric Mixing26 Apr 2026
- 2026Sparse Additive Model Pruning for Order-Based Causal Structure Learning17 Feb 2026
- 2026Ordering-based Causal Discovery via Generalized Score Matching22 Jan 2026
- 2025Learning Gaussian DAG Models without Condition Number Bounds8 Nov 2025
- 2025Causal Ordering for Structure Learning from Time Series28 Oct 2025
- 2025Identifiability of the minimum-trace directed acyclic graph and hill climbing algorithms without strict local optima under weakly increasing error variances7 Aug 2025
- 2024Linear Causal Bandits: Unknown Graph and Soft Interventions4 Nov 2024
- 2024LoSAM: Local Search in Additive Noise Models with Mixed Mechanisms and General Noise for Global Causal Discovery15 Oct 2024
37 more
- 2024Markov Equivalence and Consistency in Differentiable Structure Learning8 Oct 2024
- 2024Ordering-Based Causal Discovery for Linear and Nonlinear Relations8 Oct 2024
- 2024Score matching through the roof: linear, nonlinear, and latent variables causal discovery26 Jul 2024
- 2024Integer Programming for Learning Directed Acyclic Graphs from Non-identifiable Gaussian Models19 Apr 2024
- 2024Generalized Criterion for Identifiability of Additive Noise Models Using Majorization8 Apr 2024
- 2024Learning Directed Acyclic Graphs from Partial Orderings24 Mar 2024
- 2024Optimal estimation of Gaussian (poly)trees9 Feb 2024
- 2023Inconsistency of cross-validation for structure learning in Gaussian graphical models28 Dec 2023
- 2023Bayesian Approach to Linear Bayesian Networks27 Nov 2023
- 2023Distributionally Robust Skeleton Learning of Discrete Bayesian Networks10 Nov 2023
- 2023Recovering Linear Causal Models with Latent Variables via Cholesky Factorization of Covariance Matrix1 Nov 2023
- 2023Sample Complexity Bounds for Score-Matching: Causal Discovery and Generative Modeling27 Oct 2023
- 2023Structural transfer learning of non-Gaussian DAG16 Oct 2023
- 2023Information Theoretically Optimal Sample Complexity of Learning Dynamical Directed Acyclic Graphs31 Aug 2023
- 2023Hierarchical Topological Ordering with Conditional Independence Test for Limited Time Series16 Aug 2023
- 2023Order-based Structure Learning with Normalizing Flows14 Aug 2023
- 2023Heteroscedastic Causal Structure Learning16 Jul 2023
- 2023iSCAN: Identifying Causal Mechanism Shifts among Nonlinear Additive Noise Models30 Jun 2023
- 2023Optimizing NOTEARS Objectives via Topological Swaps26 May 2023
- 2023A Scale-Invariant Sorting Criterion to Find a Causal Order in Additive Noise Models31 Mar 2023
- 2022Learning Large Causal Structures from Inverse Covariance Matrix via Sparse Matrix Decomposition25 Nov 2022
- 2022Learning Latent Structural Causal Models24 Oct 2022
- 2022Diffusion Models for Causal Discovery via Topological Ordering12 Oct 2022
- 2022DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity Characterization16 Sep 2022
- 2022Latent Variable Models for Bayesian Causal Discovery12 Jul 2022
- 2022MissDAG: Causal Discovery in the Presence of Missing Data with Continuous Additive Noise Models27 May 2022
- 2022Score matching enables causal discovery of nonlinear additive noise models8 Mar 2022
- 2022Optimal estimation of Gaussian DAG models25 Jan 2022
- 2021BCD Nets: Scalable Variational Approaches for Bayesian Causal Discovery6 Dec 2021
- 2021Scalable Intervention Target Estimation in Linear Models15 Nov 2021
- 2021Learning linear non-Gaussian directed acyclic graph with diverging number of nodes1 Nov 2021
- 2021Efficient Bayesian network structure learning via local Markov boundary search12 Oct 2021
- 2021Structure learning in polynomial time: Greedy algorithms, Bregman information, and exponential families10 Oct 2021
- 2021Learning Linear Polytree Structural Equation Models22 Jul 2021
- 2021Identifiability of AMP chain graph models17 Jun 2021
- 2021Definite Non-Ancestral Relations and Structure Learning20 May 2021
- 2021Beware of the Simulated DAG! Causal Discovery Benchmarks May Be Easy To Game26 Feb 2021
- 2021Beware of the Simulated DAG! Causal Discovery Benchmarks May Be Easy To Gamecited by 159
- 2022DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity Characterizationcited by 135
- 2022Score matching enables causal discovery of nonlinear additive noise modelscited by 108
- 2021BCD Nets: Scalable Variational Approaches for Bayesian Causal Discoverycited by 68
- 2023A Scale-Invariant Sorting Criterion to Find a Causal Order in Additive Noise Modelscited by 28
- 2022MissDAG: Causal Discovery in the Presence of Missing Data with Continuous Additive Noise Modelscited by 21
- 2023Optimizing NOTEARS Objectives via Topological Swapscited by 17
- 2023Sample Complexity Bounds for Score-Matching: Causal Discovery and Generative Modelingcited by 15
- 2021Efficient Bayesian network structure learning via local Markov boundary searchcited by 14
- 2022Optimal estimation of Gaussian DAG modelscited by 14
- 2024Ordering-Based Causal Discovery for Linear and Nonlinear Relationscited by 11
- 2021Structure learning in polynomial time: Greedy algorithms, Bregman information, and exponential familiescited by 10
12 most cited of 48 All 48 (JSON)
- 2026Discrete Score Matching Enables Causal Discovery from Count Data30 Sep 2026
- 2026The Statistical Cost of Causal Discovery with Feedback28 Sep 2026
- 2026Provable Guarantees and Efficient Learning of Structural Equation Models with Latent Confounders16 Sep 2026
- 2026Order-based Rehearsal Learning6 May 2026
- 2026Causal Representation Learning from General Environments under Nonparametric Mixing26 Apr 2026
- 2026Sparse Additive Model Pruning for Order-Based Causal Structure Learning17 Feb 2026
- 2026Ordering-based Causal Discovery via Generalized Score Matching22 Jan 2026
- 2025Learning Gaussian DAG Models without Condition Number Bounds8 Nov 2025
- 2025Causal Ordering for Structure Learning from Time Series28 Oct 2025
- 2025Identifiability of the minimum-trace directed acyclic graph and hill climbing algorithms without strict local optima under weakly increasing error variances7 Aug 2025
- 2024Linear Causal Bandits: Unknown Graph and Soft Interventions4 Nov 2024
- 2024LoSAM: Local Search in Additive Noise Models with Mixed Mechanisms and General Noise for Global Causal Discovery15 Oct 2024
12 newest of 48 All 48 (JSON)