Scalable Causal Discovery with Score Matching
Not on the map. Why?
Abstract (arXiv)
This paper demonstrates how to discover the whole causal graph from the second derivative of the log-likelihood in observational non-linear additive Gaussian noise models. Leveraging scalable machine learning approaches to approximate the score function nabla log p(X), we extend the work of Rolland et al. (2022) that only recovers the topological order from the score and requires an expensive pruning step removing spurious edges among those admitted by the ordering. Our analysis leads to DAS (acronym for Discovery At Scale), a practical algorithm that reduces the complexity of the pruning by a factor proportional to the graph size. In practice, DAS achieves competitive accuracy with current state-of-the-art while being over an order of magnitude faster. Overall, our approach enables principled and scalable causal discovery, significantly lowering the compute bar.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Builds on 8 of its 38 references that are in the map. First posted on arXiv 6 Apr 2023.
Builds on
8 of 38 references.
References · 8
- 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 745
- 2019Gradient-Based Neural DAG Learningcited by 227
- 2013CAM: Causal additive models, high-dimensional order search and penalized regressioncited by 175
- 2022Score matching enables causal discovery of nonlinear additive noise modelscited by 108
- 2020Amortized Causal Discovery: Learning to Infer Causal Graphs from Time-Series Datacited by 99
- 2017Inference via low-dimensional couplingscited by 43
- 2017Beyond normality: Learning sparse probabilistic graphical models in the non-Gaussian settingcited by 15
- 2021Obtaining Causal Information by Merging Datasets with MAXENTcited by 9
Built on by
Citing papers per year: 2023: 7; 2024: 13; 2025: 7; 2026: 15.
42 papers.
Sort:
By area:
- 2023General Identifiability and Achievability for Causal Representation Learningcited by 34
- 2023Assumption violations in causal discovery and the robustness of score matchingcited by 28
- 2023textttcausalAssembly: Generating Realistic Production Data for Benchmarking Causal Discoverycited by 18
- 2024Signature Kernel Conditional Independence Tests in Causal Discovery for Stochastic Processescited by 18
- 2024Identifiable Exchangeable Mechanisms for Causal Structure and Representation Learningcited by 16
- 2023Sample Complexity Bounds for Score-Matching: Causal Discovery and Generative Modelingcited by 15
- 2024DCILP: A Distributed Approach for Large-Scale Causal Structure Learningcited by 8
- 2024Score matching through the roof: linear, nonlinear, and latent variables causal discoverycited by 8
- 2024A Skewness-Based Criterion for Addressing Heteroscedastic Noise in Causal Discoverycited by 7
- 2024Identifiability Guarantees for Causal Disentanglement from Purely Observational Datacited by 7
- 2025Distinguishing Cause from Effect with Causal Velocity Modelscited by 6
- 2024Hybrid Top-Down Global Causal Discovery with Local Search for Linear and Nonlinear Additive Noise Modelscited by 5
30 more
- 2024Scalable and Flexible Causal Discovery with an Efficient Test for Adjacencycited by 5
- 2023Learning Causal Graphs via Monotone Triangular Transport Mapscited by 4
- 2023Shortcuts for causal discovery of nonlinear models by score matchingcited by 4
- 2024AcceleratedLiNGAM: Learning Causal DAGs at the speed of GPUscited by 4
- 2026Causal Representation Learning from General Environments under Nonparametric Mixingcited by 4
- 2023Differentiable Bayesian Structure Learning with Acyclicity Assurancecited by 3
- 2024Cross-validating causal discovery via Leave-One-Variable-Outcited by 2
- 2026DAG-FM: A Foundation Model for Causal Discovery under Heterogeneous Causal Mechanismscited by 2
- 2024LoSAM: Local Search in Additive Noise Models with Mixed Mechanisms and General Noise for Global Causal Discoverycited by 1
- 2024Causal Order Discovery based on Monotonic SCMscited by 1
- 2024Score-matching-based Structure Learning for Temporal Data on Networkscited by 1
- 2025Causal Discovery via Bayesian Optimizationcited by 1
- 2025Your Assumed DAG is Wrong and Here's How To Deal With Itcited by 1
- 2025When Additive Noise Meets Unobserved Mediators: Bivariate Denoising Diffusion for Causal Discoverycited by 1
- 2025Causal Ordering for Structure Learning from Time Seriescited by 1
- 2026Ordering-based Causal Discovery via Generalized Score Matchingcited by 1
- 2026Learning Causal Orderings for In-Context Tabular Predictioncited by 1
- 2026Order-based Causal Discovery for Multistage Processescited by 1
- 2025Estimating Treatment Effects with Independent Component Analysiscited by 0
- 2025On the Identifiability of Causal Graphs with the Invariance Principlecited by 0
- 2026Efficient Causal Structure Learning via Modular Subgraph Integrationcited by 0
- 2026Causal Graph Learning via Distributional Invariance of Cause-Effect Relationshipcited by 0
- 2026Sparse Additive Model Pruning for Order-Based Causal Structure Learningcited by 0
- 2026Causal-Audit: A Framework for Risk Assessment of Assumption Violations in Time-Series Causal Discoverycited by 0
- 2026Optimization-Free Topological Sort for Causal Discovery via the Schur Complement of Score Jacobianscited by 0
- 2026A Topological Sorting Criterion for Random Causal Directed Acyclic Graphscited by 0
- 2026Function-Valued Causal Influence in Nonlinear Time Seriescited by 0
- 2026CausalArena: Benchmarking Causal Discovery in the Foundation Model Eracited by 0
- 2026Hessian Rank Constraint for Learning Structure of Nonlinear Latent Variable Modelscited by 0
- 2026Discrete Score Matching Enables Causal Discovery from Count Datacited by 0
- 2026Discrete Score Matching Enables Causal Discovery from Count Data30 Sep 2026
- 2026Hessian Rank Constraint for Learning Structure of Nonlinear Latent Variable Models21 Sep 2026
- 2026CausalArena: Benchmarking Causal Discovery in the Foundation Model Era10 Sep 2026
- 2026DAG-FM: A Foundation Model for Causal Discovery under Heterogeneous Causal Mechanisms13 Jul 2026
- 2026Order-based Causal Discovery for Multistage Processes4 Jul 2026
- 2026Function-Valued Causal Influence in Nonlinear Time Series26 May 2026
- 2026Learning Causal Orderings for In-Context Tabular Prediction21 May 2026
- 2026A Topological Sorting Criterion for Random Causal Directed Acyclic Graphs7 May 2026
- 2026Optimization-Free Topological Sort for Causal Discovery via the Schur Complement of Score Jacobians28 Apr 2026
- 2026Causal Representation Learning from General Environments under Nonparametric Mixing26 Apr 2026
- 2026Causal-Audit: A Framework for Risk Assessment of Assumption Violations in Time-Series Causal Discovery2 Apr 2026
- 2026Sparse Additive Model Pruning for Order-Based Causal Structure Learning17 Feb 2026
30 more
- 2026Causal Graph Learning via Distributional Invariance of Cause-Effect Relationship3 Feb 2026
- 2026Efficient Causal Structure Learning via Modular Subgraph Integration28 Jan 2026
- 2026Ordering-based Causal Discovery via Generalized Score Matching22 Jan 2026
- 2025Causal Ordering for Structure Learning from Time Series28 Oct 2025
- 2025On the Identifiability of Causal Graphs with the Invariance Principle15 Oct 2025
- 2025Estimating Treatment Effects with Independent Component Analysis22 Jul 2025
- 2025When Additive Noise Meets Unobserved Mediators: Bivariate Denoising Diffusion for Causal Discovery29 Jun 2025
- 2025Your Assumed DAG is Wrong and Here's How To Deal With It24 Feb 2025
- 2025Distinguishing Cause from Effect with Causal Velocity Models7 Feb 2025
- 2025Causal Discovery via Bayesian Optimization25 Jan 2025
- 2024Score-matching-based Structure Learning for Temporal Data on Networks10 Dec 2024
- 2024Cross-validating causal discovery via Leave-One-Variable-Out8 Nov 2024
- 2024Identifiability Guarantees for Causal Disentanglement from Purely Observational Data31 Oct 2024
- 2024Causal Order Discovery based on Monotonic SCMs24 Oct 2024
- 2024LoSAM: Local Search in Additive Noise Models with Mixed Mechanisms and General Noise for Global Causal Discovery15 Oct 2024
- 2024A Skewness-Based Criterion for Addressing Heteroscedastic Noise in Causal Discovery8 Oct 2024
- 2024Score matching through the roof: linear, nonlinear, and latent variables causal discovery26 Jul 2024
- 2024Identifiable Exchangeable Mechanisms for Causal Structure and Representation Learning20 Jun 2024
- 2024DCILP: A Distributed Approach for Large-Scale Causal Structure Learning15 Jun 2024
- 2024Scalable and Flexible Causal Discovery with an Efficient Test for Adjacency13 Jun 2024
- 2024Hybrid Top-Down Global Causal Discovery with Local Search for Linear and Nonlinear Additive Noise Models23 May 2024
- 2024AcceleratedLiNGAM: Learning Causal DAGs at the speed of GPUs6 Mar 2024
- 2024Signature Kernel Conditional Independence Tests in Causal Discovery for Stochastic Processes28 Feb 2024
- 2023Sample Complexity Bounds for Score-Matching: Causal Discovery and Generative Modeling27 Oct 2023
- 2023General Identifiability and Achievability for Causal Representation Learning24 Oct 2023
- 2023Shortcuts for causal discovery of nonlinear models by score matching22 Oct 2023
- 2023Assumption violations in causal discovery and the robustness of score matching20 Oct 2023
- 2023Differentiable Bayesian Structure Learning with Acyclicity Assurance4 Sep 2023
- 2023textttcausalAssembly: Generating Realistic Production Data for Benchmarking Causal Discovery19 Jun 2023
- 2023Learning Causal Graphs via Monotone Triangular Transport Maps26 May 2023
- 2023General Identifiability and Achievability for Causal Representation Learningcited by 34
- 2023Assumption violations in causal discovery and the robustness of score matchingcited by 28
- 2023textttcausalAssembly: Generating Realistic Production Data for Benchmarking Causal Discoverycited by 18
- 2024Signature Kernel Conditional Independence Tests in Causal Discovery for Stochastic Processescited by 18
- 2024Identifiable Exchangeable Mechanisms for Causal Structure and Representation Learningcited by 16
- 2023Sample Complexity Bounds for Score-Matching: Causal Discovery and Generative Modelingcited by 15
- 2024DCILP: A Distributed Approach for Large-Scale Causal Structure Learningcited by 8
- 2024Score matching through the roof: linear, nonlinear, and latent variables causal discoverycited by 8
- 2024A Skewness-Based Criterion for Addressing Heteroscedastic Noise in Causal Discoverycited by 7
- 2024Identifiability Guarantees for Causal Disentanglement from Purely Observational Datacited by 7
- 2025Distinguishing Cause from Effect with Causal Velocity Modelscited by 6
- 2024Hybrid Top-Down Global Causal Discovery with Local Search for Linear and Nonlinear Additive Noise Modelscited by 5
12 most cited of 40 All 40 (JSON)
- 2026Discrete Score Matching Enables Causal Discovery from Count Data30 Sep 2026
- 2026Hessian Rank Constraint for Learning Structure of Nonlinear Latent Variable Models21 Sep 2026
- 2026DAG-FM: A Foundation Model for Causal Discovery under Heterogeneous Causal Mechanisms13 Jul 2026
- 2026Order-based Causal Discovery for Multistage Processes4 Jul 2026
- 2026Function-Valued Causal Influence in Nonlinear Time Series26 May 2026
- 2026Learning Causal Orderings for In-Context Tabular Prediction21 May 2026
- 2026A Topological Sorting Criterion for Random Causal Directed Acyclic Graphs7 May 2026
- 2026Optimization-Free Topological Sort for Causal Discovery via the Schur Complement of Score Jacobians28 Apr 2026
- 2026Causal Representation Learning from General Environments under Nonparametric Mixing26 Apr 2026
- 2026Causal-Audit: A Framework for Risk Assessment of Assumption Violations in Time-Series Causal Discovery2 Apr 2026
- 2026Sparse Additive Model Pruning for Order-Based Causal Structure Learning17 Feb 2026
- 2026Causal Graph Learning via Distributional Invariance of Cause-Effect Relationship3 Feb 2026
12 newest of 40 All 40 (JSON)