Stable Differentiable Causal Discovery
Not on the map. Why?
Abstract (arXiv)
Inferring causal relationships as directed acyclic graphs (DAGs) is an important but challenging problem. Differentiable Causal Discovery (DCD) is a promising approach to this problem, framing the search as a continuous optimization. But existing DCD methods are numerically unstable, with poor performance beyond tens of variables. In this paper, we propose Stable Differentiable Causal Discovery (SDCD), a new method that improves previous DCD methods in two ways: (1) It employs an alternative constraint for acyclicity; this constraint is more stable, both theoretically and empirically, and fast to compute. (2) It uses a training procedure tailored for sparse causal graphs, which are common in real-world scenarios. We first derive SDCD and prove its stability and correctness. We then evaluate it with both observational and interventional data and on both small-scale and large-scale settings. We find that SDCD outperforms existing methods in both convergence speed and accuracy and can scale to thousands of variables. We provide code at https://github.com/azizilab/sdcd.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 23 of its 49 references that are in the map. First posted on arXiv 17 Nov 2023.
Builds on
23 of 49 references.
References · 23
- 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 745
- 2019DAG-GNN: DAG Structure Learning with Graph Neural Networkscited by 329
- 2013Causal Discovery with Continuous Additive Noise Modelscited by 252
- 2019Gradient-Based Neural DAG Learningcited by 227
- 2020Differentiable Causal Discovery from Interventional Datacited by 218
- 2019Learning Sparse Nonparametric DAGscited by 207
- 2020On the Role of Sparsity and DAG Constraints for Learning Linear DAGscited by 186
- 2013CAM: Causal additive models, high-dimensional order search and penalized regressioncited by 175
- 2021Beware of the Simulated DAG! Causal Discovery Benchmarks May Be Easy To Gamecited by 159
- 2022DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity Characterizationcited by 135
- 2022Score matching enables causal discovery of nonlinear additive noise modelscited by 108
- 2022Amortized Inference for Causal Structure Learningcited by 89
11 more
- 2013High-dimensional learning of linear causal networks via inverse covariance estimationcited by 86
- 2021Efficient Neural Causal Discovery without Acyclicity Constraintscited by 82
- 2018Characterizing and Learning Equivalence Classes of Causal DAGs under Interventionscited by 76
- 2020DAGs with No Fears: A Closer Look at Continuous Optimization for Learning Bayesian Networkscited by 66
- 2021DAGs with No Curl: An Efficient DAG Structure Learning Approachcited by 53
- 2014Constraint-based Causal Discovery from Multiple Interventions over Overlapping Variable Setscited by 48
- 2022Large-Scale Differentiable Causal Discovery of Factor Graphscited by 47
- 2019Scaling structural learning with NO-BEARS to infer causal transcriptome networkscited by 39
- 2020On the Convergence of Continuous Constrained Optimization for Structure Learningcited by 38
- 2023Structure Learning with Continuous Optimization: A Sober Look and Beyondcited by 34
- 2023Optimizing NOTEARS Objectives via Topological Swapscited by 17
Built on by
Citing papers per year: 2024: 7; 2025: 8; 2026: 15.
30 papers.
Sort:
By area:
- 2025Extremely Greedy Equivalence Searchcited by 8
- 2024Deriving Causal Order from Single-Variable Interventions: Guarantees & Algorithmcited by 5
- 2024Scalable and Flexible Causal Discovery with an Efficient Test for Adjacencycited by 5
- 2024Continuous Bayesian Model Selection for Multivariate Causal Discoverycited by 5
- 2026CauScale: Neural Causal Discovery at Scalecited by 5
- 2025Since Faithfulness Fails: The Performance Limits of Neural Causal Discoverycited by 4
- 2025Causal-Adapter: Taming Text-to-Image Diffusion for Faithful Counterfactual Generationcited by 4
- 2026Arrow: A Foundation Model for Causal Discoverycited by 4
- 2024Differentiable Causal Discovery For Latent Hierarchical Causal Modelscited by 3
- 2024Efficient Differentiable Discovery of Causal Ordercited by 2
- 2026Coarse-to-Fine Learning of Dynamic Causal Structurescited by 2
- 2024Revisiting Differentiable Structure Learning: Inconsistency of ℓ1 Penalty and Beyondcited by 1
18 more
- 2025Amortized Causal Discovery with Prior-Fitted Networkscited by 1
- 2024Kernel-Based Differentiable Learning of Non-Parametric Directed Acyclic Graphical Modelscited by 0
- 2025Differentiable Structure Learning and Causal Discovery for General Binary Datacited by 0
- 2025Large-Scale Bayesian Causal Discovery with Interventional Datacited by 0
- 2025Theoretical Guarantees for Causal Discovery on Large Random Graphscited by 0
- 2025DAG Learning from Zero-Inflated Count Data Using Continuous Optimizationcited by 0
- 2026SC3D: Dynamic and Differentiable Causal Discovery for Temporal and Instantaneous Graphscited by 0
- 2026Neural Autoregressive Flows for Markov Boundary Learningcited by 0
- 2026Smoothing the Landscape: Causal Structure Learning via Diffusion Denoising Objectivescited by 0
- 2026When Does Gene Regulatory Network Inference Break? A Controlled Diagnostic Study of Causal and Correlational Methods on Single-Cell Datacited by 0
- 2026PACER: Acyclic Causal Discovery from Large-Scale Interventional Datacited by 0
- 2026KG-SoftMAP: Soft Knowledge-Graph Priors for Bayesian Network Structure Learning from Sparse Discrete Datacited by 0
- 2026Unsupervised Causal Abstractions Discoverycited by 0
- 2026Amortized Bayesian Causal Discovery of Extended Factor Graphscited by 0
- 2026Support Selection Beyond Smooth DAG Exactness: Completion Geometry,Score Margins, and Selective Certificatescited by 0
- 2026Guide, Not Bind: Why Defeasible Priors Fail in Augmented Lagrangian Causal Discoverycited by 0
- 2026CausalArena: Benchmarking Causal Discovery in the Foundation Model Eracited by 0
- 2026Demistifying Data and Simulator Assumptions in Supervised Causal Discoverycited by 0
- 2026Demistifying Data and Simulator Assumptions in Supervised Causal Discovery29 Sep 2026
- 2026CausalArena: Benchmarking Causal Discovery in the Foundation Model Era10 Sep 2026
- 2026Guide, Not Bind: Why Defeasible Priors Fail in Augmented Lagrangian Causal Discovery3 Sep 2026
- 2026Support Selection Beyond Smooth DAG Exactness: Completion Geometry,Score Margins, and Selective Certificates8 Aug 2026
- 2026Amortized Bayesian Causal Discovery of Extended Factor Graphs24 Jul 2026
- 2026Unsupervised Causal Abstractions Discovery17 Jun 2026
- 2026KG-SoftMAP: Soft Knowledge-Graph Priors for Bayesian Network Structure Learning from Sparse Discrete Data9 Jun 2026
- 2026PACER: Acyclic Causal Discovery from Large-Scale Interventional Data14 May 2026
- 2026Arrow: A Foundation Model for Causal Discovery8 May 2026
- 2026When Does Gene Regulatory Network Inference Break? A Controlled Diagnostic Study of Causal and Correlational Methods on Single-Cell Data6 May 2026
- 2026Smoothing the Landscape: Causal Structure Learning via Diffusion Denoising Objectives2 Apr 2026
- 2026Neural Autoregressive Flows for Markov Boundary Learning21 Mar 2026
18 more
- 2026Coarse-to-Fine Learning of Dynamic Causal Structures26 Feb 2026
- 2026CauScale: Neural Causal Discovery at Scale9 Feb 2026
- 2026SC3D: Dynamic and Differentiable Causal Discovery for Temporal and Instantaneous Graphs2 Feb 2026
- 2025DAG Learning from Zero-Inflated Count Data Using Continuous Optimization18 Dec 2025
- 2025Amortized Causal Discovery with Prior-Fitted Networks3 Dec 2025
- 2025Theoretical Guarantees for Causal Discovery on Large Random Graphs4 Nov 2025
- 2025Large-Scale Bayesian Causal Discovery with Interventional Data2 Oct 2025
- 2025Causal-Adapter: Taming Text-to-Image Diffusion for Faithful Counterfactual Generation29 Sep 2025
- 2025Differentiable Structure Learning and Causal Discovery for General Binary Data25 Sep 2025
- 2025Extremely Greedy Equivalence Search26 Feb 2025
- 2025Since Faithfulness Fails: The Performance Limits of Neural Causal Discovery22 Feb 2025
- 2024Differentiable Causal Discovery For Latent Hierarchical Causal Models29 Nov 2024
- 2024Continuous Bayesian Model Selection for Multivariate Causal Discovery15 Nov 2024
- 2024Revisiting Differentiable Structure Learning: Inconsistency of ℓ1 Penalty and Beyond24 Oct 2024
- 2024Efficient Differentiable Discovery of Causal Order11 Oct 2024
- 2024Kernel-Based Differentiable Learning of Non-Parametric Directed Acyclic Graphical Models20 Aug 2024
- 2024Scalable and Flexible Causal Discovery with an Efficient Test for Adjacency13 Jun 2024
- 2024Deriving Causal Order from Single-Variable Interventions: Guarantees & Algorithm28 May 2024
- 2025Extremely Greedy Equivalence Searchcited by 8
- 2024Deriving Causal Order from Single-Variable Interventions: Guarantees & Algorithmcited by 5
- 2024Scalable and Flexible Causal Discovery with an Efficient Test for Adjacencycited by 5
- 2024Continuous Bayesian Model Selection for Multivariate Causal Discoverycited by 5
- 2026CauScale: Neural Causal Discovery at Scalecited by 5
- 2025Since Faithfulness Fails: The Performance Limits of Neural Causal Discoverycited by 4
- 2026Arrow: A Foundation Model for Causal Discoverycited by 4
- 2024Differentiable Causal Discovery For Latent Hierarchical Causal Modelscited by 3
- 2024Efficient Differentiable Discovery of Causal Ordercited by 2
- 2026Coarse-to-Fine Learning of Dynamic Causal Structurescited by 2
- 2024Revisiting Differentiable Structure Learning: Inconsistency of ℓ1 Penalty and Beyondcited by 1
- 2025Amortized Causal Discovery with Prior-Fitted Networkscited by 1
12 most cited of 27 All 27 (JSON)
- 2026Demistifying Data and Simulator Assumptions in Supervised Causal Discovery29 Sep 2026
- 2026Guide, Not Bind: Why Defeasible Priors Fail in Augmented Lagrangian Causal Discovery3 Sep 2026
- 2026Support Selection Beyond Smooth DAG Exactness: Completion Geometry,Score Margins, and Selective Certificates8 Aug 2026
- 2026Amortized Bayesian Causal Discovery of Extended Factor Graphs24 Jul 2026
- 2026Unsupervised Causal Abstractions Discovery17 Jun 2026
- 2026KG-SoftMAP: Soft Knowledge-Graph Priors for Bayesian Network Structure Learning from Sparse Discrete Data9 Jun 2026
- 2026PACER: Acyclic Causal Discovery from Large-Scale Interventional Data14 May 2026
- 2026Arrow: A Foundation Model for Causal Discovery8 May 2026
- 2026When Does Gene Regulatory Network Inference Break? A Controlled Diagnostic Study of Causal and Correlational Methods on Single-Cell Data6 May 2026
- 2026Neural Autoregressive Flows for Markov Boundary Learning21 Mar 2026
- 2026Coarse-to-Fine Learning of Dynamic Causal Structures26 Feb 2026
- 2026CauScale: Neural Causal Discovery at Scale9 Feb 2026
12 newest of 27 All 27 (JSON)