Learning Sparse Nonparametric DAGs
Not on the map. Why?
Abstract (arXiv)
We develop a framework for learning sparse nonparametric directed acyclic graphs (DAGs) from data. Our approach is based on a recent algebraic characterization of DAGs that led to a fully continuous program for score-based learning of DAG models parametrized by a linear structural equation model (SEM). We extend this algebraic characterization to nonparametric SEM by leveraging nonparametric sparsity based on partial derivatives, resulting in a continuous optimization problem that can be applied to a variety of nonparametric and semiparametric models including GLMs, additive noise models, and index models as special cases. Unlike existing approaches that require specific modeling choices, loss functions, or algorithms, we present a completely general framework that can be applied to general nonlinear models (e.g. without additive noise), general differentiable loss functions, and generic black-box optimization routines. The code is available at https://github.com/xunzheng/notears.
Key facts. Cited by 207 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 30; 2022: 38; 2023: 46; 2024: 30; 2025: 27; 2026: 36.
207 papers.
Sort:
By area:
- 2021D'ya like DAGs? A Survey on Structure Learning and Causal Discoverycited by 209
- 2021Beware of the Simulated DAG! Causal Discovery Benchmarks May Be Easy To Gamecited by 159
- 2022DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity Characterizationcited by 135
- 2021DiBS: Differentiable Bayesian Structure Learningcited by 105
- 2023Nonparametric Identifiability of Causal Representations from Unknown Interventionscited by 105
- 2022Deep End-to-end Causal Inferencecited by 93
- 2021Efficient Neural Causal Discovery without Acyclicity Constraintscited by 82
- 2022Diffusion Models for Causal Discovery via Topological Orderingcited by 64
- 2021gCastle: A Python Toolbox for Causal Discoverycited by 60
- 2021Ordering-Based Causal Discovery with Reinforcement Learningcited by 55
- 2021DAGs with No Curl: An Efficient DAG Structure Learning Approachcited by 53
- 2021MIRACLE: Causally-Aware Imputation via Learning Missing Data Mechanismscited by 50
38 more
- 2022Large-Scale Differentiable Causal Discovery of Factor Graphscited by 47
- 2021Unsuitability of NOTEARS for Causal Graph Discoverycited by 46
- 2023Causal Discovery from Temporal Data: An Overview and New Perspectivescited by 43
- 2021Learning Neural Causal Models with Active Interventionscited by 40
- 2023Structure Learning with Continuous Optimization: A Sober Look and Beyondcited by 34
- 2021NTS-NOTEARS: Learning Nonparametric DBNs With Prior Knowledgecited by 33
- 2022Identifying Weight-Variant Latent Causal Modelscited by 33
- 2023Discovering Causal Relations and Equations from Datacited by 33
- 2022Distributed Graph Neural Network Training: A Surveycited by 32
- 2021Towards Federated Bayesian Network Structure Learning with Continuous Optimizationcited by 31
- 2021ACRE: Abstract Causal REasoning Beyond Covariationcited by 30
- 2023Causal Representation Learning Made Identifiable by Grouping of Observational Variablescited by 30
- 2023Stable Differentiable Causal Discoverycited by 30
- 2022CausalBench: A Large-scale Benchmark for Network Inference from Single-cell Perturbation Datacited by 29
- 2023Assumption violations in causal discovery and the robustness of score matchingcited by 28
- 2022BaCaDI: Bayesian Causal Discovery with Unknown Interventionscited by 26
- 2022Truncated Matrix Power Iteration for Differentiable DAG Learningcited by 23
- 2021Data Generating Process to Evaluate Causal Discovery Techniques for Time Series Datacited by 22
- 2023Self-Compatibility: Evaluating Causal Discovery without Ground Truthcited by 22
- 2022Differentiable Causal Discovery Under Latent Interventionscited by 21
- 2022MissDAG: Causal Discovery in the Presence of Missing Data with Continuous Additive Noise Modelscited by 21
- 2023NODAGS-Flow: Nonlinear Cyclic Causal Structure Learningcited by 20
- 2023Causal Deep Learningcited by 20
- 2021A Theoretical Analysis on Independence-driven Importance Weighting for Covariate-shift Generalizationcited by 18
- 2023Automated Scientific Discovery: From Equation Discovery to Autonomous Discovery Systemscited by 18
- 2023textttcausalAssembly: Generating Realistic Production Data for Benchmarking Causal Discoverycited by 18
- 2024Signature Kernel Conditional Independence Tests in Causal Discovery for Stochastic Processescited by 18
- 2021FedDAG: Federated DAG Structure Learningcited by 17
- 2022CausPref: Causal Preference Learning for Out-of-Distribution Recommendationcited by 17
- 2023Optimizing NOTEARS Objectives via Topological Swapscited by 17
- 2024Standardizing Structural Causal Modelscited by 17
- 2021Simultaneous Missing Value Imputation and Structure Learning with Groupscited by 16
- 2023Causal Reasoning in the Presence of Latent Confounders via Neural ADMG Learningcited by 15
- 2021Efficient Bayesian network structure learning via local Markov boundary searchcited by 14
- 2023On Learning Necessary and Sufficient Causal Graphscited by 14
- 2023Computably Continuous Reinforcement-Learning Objectives are PAC-learnablecited by 13
- 2023MM-DAG: Multi-task DAG Learning for Multi-modal Data -- with Application for Traffic Congestion Analysiscited by 13
- 2022Characterization and Greedy Learning of Gaussian Structural Causal Models under Unknown Interventionscited by 12
50 most cited of 207 All 207 (JSON)
- 2026Discrete Score Matching Enables Causal Discovery from Count Data30 Sep 2026
- 2026Demistifying Data and Simulator Assumptions in Supervised Causal Discovery29 Sep 2026
- 2026Learning the Structure of Triangular Transport Maps29 Sep 2026
- 2026ITSY: Causal Discovery From Irregular Time-Series Data20 Sep 2026
- 2026LimiX-2: A Contextual Mechanism Network Towards General Structured-Data Intelligence15 Sep 2026
- 2026CausalArena: Benchmarking Causal Discovery in the Foundation Model Era10 Sep 2026
- 2026From topology learning to graph generation: A unifying perspective2 Sep 2026
- 2026Neural-Bayesian Structure Learning for Discrete Choice Modeling26 Aug 2026
- 2026Joint Causal Structure and Cluster Discovery Using Variational Inference23 Aug 2026
- 2026GoT-CD: Graph-of-Thoughts Causal Discovery and the Fragility of Post-hoc Path-Specific Fairness Audits3 Aug 2026
- 2026From Unsupervised Subgroups to Hypothetical State-Intervention Policies: An Evaluation of Selected Subgrouping Methods in Observational Health Data29 Jul 2026
- 2026Structure Learning on Clustered Data9 Jul 2026
38 more
- 2026Order-based Causal Discovery for Multistage Processes4 Jul 2026
- 2026A Survey on Federated Causal Discovery and Inference21 Jun 2026
- 2026Graphical conditional generative modeling for digital twin modeling15 Jun 2026
- 2026Causal Atlases from Entropic Inference: Bayesian Networks beyond Optimal DAGs4 Jun 2026
- 2026EML-CD: Causal Mechanism Recovery via EML Symbolic Trees in Structure Learning4 Jun 2026
- 2026CauTion: Knowing When to Trust LLMs for Ensemble Causal Discovery2 Jun 2026
- 2026Do Real-World Datasets Contain Natural Experiments? An Empirical Study Using Causal Feature Selection2 Jun 2026
- 2026A Unified Framework for Structure-Aware Clustering and Heterogeneous Causal Graph Learning19 May 2026
- 2026Stable Causal Discovery via Directed Acyclic Graph Aggregation18 May 2026
- 2026SCOUT: Cyclic Causal Discovery Under Soft Interventions with Unknown Targets15 May 2026
- 2026PACER: Acyclic Causal Discovery from Large-Scale Interventional Data14 May 2026
- 2026Arrow: A Foundation Model for Causal Discovery8 May 2026
- 2026MuCALD-SplitFed: Causal-Latent Diffusion for Privacy-Preserving Multi-Task Split-Federated Medical Image Segmentation4 May 2026
- 2026Proactive Dialogue Model with Intent Prediction30 Apr 2026
- 2026TTCD:Transformer Integrated Temporal Causal Discovery from Non-Stationary Time Series Data27 Apr 2026
- 2026DAGAF: A directed acyclic generative adversarial framework for joint structure learning and tabular data synthesis5 Apr 2026
- 2026A Knowledge-Informed Pretrained Model for Causal Discovery21 Mar 2026
- 2026Scalable Contrastive Causal Discovery under Unknown Soft Interventions3 Mar 2026
- 2026Leveraging Large Language Models for Causal Discovery: a Constraint-based, Argumentation-driven Approach18 Feb 2026
- 2026Sparse Additive Model Pruning for Order-Based Causal Structure Learning17 Feb 2026
- 2026Causal Graph Learning via Distributional Invariance of Cause-Effect Relationship3 Feb 2026
- 2026Root Cause Analysis of Measurement and Mechanistic Anomalies30 Jan 2026
- 2026Ordering-based Causal Discovery via Generalized Score Matching22 Jan 2026
- 2026Efficient Differentiable Causal Discovery via Reliable Super-Structure Learning9 Jan 2026
- 2025Causal Discovery with Mixed Latent Confounding via Precision Decomposition31 Dec 2025
- 2025Differentially Private and Federated Structure Learning in Bayesian Networks1 Dec 2025
- 2025Robust Causal Discovery under Imperfect Structural Constraints10 Nov 2025
- 2025Higher-Order Causal Structure Learning with Additive Models5 Nov 2025
- 2025Differentiable Constraint-Based Causal Discovery24 Oct 2025
- 2025Shylock: Causal Discovery in Multivariate Time Series based on Hybrid Constraints24 Oct 2025
- 2025Realizing LLMs' Causal Potential Requires Science-Grounded, Novel Benchmarks18 Oct 2025
- 2025Humanoid-inspired Causal Representation Learning for Domain Generalization18 Oct 2025
- 2025The Robustness of Differentiable Causal Discovery in Misspecified Scenarios14 Oct 2025
- 2025Score-based Greedy Search for Structure Identification of Partially Observed Linear Causal Models5 Oct 2025
- 2025Differentiable Structure Learning and Causal Discovery for General Binary Data25 Sep 2025
- 2025Interpretable Clustering with Adaptive Heterogeneous Causal Structure Learning in Mixed Observational Data4 Sep 2025
- 2025Differentiable Cyclic Causal Discovery Under Unmeasured Confounders11 Aug 2025
- 2025Uncertainty Quantification for Large-Scale Deep Networks via Post-StoNet Modeling2 Aug 2025
50 newest of 207 All 207 (JSON)
- 2023Causal Reasoning in the Presence of Latent Confounders via Neural ADMG Learningcited by 15
- 2022Interactive Visual Reasoning under Uncertaintycited by 8
- 2025ACCESS : A Benchmark for Abstract Causal Event Discovery and Reasoningcited by 3
- 2026A Survey on Federated Causal Discovery and Inferencecited by 0
- 2026GoT-CD: Graph-of-Thoughts Causal Discovery and the Fragility of Post-hoc Path-Specific Fairness Auditscited by 0
- 2026CausalArena: Benchmarking Causal Discovery in the Foundation Model Eracited by 0
- 2026CausalArena: Benchmarking Causal Discovery in the Foundation Model Era10 Sep 2026
- 2026GoT-CD: Graph-of-Thoughts Causal Discovery and the Fragility of Post-hoc Path-Specific Fairness Audits3 Aug 2026
- 2026A Survey on Federated Causal Discovery and Inference21 Jun 2026
- 2025ACCESS : A Benchmark for Abstract Causal Event Discovery and Reasoning12 Feb 2025
- 2023Causal Reasoning in the Presence of Latent Confounders via Neural ADMG Learning22 Mar 2023
- 2022Interactive Visual Reasoning under Uncertainty18 Jun 2022
- 2022Diffusion Models for Causal Discovery via Topological Orderingcited by 64
- 2025When Additive Noise Meets Unobserved Mediators: Bivariate Denoising Diffusion for Causal Discoverycited by 1
- 2026MuCALD-SplitFed: Causal-Latent Diffusion for Privacy-Preserving Multi-Task Split-Federated Medical Image Segmentationcited by 0
- 2026MuCALD-SplitFed: Causal-Latent Diffusion for Privacy-Preserving Multi-Task Split-Federated Medical Image Segmentation4 May 2026
- 2025When Additive Noise Meets Unobserved Mediators: Bivariate Denoising Diffusion for Causal Discovery29 Jun 2025
- 2022Diffusion Models for Causal Discovery via Topological Ordering12 Oct 2022
- 2021D'ya like DAGs? A Survey on Structure Learning and Causal Discoverycited by 209
- 2021Beware of the Simulated DAG! Causal Discovery Benchmarks May Be Easy To Gamecited by 159
- 2022DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity Characterizationcited by 135
- 2021DiBS: Differentiable Bayesian Structure Learningcited by 105
- 2023Nonparametric Identifiability of Causal Representations from Unknown Interventionscited by 105
- 2022Deep End-to-end Causal Inferencecited by 93
- 2021Efficient Neural Causal Discovery without Acyclicity Constraintscited by 82
- 2021gCastle: A Python Toolbox for Causal Discoverycited by 60
- 2021Ordering-Based Causal Discovery with Reinforcement Learningcited by 55
- 2021DAGs with No Curl: An Efficient DAG Structure Learning Approachcited by 53
- 2021MIRACLE: Causally-Aware Imputation via Learning Missing Data Mechanismscited by 50
- 2022Large-Scale Differentiable Causal Discovery of Factor Graphscited by 47
12 most cited of 198 All 198 (JSON)
- 2026Discrete Score Matching Enables Causal Discovery from Count Data30 Sep 2026
- 2026Demistifying Data and Simulator Assumptions in Supervised Causal Discovery29 Sep 2026
- 2026Learning the Structure of Triangular Transport Maps29 Sep 2026
- 2026ITSY: Causal Discovery From Irregular Time-Series Data20 Sep 2026
- 2026LimiX-2: A Contextual Mechanism Network Towards General Structured-Data Intelligence15 Sep 2026
- 2026From topology learning to graph generation: A unifying perspective2 Sep 2026
- 2026Neural-Bayesian Structure Learning for Discrete Choice Modeling26 Aug 2026
- 2026Joint Causal Structure and Cluster Discovery Using Variational Inference23 Aug 2026
- 2026From Unsupervised Subgroups to Hypothetical State-Intervention Policies: An Evaluation of Selected Subgrouping Methods in Observational Health Data29 Jul 2026
- 2026Structure Learning on Clustered Data9 Jul 2026
- 2026Order-based Causal Discovery for Multistage Processes4 Jul 2026
- 2026Graphical conditional generative modeling for digital twin modeling15 Jun 2026
12 newest of 198 All 198 (JSON)