Arrow: A Foundation Model for Causal Discovery
Not on the map. Why?
Abstract (arXiv)
We introduce Arrow, a foundation model for zero-shot causal discovery on observational tabular data. Arrow factorizes a directed acyclic graph into an undirected skeleton and a topological order, guaranteeing acyclicity by construction. Given a new dataset, it uses a transformer-based architecture to contextualize variables within and across observations, then predicts skeleton edge probabilities and node order scores that together define a graph. Arrow is trained in a supervised fashion on synthetic datasets with ground-truth graphs, using an end-to-end differentiable directed edge composite likelihood induced by the skeleton-order factorization. The training distribution spans diverse graph families, functional forms, noise models, and dataset shapes. Across in- and out-of-distribution synthetic, semi-synthetic, and real datasets, Arrow matches or outperforms existing causal discovery methods at substantially lower inference cost than competitive alternatives. Our results demonstrate that large-scale pretraining on diverse synthetic data can yield zero-shot causal discovery models that are fast, accurate, and reusable on new datasets.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 35 of its 55 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
35 of 55 references.
References · 35
- 2017Attention Is All You Needcited by 60,361
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2016Optimization Methods for Large-Scale Machine Learningcited by 1,150
- 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 752
- 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 674
- 2019The frontier of simulation-based inferencecited by 502
- 2021Transformers Can Do Bayesian Inferencecited by 360
- 2019DAG-GNN: DAG Structure Learning with Graph Neural Networkscited by 331
- 2025TabICL: A Tabular Foundation Model for In-Context Learning on Large Datacited by 289
- 2019Learning Sparse Nonparametric DAGscited by 207
23 more
- 2020On the Role of Sparsity and DAG Constraints for Learning Linear DAGscited by 191
- 2022DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity Characterizationcited by 140
- 2021DiBS: Differentiable Bayesian Structure Learningcited by 106
- 2018Janossy Pooling: Learning Deep Permutation-Invariant Functions for Variable-Size Inputscited by 98
- 2022Amortized Inference for Causal Structure Learningcited by 90
- 2022Learning to Induce Causal Structurecited by 68
- 2022Differentiable DAG Samplingcited by 47
- 2023Fast Scalable and Accurate Discovery of DAGs Using the Best Order Score Search and Grow-Shrink Treescited by 38
- 2023Stable Differentiable Causal Discoverycited by 31
- 2024A Meta-Learning Approach to Bayesian Causal Discoverycited by 22
- 2024Sample, estimate, aggregate: A recipe for causal discovery foundation modelscited by 21
- 2024Standardizing Structural Causal Modelscited by 17
- 2022Causal discovery for observational sciences using supervised machine learningcited by 10
- 2025Unitless Unrestricted Markov-Consistent SCM Generation: Better Benchmark Datasets for Causal Discoverycited by 8
- 2024Scalable and Flexible Causal Discovery with an Efficient Test for Adjacencycited by 6
- 2026CauScale: Neural Causal Discovery at Scalecited by 6
- 2025Does TabPFN Understand Causal Structures?cited by 5
- 2021Causal Discovery in Linear Structural Causal Models with Deterministic Relationscited by 4
- 2024Permutation-based Inference for Variational Learning of Directed Acyclic Graphscited by 4
- 2024ProDAG: Projected Variational Inference for Directed Acyclic Graphscited by 4
- 2025Learning Causal Graphs at Scale: A Foundation Model Approachcited by 4
- 2026A Knowledge-Informed Pretrained Model for Causal Discoverycited by 2
- 2025Causal Discovery via Bayesian Optimizationcited by 1
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026TabCausal: Pretraining Across Causal Environments for Tabular Causal Discoverycited by 4
- 2026CDFM: Towards a General-Purpose Causal Discovery Foundation Modelcited by 2
- 2026Causal Foundation Modelscited by 1
- 2026CausalArena: Benchmarking Causal Discovery in the Foundation Model Eracited by 0
- 2026Demistifying Data and Simulator Assumptions in Supervised Causal Discoverycited by 0
- 2026Demistifying Data and Simulator Assumptions in Supervised Causal Discovery29 Sep 2026
- 2026CausalArena: Benchmarking Causal Discovery in the Foundation Model Era10 Sep 2026
- 2026Causal Foundation Models2 Sep 2026
- 2026CDFM: Towards a General-Purpose Causal Discovery Foundation Model13 Jul 2026
- 2026TabCausal: Pretraining Across Causal Environments for Tabular Causal Discovery29 May 2026