mlsanityData to 14 Oct 2026

Arrow: A Foundation Model for Causal Discovery

arXiv 2605.07204 ↗First posted 8 May 2026cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

We introduce Arrow, a foundation model for zero-shot causal discovery on observational tabular data. Arrow factorizes a directed acyclic graph into an undirected skeleton and a topological order, guaranteeing acyclicity by construction. Given a new dataset, it uses a transformer-based architecture to contextualize variables within and across observations, then predicts skeleton edge probabilities and node order scores that together define a graph. Arrow is trained in a supervised fashion on synthetic datasets with ground-truth graphs, using an end-to-end differentiable directed edge composite likelihood induced by the skeleton-order factorization. The training distribution spans diverse graph families, functional forms, noise models, and dataset shapes. Across in- and out-of-distribution synthetic, semi-synthetic, and real datasets, Arrow matches or outperforms existing causal discovery methods at substantially lower inference cost than competitive alternatives. Our results demonstrate that large-scale pretraining on diverse synthetic data can yield zero-shot causal discovery models that are fast, accurate, and reusable on new datasets.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 35 of its 55 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

35 of 55 references.

References · 35

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Scaling Laws for Neural Language Modelscited by 6,586
  3. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  4. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  5. 2016Optimization Methods for Large-Scale Machine Learningcited by 1,150
  6. 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 752
  7. 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 674
  8. 2019The frontier of simulation-based inferencecited by 502
  9. 2021Transformers Can Do Bayesian Inferencecited by 360
  10. 2019DAG-GNN: DAG Structure Learning with Graph Neural Networkscited by 331
  11. 2025TabICL: A Tabular Foundation Model for In-Context Learning on Large Datacited by 289
  12. 2019Learning Sparse Nonparametric DAGscited by 207
23 more
  1. 2020On the Role of Sparsity and DAG Constraints for Learning Linear DAGscited by 191
  2. 2022DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity Characterizationcited by 140
  3. 2021DiBS: Differentiable Bayesian Structure Learningcited by 106
  4. 2018Janossy Pooling: Learning Deep Permutation-Invariant Functions for Variable-Size Inputscited by 98
  5. 2022Amortized Inference for Causal Structure Learningcited by 90
  6. 2022Learning to Induce Causal Structurecited by 68
  7. 2022Differentiable DAG Samplingcited by 47
  8. 2023Fast Scalable and Accurate Discovery of DAGs Using the Best Order Score Search and Grow-Shrink Treescited by 38
  9. 2023Stable Differentiable Causal Discoverycited by 31
  10. 2024A Meta-Learning Approach to Bayesian Causal Discoverycited by 22
  11. 2024Sample, estimate, aggregate: A recipe for causal discovery foundation modelscited by 21
  12. 2024Standardizing Structural Causal Modelscited by 17
  13. 2022Causal discovery for observational sciences using supervised machine learningcited by 10
  14. 2025Unitless Unrestricted Markov-Consistent SCM Generation: Better Benchmark Datasets for Causal Discoverycited by 8
  15. 2024Scalable and Flexible Causal Discovery with an Efficient Test for Adjacencycited by 6
  16. 2026CauScale: Neural Causal Discovery at Scalecited by 6
  17. 2025Does TabPFN Understand Causal Structures?cited by 5
  18. 2021Causal Discovery in Linear Structural Causal Models with Deterministic Relationscited by 4
  19. 2024Permutation-based Inference for Variational Learning of Directed Acyclic Graphscited by 4
  20. 2024ProDAG: Projected Variational Inference for Directed Acyclic Graphscited by 4
  21. 2025Learning Causal Graphs at Scale: A Foundation Model Approachcited by 4
  22. 2026A Knowledge-Informed Pretrained Model for Causal Discoverycited by 2
  23. 2025Causal Discovery via Bayesian Optimizationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.