mlsanityData to 7 Oct 2026

Large Causal Models for Temporal Causal Discovery

arXiv 2602.18662 ↗First posted 20 Feb 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Causal discovery for both cross-sectional and temporal data has traditionally followed a dataset-specific paradigm, where a new model is fitted for each individual dataset. Such an approach limits the potential of multi-dataset pretraining. The concept of large causal models (LCMs) envisions a class of pre-trained neural architectures specifically designed for temporal causal discovery. Prior approaches are constrained to small variable counts, degrade with larger inputs, and rely heavily on synthetic data, limiting generalization. We propose a principled framework for LCMs, combining diverse synthetic generators with realistic time-series datasets, allowing learning at scale. Extensive experiments on synthetic, semi-synthetic and realistic benchmarks show that LCMs scale effectively to higher variable counts and deeper architectures while maintaining strong performance. Trained models achieve competitive or superior accuracy compared to classical and neural baselines, particularly in out-of-distribution settings, while enabling fast, single-pass inference. Results demonstrate LCMs as a promising foundation-model paradigm for temporal causal discovery. Experiments and model weights are available at https://github.com/kougioulis/LCM/.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 30 of its 56 references that are in the map. First posted on arXiv 20 Feb 2026.

Builds on

30 of 56 references.

References · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  6. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  7. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  8. 2016Density estimation using Real NVPcited by 2,029
  9. 2017Decoupled Weight Decay Regularizationcited by 1,722
  10. 2023A decoder-only foundation model for time-series forecastingcited by 650
  11. 2019Neural Spline Flowscited by 590
  12. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
18 more
  1. 2020Differentiable Causal Discovery from Interventional Datacited by 218
  2. 2020DYNOTEARS: Structure Learning from Time-Series Datacited by 198
  3. 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 198
  4. 2020Amortized Causal Discovery: Learning to Infer Causal Graphs from Time-Series Datacited by 99
  5. 2022Deep End-to-end Causal Inferencecited by 93
  6. 2022Amortized Inference for Causal Structure Learningcited by 89
  7. 2024Timer-XL: Long-Context Transformers for Unified Time Series Forecastingcited by 83
  8. 2022Learning to Induce Causal Structurecited by 68
  9. 2018Structural Agnostic Modeling: Adversarial Learning of Causal Graphscited by 48
  10. 2023CausalTime: Realistically Generated Time-series for Benchmarking of Causal Discoverycited by 35
  11. 2017Causal Generative Neural Networkscited by 24
  12. 2021Data Generating Process to Evaluate Causal Discovery Techniques for Time Series Datacited by 22
  13. 2024Sample, estimate, aggregate: A recipe for causal discovery foundation modelscited by 19
  14. 2023Towards Causal Foundation Model: on Duality between Causal Inference and Attentioncited by 17
  15. 2023Causal Reasoning in the Presence of Latent Confounders via Neural ADMG Learningcited by 15
  16. 2024Embracing the black box: Heading towards foundation models for causal discovery from time series datacited by 5
  17. 2025Transformers and Their Roles as Time Series Foundation Modelscited by 3
  18. 2025Adversarial Causal Tuning for Realistic Time-series Generationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.