mlsanityData to 13 Oct 2026

A Review and Roadmap of Deep Causal Model from Different Causal Structures and Representations

arXiv 2311.00923 ↗First posted 2 Nov 2023cs.LG stat.MEcited by 1

Not on the map. Why?

Abstract (arXiv)

The fusion of causal models with deep learning introducing increasingly intricate data sets, such as the causal associations within images or between textual components, has surfaced as a focal research area. Nonetheless, the broadening of original causal concepts and theories to such complex, non-statistical data has been met with serious challenges. In response, our study proposes redefinitions of causal data into three distinct categories from the standpoint of causal structure and representation: definite data, semi-definite data, and indefinite data. Definite data chiefly pertains to statistical data used in conventional causal scenarios, while semi-definite data refers to a spectrum of data formats germane to deep learning, including time-series, images, text, and others. Indefinite data is an emergent research sphere inferred from the progression of data forms by us. To comprehensively present these three data paradigms, we elaborate on their formal definitions, differences manifested in datasets, resolution pathways, and development of research. We summarize key tasks and achievements pertaining to definite and semi-definite data from myriad research undertakings, present a roadmap for indefinite data, beginning with its current research conundrums. Lastly, we classify and scrutinize the key datasets presently utilized within these three paradigms.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 107 of its 283 references that are in the map. First posted on arXiv 2 Nov 2023.

Builds on

107 of 283 references.

References · 107

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
  2. 2020Language Models are Few-Shot Learnerscited by 32,320
  3. 2022Training language models to follow instructions with human feedbackcited by 15,856
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,072
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,322
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,376
  7. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,281
  8. 2015Character-level Convolutional Networks for Text Classificationcited by 2,319
  9. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,171
  10. 2015Variational Inference with Normalizing Flowscited by 2,163
  11. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,805
  12. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,409
38 more
  1. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,334
  2. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,043
  3. 2020Learning to Simulate Complex Physics with Graph Networkscited by 873
  4. 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 748
  5. 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 736
  6. 2019Modeling Tabular data using Conditional GANcited by 698
  7. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
  8. 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 598
  9. 2017Generative Adversarial Networks: An Overviewcited by 589
  10. 2017Meta-learners for Estimating Heterogeneous Treatment Effects using Machine Learningcited by 477
  11. 2021Causal Abstractions of Neural Networkscited by 408
  12. 2019An Evaluation Dataset for Intent Classification and Out-of-Scope Predictioncited by 381
  13. 2016Solving General Arithmetic Word Problemscited by 355
  14. 2019DAG-GNN: DAG Structure Learning with Graph Neural Networkscited by 330
  15. 2015Recursive Partitioning for Heterogeneous Causal Effectscited by 255
  16. 2013Causal Discovery with Continuous Additive Noise Modelscited by 253
  17. 2017Detecting causal associations in large nonlinear time series datasetscited by 242
  18. 2017Advances in Variational Inferencecited by 236
  19. 2019Gradient-Based Neural DAG Learningcited by 227
  20. 2021D'ya like DAGs? A Survey on Structure Learning and Causal Discoverycited by 210
  21. 2020A Survey on Causal Inferencecited by 202
  22. 2020DYNOTEARS: Structure Learning from Time-Series Datacited by 199
  23. 2022Discovering Invariant Rationales for Graph Neural Networkscited by 187
  24. 2019Understanding Attention and Generalization in Graph Neural Networkscited by 169
  25. 2017Emotional Chatting Machine: Emotional Conversation Generation with Internal and External Memorycited by 167
  26. 2019Causal Discovery from Heterogeneous/Nonstationary Data with Independent Changescited by 166
  27. 2019Causal Discovery with Reinforcement Learningcited by 145
  28. 2019On the Fairness of Disentangled Representationscited by 144
  29. 2023Can Large Language Models Infer Causation from Correlation?cited by 143
  30. 2016Identifying Causal Effects With Proxy Variables of an Unmeasured Confoundercited by 139
  31. 2020Discovering contemporaneous and lagged causal relations in autocorrelated nonlinear time series datasetscited by 137
  32. 2017Causal Consistency of Structural Equation Modelscited by 116
  33. 2020MIME: MIMicking Emotions for Empathetic Response Generationcited by 114
  34. 2019Unsupervised Learning of Object Keypoints for Perception and Controlcited by 109
  35. 2018Abstracting Causal Modelscited by 106
  36. 2019Context-Aware Emotion Recognition Networkscited by 99
  37. 2019Learning Counterfactual Representations for Estimating Individual Dose-Response Curvescited by 90
  38. 2013High-dimensional learning of linear causal networks via inverse covariance estimationcited by 86

50 most cited of 107 All 107 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.