A Review and Roadmap of Deep Causal Model from Different Causal Structures and Representations
Not on the map. Why?
Abstract (arXiv)
The fusion of causal models with deep learning introducing increasingly intricate data sets, such as the causal associations within images or between textual components, has surfaced as a focal research area. Nonetheless, the broadening of original causal concepts and theories to such complex, non-statistical data has been met with serious challenges. In response, our study proposes redefinitions of causal data into three distinct categories from the standpoint of causal structure and representation: definite data, semi-definite data, and indefinite data. Definite data chiefly pertains to statistical data used in conventional causal scenarios, while semi-definite data refers to a spectrum of data formats germane to deep learning, including time-series, images, text, and others. Indefinite data is an emergent research sphere inferred from the progression of data forms by us. To comprehensively present these three data paradigms, we elaborate on their formal definitions, differences manifested in datasets, resolution pathways, and development of research. We summarize key tasks and achievements pertaining to definite and semi-definite data from myriad research undertakings, present a roadmap for indefinite data, beginning with its current research conundrums. Lastly, we classify and scrutinize the key datasets presently utilized within these three paradigms.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 107 of its 283 references that are in the map. First posted on arXiv 2 Nov 2023.
Builds on
107 of 283 references.
References · 107
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
- 2020Language Models are Few-Shot Learnerscited by 32,320
- 2022Training language models to follow instructions with human feedbackcited by 15,856
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,072
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,322
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,376
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,281
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,319
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,171
- 2015Variational Inference with Normalizing Flowscited by 2,163
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,805
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,409
38 more
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,334
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,043
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 873
- 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 748
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 736
- 2019Modeling Tabular data using Conditional GANcited by 698
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
- 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 598
- 2017Generative Adversarial Networks: An Overviewcited by 589
- 2017Meta-learners for Estimating Heterogeneous Treatment Effects using Machine Learningcited by 477
- 2021Causal Abstractions of Neural Networkscited by 408
- 2019An Evaluation Dataset for Intent Classification and Out-of-Scope Predictioncited by 381
- 2016Solving General Arithmetic Word Problemscited by 355
- 2019DAG-GNN: DAG Structure Learning with Graph Neural Networkscited by 330
- 2015Recursive Partitioning for Heterogeneous Causal Effectscited by 255
- 2013Causal Discovery with Continuous Additive Noise Modelscited by 253
- 2017Detecting causal associations in large nonlinear time series datasetscited by 242
- 2017Advances in Variational Inferencecited by 236
- 2019Gradient-Based Neural DAG Learningcited by 227
- 2021D'ya like DAGs? A Survey on Structure Learning and Causal Discoverycited by 210
- 2020A Survey on Causal Inferencecited by 202
- 2020DYNOTEARS: Structure Learning from Time-Series Datacited by 199
- 2022Discovering Invariant Rationales for Graph Neural Networkscited by 187
- 2019Understanding Attention and Generalization in Graph Neural Networkscited by 169
- 2017Emotional Chatting Machine: Emotional Conversation Generation with Internal and External Memorycited by 167
- 2019Causal Discovery from Heterogeneous/Nonstationary Data with Independent Changescited by 166
- 2019Causal Discovery with Reinforcement Learningcited by 145
- 2019On the Fairness of Disentangled Representationscited by 144
- 2023Can Large Language Models Infer Causation from Correlation?cited by 143
- 2016Identifying Causal Effects With Proxy Variables of an Unmeasured Confoundercited by 139
- 2020Discovering contemporaneous and lagged causal relations in autocorrelated nonlinear time series datasetscited by 137
- 2017Causal Consistency of Structural Equation Modelscited by 116
- 2020MIME: MIMicking Emotions for Empathetic Response Generationcited by 114
- 2019Unsupervised Learning of Object Keypoints for Perception and Controlcited by 109
- 2018Abstracting Causal Modelscited by 106
- 2019Context-Aware Emotion Recognition Networkscited by 99
- 2019Learning Counterfactual Representations for Estimating Individual Dose-Response Curvescited by 90
- 2013High-dimensional learning of linear causal networks via inverse covariance estimationcited by 86
50 most cited of 107 All 107 (JSON)
Built on by
Citing papers per year: 2024: 1.
1 paper.