A Survey on Extraction of Causal Relations from Natural Language Text
Not on the map. Why?
Abstract (arXiv)
As an essential component of human cognition, cause-effect relations appear frequently in text, and curating cause-effect relations from text helps in building causal networks for predictive tasks. Existing causality extraction techniques include knowledge-based, statistical machine learning(ML)-based, and deep learning-based approaches. Each method has its advantages and weaknesses. For example, knowledge-based methods are understandable but require extensive manual domain knowledge and have poor cross-domain applicability. Statistical machine learning methods are more automated because of natural language processing (NLP) toolkits. However, feature engineering is labor-intensive, and toolkits may lead to error propagation. In the past few years, deep learning techniques attract substantial attention from NLP researchers because of its' powerful representation learning ability and the rapid increase in computational resources. Their limitations include high computational costs and a lack of adequate annotated training data. In this paper, we conduct a comprehensive survey of causality extraction. We initially introduce primary forms existing in the causality extraction: explicit intra-sentential causality, implicit causality, and inter-sentential causality. Next, we list benchmark datasets and modeling assessment methods for causal relation extraction. Then, we present a structured overview of the three techniques with their representative systems. Lastly, we highlight existing open challenges with their potential directions.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 27 of its 123 references that are in the map. First posted on arXiv 16 Jan 2021.
Builds on
27 of 123 references.
References · 27
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2018Deep contextualized word representationscited by 2,285
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
- 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 487
- 2018Graph Convolutional Networks for Text Classificationcited by 345
- 2019Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasetscited by 298
- 2019DocRED: A Large-Scale Document-Level Relation Extraction Datasetcited by 239
- 2018Graph Convolution over Pruned Dependency Trees Improves Relation Extractioncited by 146
- 2020Double Graph Based Reasoning for Document-level Relation Extractioncited by 87
- 2020Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoderscited by 87
15 more
- 2019Attention Guided Graph Convolutional Networks for Relation Extractioncited by 82
- 2019Connecting the Dots: Document-level Neural Relation Extraction with Edge-oriented Graphscited by 71
- 2019SemEval-2010 Task 8: Multi-Way Classification of Semantic Relations Between Pairs of Nominalscited by 63
- 2018Joint entity recognition and relation extraction as a multi-head selection problemcited by 59
- 2020Global-to-Local Neural Networks for Document-Level Relation Extractioncited by 43
- 2015Classifying Relations via Long Short Term Memory Networks along Shortest Dependency Pathcited by 35
- 2018Adversarial training for multi-context joint entity and relation extractioncited by 29
- 2019Causality Extraction based on Self-Attentive BiLSTM-CRF with Transferred Embeddingscited by 25
- 2019Improving Relation Extraction by Pre-trained Language Representationscited by 24
- 2019Extracting Multiple-Relations in One-Pass with Pre-Trained Transformerscited by 19
- 2016Automatic Extraction of Causal Relations from Natural Language Texts: A Comprehensive Surveycited by 16
- 2019A Walk-based Model on Entity Graphs for Relation Extractioncited by 8
- 2019Transfer Learning for Causal Sentence Detectioncited by 4
- 2020Relabel the Noise: Joint Extraction of Entities and Relations via Cooperative Multiagentscited by 3
- 2019A Multi-level Neural Network for Implicit Causality Detection in Web Textscited by 1
Built on by
Citing papers per year: 2021: 4; 2022: 3; 2023: 3; 2024: 9; 2025: 2; 2026: 4.
25 papers.
Sort:
By area:
- 2024A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directionscited by 34
- 2022The Causal News Corpus: Annotating Causal Relations in Event Sentences from Newscited by 24
- 2024A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluationscited by 16
- 2022UniCausal: Unified Benchmark and Repository for Causal Text Miningcited by 9
- 2025Large Causal Models from Large Language Modelscited by 8
- 2024Leveraging Prompt-Based Large Language Models: Predicting Pandemic Health Decisions and Outcomes Through Social Media Languagecited by 6
- 2024A Survey of Event Causality Identification: Taxonomy, Challenges, Assessment, and Prospectscited by 6
- 2021HeadlineCause: A Dataset of News Headlines for Detecting Causalitiescited by 5
- 2023An Explainable AI Approach to Large Language Model Assisted Causal Model Auditing and Developmentcited by 5
- 2022Event Causality Identification with Causal News Corpus -- Shared Task 3, CASE 2022cited by 3
- 2024CausalChat: Interactive Causal Model Development and Refinement Using Large Language Modelscited by 3
- 2026PROMETHEUS: Automating Deep Causal Research Integrating Text, Data and Modelscited by 3
13 more
- 2023Causal Intersectionality and Dual Form of Gradient Descent for Multimodal Analysis: a Case Study on Hateful Memescited by 2
- 2024Is ChatGPT the Future of Causal Text Mining? A Comprehensive Evaluation and Analysiscited by 2
- 2021Fine-Grained Causality Extraction From Natural Language Requirements Using Recursive Neural Tensor Networkscited by 1
- 2021CATE: CAusality Tree Extractor from Natural Language Requirementscited by 1
- 2021Identifying causal relations in tweets using deep learning: Use case on diabetes-related tweets from 2017-2021cited by 1
- 2023Applying BioBERT to Extract Germline Gene-Disease Associations for Building a Knowledge Graph from the Biomedical Literaturecited by 1
- 2024Causality Extraction from Nuclear Licensee Event Reports Using a Hybrid Frameworkcited by 1
- 2026Causality Elicitation from Large Language Modelscited by 1
- 2026Odyssey: Constructing Verifiable Local Truth-Preserving Foundation Modelscited by 1
- 2024Increasing the Accessibility of Causal Domain Knowledge via Causal Information Extraction Methods: A Case Study in the Semiconductor Manufacturing Industrycited by 0
- 2024Evaluating Large Language Models for Causal Modelingcited by 0
- 2025Causal Cartographer: From Mapping to Reasoning Over Counterfactual Worldscited by 0
- 2026CSQL: Mapping Documents into Causal Databasescited by 0
- 2026Odyssey: Constructing Verifiable Local Truth-Preserving Foundation Models25 Jun 2026
- 2026PROMETHEUS: Automating Deep Causal Research Integrating Text, Data and Models13 May 2026
- 2026Causality Elicitation from Large Language Models4 Mar 2026
- 2026CSQL: Mapping Documents into Causal Databases13 Jan 2026
- 2025Large Causal Models from Large Language Models8 Dec 2025
- 2025Causal Cartographer: From Mapping to Reasoning Over Counterfactual Worlds20 May 2025
- 2024Evaluating Large Language Models for Causal Modeling24 Nov 2024
- 2024A Survey of Event Causality Identification: Taxonomy, Challenges, Assessment, and Prospects15 Nov 2024
- 2024Increasing the Accessibility of Causal Domain Knowledge via Causal Information Extraction Methods: A Case Study in the Semiconductor Manufacturing Industry15 Nov 2024
- 2024CausalChat: Interactive Causal Model Development and Refinement Using Large Language Models18 Oct 2024
- 2024A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluations14 Jun 2024
- 2024A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directions6 Jun 2024
13 more
- 2024Causality Extraction from Nuclear Licensee Event Reports Using a Hybrid Framework8 Apr 2024
- 2024Leveraging Prompt-Based Large Language Models: Predicting Pandemic Health Decisions and Outcomes Through Social Media Language1 Mar 2024
- 2024Is ChatGPT the Future of Causal Text Mining? A Comprehensive Evaluation and Analysis22 Feb 2024
- 2023An Explainable AI Approach to Large Language Model Assisted Causal Model Auditing and Development23 Dec 2023
- 2023Applying BioBERT to Extract Germline Gene-Disease Associations for Building a Knowledge Graph from the Biomedical Literature11 Sep 2023
- 2023Causal Intersectionality and Dual Form of Gradient Descent for Multimodal Analysis: a Case Study on Hateful Memes19 Aug 2023
- 2022Event Causality Identification with Causal News Corpus -- Shared Task 3, CASE 202222 Nov 2022
- 2022UniCausal: Unified Benchmark and Repository for Causal Text Mining19 Aug 2022
- 2022The Causal News Corpus: Annotating Causal Relations in Event Sentences from News25 Apr 2022
- 2021Identifying causal relations in tweets using deep learning: Use case on diabetes-related tweets from 2017-20211 Nov 2021
- 2021HeadlineCause: A Dataset of News Headlines for Detecting Causalities28 Aug 2021
- 2021CATE: CAusality Tree Extractor from Natural Language Requirements21 Jul 2021
- 2021Fine-Grained Causality Extraction From Natural Language Requirements Using Recursive Neural Tensor Networks21 Jul 2021
- 2024A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directionscited by 34
- 2022The Causal News Corpus: Annotating Causal Relations in Event Sentences from Newscited by 24
- 2024A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluationscited by 16
- 2022UniCausal: Unified Benchmark and Repository for Causal Text Miningcited by 9
- 2025Large Causal Models from Large Language Modelscited by 8
- 2024A Survey of Event Causality Identification: Taxonomy, Challenges, Assessment, and Prospectscited by 6
- 2021HeadlineCause: A Dataset of News Headlines for Detecting Causalitiescited by 5
- 2023An Explainable AI Approach to Large Language Model Assisted Causal Model Auditing and Developmentcited by 5
- 2022Event Causality Identification with Causal News Corpus -- Shared Task 3, CASE 2022cited by 3
- 2024CausalChat: Interactive Causal Model Development and Refinement Using Large Language Modelscited by 3
- 2023Causal Intersectionality and Dual Form of Gradient Descent for Multimodal Analysis: a Case Study on Hateful Memescited by 2
- 2024Is ChatGPT the Future of Causal Text Mining? A Comprehensive Evaluation and Analysiscited by 2
12 most cited of 22 All 22 (JSON)
- 2026Odyssey: Constructing Verifiable Local Truth-Preserving Foundation Models25 Jun 2026
- 2026Causality Elicitation from Large Language Models4 Mar 2026
- 2026CSQL: Mapping Documents into Causal Databases13 Jan 2026
- 2025Large Causal Models from Large Language Models8 Dec 2025
- 2024Evaluating Large Language Models for Causal Modeling24 Nov 2024
- 2024A Survey of Event Causality Identification: Taxonomy, Challenges, Assessment, and Prospects15 Nov 2024
- 2024Increasing the Accessibility of Causal Domain Knowledge via Causal Information Extraction Methods: A Case Study in the Semiconductor Manufacturing Industry15 Nov 2024
- 2024CausalChat: Interactive Causal Model Development and Refinement Using Large Language Models18 Oct 2024
- 2024A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluations14 Jun 2024
- 2024A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directions6 Jun 2024
- 2024Causality Extraction from Nuclear Licensee Event Reports Using a Hybrid Framework8 Apr 2024
- 2024Is ChatGPT the Future of Causal Text Mining? A Comprehensive Evaluation and Analysis22 Feb 2024
12 newest of 22 All 22 (JSON)