mlsanityData to 7 Oct 2026

A Survey on Extraction of Causal Relations from Natural Language Text

arXiv 2101.06426 ↗First posted 16 Jan 2021cs.IR cs.CLcited by 25

Not on the map. Why?

Abstract (arXiv)

As an essential component of human cognition, cause-effect relations appear frequently in text, and curating cause-effect relations from text helps in building causal networks for predictive tasks. Existing causality extraction techniques include knowledge-based, statistical machine learning(ML)-based, and deep learning-based approaches. Each method has its advantages and weaknesses. For example, knowledge-based methods are understandable but require extensive manual domain knowledge and have poor cross-domain applicability. Statistical machine learning methods are more automated because of natural language processing (NLP) toolkits. However, feature engineering is labor-intensive, and toolkits may lead to error propagation. In the past few years, deep learning techniques attract substantial attention from NLP researchers because of its' powerful representation learning ability and the rapid increase in computational resources. Their limitations include high computational costs and a lack of adequate annotated training data. In this paper, we conduct a comprehensive survey of causality extraction. We initially introduce primary forms existing in the causality extraction: explicit intra-sentential causality, implicit causality, and inter-sentential causality. Next, we list benchmark datasets and modeling assessment methods for causal relation extraction. Then, we present a structured overview of the three techniques with their representative systems. Lastly, we highlight existing open challenges with their potential directions.

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 27 of its 123 references that are in the map. First posted on arXiv 16 Jan 2021.

Builds on

27 of 123 references.

References · 27

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2018Deep contextualized word representationscited by 2,285
  3. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  4. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  5. 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
  6. 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 487
  7. 2018Graph Convolutional Networks for Text Classificationcited by 345
  8. 2019Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasetscited by 298
  9. 2019DocRED: A Large-Scale Document-Level Relation Extraction Datasetcited by 239
  10. 2018Graph Convolution over Pruned Dependency Trees Improves Relation Extractioncited by 146
  11. 2020Double Graph Based Reasoning for Document-level Relation Extractioncited by 87
  12. 2020Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoderscited by 87
15 more
  1. 2019Attention Guided Graph Convolutional Networks for Relation Extractioncited by 82
  2. 2019Connecting the Dots: Document-level Neural Relation Extraction with Edge-oriented Graphscited by 71
  3. 2019SemEval-2010 Task 8: Multi-Way Classification of Semantic Relations Between Pairs of Nominalscited by 63
  4. 2018Joint entity recognition and relation extraction as a multi-head selection problemcited by 59
  5. 2020Global-to-Local Neural Networks for Document-Level Relation Extractioncited by 43
  6. 2015Classifying Relations via Long Short Term Memory Networks along Shortest Dependency Pathcited by 35
  7. 2018Adversarial training for multi-context joint entity and relation extractioncited by 29
  8. 2019Causality Extraction based on Self-Attentive BiLSTM-CRF with Transferred Embeddingscited by 25
  9. 2019Improving Relation Extraction by Pre-trained Language Representationscited by 24
  10. 2019Extracting Multiple-Relations in One-Pass with Pre-Trained Transformerscited by 19
  11. 2016Automatic Extraction of Causal Relations from Natural Language Texts: A Comprehensive Surveycited by 16
  12. 2019A Walk-based Model on Entity Graphs for Relation Extractioncited by 8
  13. 2019Transfer Learning for Causal Sentence Detectioncited by 4
  14. 2020Relabel the Noise: Joint Extraction of Entities and Relations via Cooperative Multiagentscited by 3
  15. 2019A Multi-level Neural Network for Implicit Causality Detection in Web Textscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 3; 2023: 3; 2024: 9; 2025: 2; 2026: 4.

25 papers.

Sort:

By area:

  1. 2024A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directionscited by 34
  2. 2022The Causal News Corpus: Annotating Causal Relations in Event Sentences from Newscited by 24
  3. 2024A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluationscited by 16
  4. 2022UniCausal: Unified Benchmark and Repository for Causal Text Miningcited by 9
  5. 2025Large Causal Models from Large Language Modelscited by 8
  6. 2024Leveraging Prompt-Based Large Language Models: Predicting Pandemic Health Decisions and Outcomes Through Social Media Languagecited by 6
  7. 2024A Survey of Event Causality Identification: Taxonomy, Challenges, Assessment, and Prospectscited by 6
  8. 2021HeadlineCause: A Dataset of News Headlines for Detecting Causalitiescited by 5
  9. 2023An Explainable AI Approach to Large Language Model Assisted Causal Model Auditing and Developmentcited by 5
  10. 2022Event Causality Identification with Causal News Corpus -- Shared Task 3, CASE 2022cited by 3
  11. 2024CausalChat: Interactive Causal Model Development and Refinement Using Large Language Modelscited by 3
  12. 2026PROMETHEUS: Automating Deep Causal Research Integrating Text, Data and Modelscited by 3
13 more
  1. 2023Causal Intersectionality and Dual Form of Gradient Descent for Multimodal Analysis: a Case Study on Hateful Memescited by 2
  2. 2024Is ChatGPT the Future of Causal Text Mining? A Comprehensive Evaluation and Analysiscited by 2
  3. 2021Fine-Grained Causality Extraction From Natural Language Requirements Using Recursive Neural Tensor Networkscited by 1
  4. 2021CATE: CAusality Tree Extractor from Natural Language Requirementscited by 1
  5. 2021Identifying causal relations in tweets using deep learning: Use case on diabetes-related tweets from 2017-2021cited by 1
  6. 2023Applying BioBERT to Extract Germline Gene-Disease Associations for Building a Knowledge Graph from the Biomedical Literaturecited by 1
  7. 2024Causality Extraction from Nuclear Licensee Event Reports Using a Hybrid Frameworkcited by 1
  8. 2026Causality Elicitation from Large Language Modelscited by 1
  9. 2026Odyssey: Constructing Verifiable Local Truth-Preserving Foundation Modelscited by 1
  10. 2024Increasing the Accessibility of Causal Domain Knowledge via Causal Information Extraction Methods: A Case Study in the Semiconductor Manufacturing Industrycited by 0
  11. 2024Evaluating Large Language Models for Causal Modelingcited by 0
  12. 2025Causal Cartographer: From Mapping to Reasoning Over Counterfactual Worldscited by 0
  13. 2026CSQL: Mapping Documents into Causal Databasescited by 0