mlsanityData to 7 Oct 2026

Predicting Directionality in Causal Relations in Text

arXiv 2103.13606 ↗First posted 25 Mar 2021cs.CL cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

In this work, we test the performance of two bidirectional transformer-based language models, BERT and SpanBERT, on predicting directionality in causal pairs in the textual content. Our preliminary results show that predicting direction for inter-sentence and implicit causal relations is more challenging. And, SpanBERT performs better than BERT on causal samples with longer span length. We also introduce CREST which is a framework for unifying a collection of scattered datasets of causal relations.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 8 of its 41 references that are in the map. First posted on arXiv 25 Mar 2021.

Builds on

8 of 41 references.

References · 8

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  5. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  6. 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 832
  7. 2020GLUCOSE: GeneraLized and COntextualized Story Explanationscited by 85
  8. 2020How Far are We from Effective Context Modeling? An Exploratory Study on Semantic Parsing in Contextcited by 53

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 0; 2023: 1; 2024: 2; 2025: 2; 2026: 1.

8 papers.

  1. 2021Causal Direction of Data Collection Matters: Implications of Causal and Anticausal Learning for NLPcited by 21
  2. 2024Discovering and Reasoning of Causality in the Hidden World with Large Language Modelscited by 10
  3. 2021HeadlineCause: A Dataset of News Headlines for Detecting Causalitiescited by 5
  4. 2024Causality from Bottom to Top: A Surveycited by 5
  5. 2025ExpliCa: Evaluating Explicit Causal Reasoning in Large Language Modelscited by 3
  6. 2023A Cross-Domain Evaluation of Approaches for Causal Knowledge Extractioncited by 1
  7. 2025Investigating Counterclaims in Causality Extraction from Textcited by 1
  8. 2026Fast and Generalizable NeRF Architecture Selection for Satellite Scene Reconstructioncited by 0