IDIAPers @ Causal News Corpus 2022: Extracting Cause-Effect-Signal Triplets via Pre-trained Autoregressive Language Model
Not on the map. Why?
Abstract (arXiv)
In this paper, we describe our shared task submissions for Subtask 2 in CASE-2022, Event Causality Identification with Casual News Corpus. The challenge focused on the automatic detection of all cause-effect-signal spans present in the sentence from news-media. We detect cause-effect-signal spans in a sentence using T5 -- a pre-trained autoregressive language model. We iteratively identify all cause-effect-signal span triplets, always conditioning the prediction of the next triplet on the previously predicted ones. To predict the triplet itself, we consider different causal relationships such as causerightarroweffectrightarrowsignal. Each triplet component is generated via a language model conditioned on the sentence, the previous parts of the current triplet, and previously predicted triplets. Despite training on an extremely small dataset of 160 samples, our approach achieved competitive performance, being placed second in the competition. Furthermore, we show that assuming either causerightarroweffect or effectrightarrowcause order achieves similar results.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 57 references that are in the map. First posted on arXiv 8 Sep 2022.
Builds on
21 of 57 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2015Pointer Networkscited by 882
- 2018Graph Convolutional Networks for Text Classificationcited by 345
- 2021Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyondcited by 177
- 2018Graph Convolution over Pruned Dependency Trees Improves Relation Extractioncited by 146
- 2021A Unified Generative Framework for Various NER Subtaskscited by 141
- 2020CausaLM: Causal Model Explanation Through Counterfactual Language Modelscited by 117
- 2020Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoderscited by 87
- 2020TransOMCS: From Linguistic Graphs to Commonsense Knowledgecited by 52
- 2021R2-D2: A Modular Baseline for Open-Domain Question Answeringcited by 37
9 more
- 2018Challenges of Using Text Classifiers for Causal Inferencecited by 33
- 2020To Test Machine Comprehension, Start by Defining Comprehensioncited by 31
- 2018Adversarial training for multi-context joint entity and relation extractioncited by 29
- 2022The Causal News Corpus: Annotating Causal Relations in Event Sentences from Newscited by 24
- 2014The effect of wording on message propagation: Topic- and author-controlled natural experiments on Twittercited by 21
- 2019Estimating Causal Effects of Tone in Online Debatescited by 19
- 2021Classifying Argumentative Relations Using Logical Mechanisms and Argumentation Schemescited by 17
- 2020Quantifying the Causal Effects of Conversational Tendenciescited by 12
- 2020BUT-FIT at SemEval-2020 Task 5: Automatic detection of counterfactual statements with deep pre-trained language representation modelscited by 3
Built on by
Citing papers per year: 2022: 1.
1 paper.