Event Causality Is Key to Computational Story Understanding
Not on the map. Why?
Abstract (arXiv)
Cognitive science and symbolic AI research suggest that event causality provides vital information for story understanding. However, machine learning systems for story understanding rarely employ event causality, partially due to the lack of methods that reliably identify open-world causal event relations. Leveraging recent progress in large language models, we present the first method for event causality identification that leads to material improvements in computational story understanding. Our technique sets a new state of the art on the COPES dataset (Wang et al., 2023) for causal event relation identification. Further, in the downstream story quality evaluation task, the identified causal relations lead to 3.6-16.6% relative improvement on correlation with human ratings. In the multimodal story video-text alignment task, we attain 4.1-10.9% increase on Clip Accuracy and 4.2-13.5% increase on Sentence IoU. The findings indicate substantial untapped potential for event causality in computational story understanding. The codebase is at https://github.com/insundaycathy/Event-Causality-Extraction.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 41 of its 97 references that are in the map. First posted on arXiv 16 Nov 2023.
Builds on
41 of 97 references.
References · 41
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
- 2018Hierarchical Neural Story Generationcited by 1,182
- 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 729
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
- 2023Is ChatGPT a Good NLG Evaluator? A Preliminary Studycited by 420
- 2020UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generationcited by 258
29 more
- 2018Long-Term Feature Banks for Detailed Video Understandingcited by 239
- 2022Re3: Generating Longer Stories With Recursive Reprompting and Revisioncited by 193
- 2019Heterogeneous Memory Enhanced Multimodal Attention Model for Video Question Answeringcited by 146
- 2020A Knowledge-Enhanced Pretraining Model for Commonsense Story Generationcited by 116
- 2020GLUCOSE: GeneraLized and COntextualized Story Explanationscited by 85
- 2022Fantastic Questions and Where to Find Them: FairytaleQA -- An Authentic Dataset for Narrative Comprehensioncited by 79
- 2022Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generationcited by 73
- 2023Is ChatGPT a Good Causal Reasoner? A Comprehensive Evaluationcited by 69
- 2022MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extractioncited by 65
- 2014Narrative Planning: Balancing Plot and Charactercited by 61
- 2021OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation Metricscited by 61
- 2020UNION: An Unreferenced Metric for Evaluating Open-ended Story Generationcited by 60
- 2023The Next Chapter: A Study of Large Language Models in Storytellingcited by 58
- 2019Better Automatic Evaluation of Open-Domain Dialogue Systems with Contextualized Embeddingscited by 52
- 2020Automated Storytelling via Causal, Commonsense Plot Orderingcited by 38
- 2020Pre-training Is (Almost) All You Need: An Application to Commonsense Reasoningcited by 33
- 2023Visual Writing Prompts: Character-Grounded Story Generation with Curated Image Sequencescited by 31
- 2022CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generationcited by 29
- 2020Causal BERT : Language models for causality detection between events expressed in textcited by 22
- 2023COLA: Contextualized Commonsense Causal Reasoning from the Causal Inference Perspectivecited by 22
- 2023The Magic of IF: Investigating Causal Reasoning Abilities in Large Language Models of Codecited by 21
- 2022TVShowGuess: Character Comprehension in Stories as Speaker Guessingcited by 17
- 2022ROCK: Causal Inference Principles for Reasoning about Commonsense Causalitycited by 16
- 2018A Neural Multi-sequence Alignment TeCHnique (NeuMATCH)cited by 13
- 2022Synopses of Movie Narratives: a Video-Language Dataset for Story Understandingcited by 8
- 2022EvEntS ReaLM: Event Reasoning of Entity States via Language Modelscited by 7
- 2022CoRRPUS: Code-based Structured Prompting for Neurosymbolic Story Understandingcited by 7
- 2022rmC small IS2: A Simplified Commonsense Inference Evaluation for Story Prosecited by 4
- 2023Adversarial Transformer Language Models for Contextual Commonsense Inferencecited by 2
Built on by
Citing papers per year: 2024: 2; 2025: 5; 2026: 4.
11 papers.
- 2025ACCESS : A Benchmark for Abstract Causal Event Discovery and Reasoningcited by 3
- 2025Q2E: Query-to-Event Decomposition for Zero-Shot Multilingual Text-to-Video Retrievalcited by 3
- 2025A Multi-Level Benchmark for Causal Language Understanding in Social Media Discoursecited by 3
- 2026Narrative Theory-Driven LLM Methods for Automatic Story Generation and Understanding: A Surveycited by 3
- 2024Multilingual Synopses of Movie Narratives: A Dataset for Vision-Language Story Understandingcited by 2
- 2025Causal Graph based Event Reasoning using Semantic Relation Expertscited by 2
- 2024Causal Micro-Narrativescited by 1
- 2025Two Causally Related Needles in a Video Haystackcited by 1
- 2026Benchmarking LLMs for Pairwise Causal Discovery in Biomedical and Multi-Domain Contextscited by 1
- 2026Planning Beyond Text: Graph-based Reasoning for Complex Narrative Generationcited by 1
- 2026Narrative Knowledge Weaver: Narrative-Centric Retrieval-Augmented Reasoning for Long-Form Text Understandingcited by 0
- 2026Narrative Knowledge Weaver: Narrative-Centric Retrieval-Augmented Reasoning for Long-Form Text Understanding4 Jun 2026
- 2026Planning Beyond Text: Graph-based Reasoning for Complex Narrative Generation23 Apr 2026
- 2026Narrative Theory-Driven LLM Methods for Automatic Story Generation and Understanding: A Survey23 Jan 2026
- 2026Benchmarking LLMs for Pairwise Causal Discovery in Biomedical and Multi-Domain Contexts21 Jan 2026
- 2025A Multi-Level Benchmark for Causal Language Understanding in Social Media Discourse20 Sep 2025
- 2025Q2E: Query-to-Event Decomposition for Zero-Shot Multilingual Text-to-Video Retrieval11 Jun 2025
- 2025Causal Graph based Event Reasoning using Semantic Relation Experts7 Jun 2025
- 2025Two Causally Related Needles in a Video Haystack26 May 2025
- 2025ACCESS : A Benchmark for Abstract Causal Event Discovery and Reasoning12 Feb 2025
- 2024Causal Micro-Narratives7 Oct 2024
- 2024Multilingual Synopses of Movie Narratives: A Dataset for Vision-Language Story Understanding18 Jun 2024