mlsanityData to 7 Oct 2026

Event Causality Is Key to Computational Story Understanding

arXiv 2311.09648 ↗First posted 16 Nov 2023cs.CLcited by 11

Not on the map. Why?

Abstract (arXiv)

Cognitive science and symbolic AI research suggest that event causality provides vital information for story understanding. However, machine learning systems for story understanding rarely employ event causality, partially due to the lack of methods that reliably identify open-world causal event relations. Leveraging recent progress in large language models, we present the first method for event causality identification that leads to material improvements in computational story understanding. Our technique sets a new state of the art on the COPES dataset (Wang et al., 2023) for causal event relation identification. Further, in the downstream story quality evaluation task, the identified causal relations lead to 3.6-16.6% relative improvement on correlation with human ratings. In the multimodal story video-text alignment task, we attain 4.1-10.9% increase on Clip Accuracy and 4.2-13.5% increase on Sentence IoU. The findings indicate substantial untapped potential for event causality in computational story understanding. The codebase is at https://github.com/insundaycathy/Event-Causality-Extraction.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 41 of its 97 references that are in the map. First posted on arXiv 16 Nov 2023.

Builds on

41 of 97 references.

References · 41

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  5. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  6. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  7. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
  8. 2018Hierarchical Neural Story Generationcited by 1,182
  9. 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 729
  10. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
  11. 2023Is ChatGPT a Good NLG Evaluator? A Preliminary Studycited by 420
  12. 2020UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generationcited by 258
29 more
  1. 2018Long-Term Feature Banks for Detailed Video Understandingcited by 239
  2. 2022Re3: Generating Longer Stories With Recursive Reprompting and Revisioncited by 193
  3. 2019Heterogeneous Memory Enhanced Multimodal Attention Model for Video Question Answeringcited by 146
  4. 2020A Knowledge-Enhanced Pretraining Model for Commonsense Story Generationcited by 116
  5. 2020GLUCOSE: GeneraLized and COntextualized Story Explanationscited by 85
  6. 2022Fantastic Questions and Where to Find Them: FairytaleQA -- An Authentic Dataset for Narrative Comprehensioncited by 79
  7. 2022Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generationcited by 73
  8. 2023Is ChatGPT a Good Causal Reasoner? A Comprehensive Evaluationcited by 69
  9. 2022MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extractioncited by 65
  10. 2014Narrative Planning: Balancing Plot and Charactercited by 61
  11. 2021OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation Metricscited by 61
  12. 2020UNION: An Unreferenced Metric for Evaluating Open-ended Story Generationcited by 60
  13. 2023The Next Chapter: A Study of Large Language Models in Storytellingcited by 58
  14. 2019Better Automatic Evaluation of Open-Domain Dialogue Systems with Contextualized Embeddingscited by 52
  15. 2020Automated Storytelling via Causal, Commonsense Plot Orderingcited by 38
  16. 2020Pre-training Is (Almost) All You Need: An Application to Commonsense Reasoningcited by 33
  17. 2023Visual Writing Prompts: Character-Grounded Story Generation with Curated Image Sequencescited by 31
  18. 2022CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generationcited by 29
  19. 2020Causal BERT : Language models for causality detection between events expressed in textcited by 22
  20. 2023COLA: Contextualized Commonsense Causal Reasoning from the Causal Inference Perspectivecited by 22
  21. 2023The Magic of IF: Investigating Causal Reasoning Abilities in Large Language Models of Codecited by 21
  22. 2022TVShowGuess: Character Comprehension in Stories as Speaker Guessingcited by 17
  23. 2022ROCK: Causal Inference Principles for Reasoning about Commonsense Causalitycited by 16
  24. 2018A Neural Multi-sequence Alignment TeCHnique (NeuMATCH)cited by 13
  25. 2022Synopses of Movie Narratives: a Video-Language Dataset for Story Understandingcited by 8
  26. 2022EvEntS ReaLM: Event Reasoning of Entity States via Language Modelscited by 7
  27. 2022CoRRPUS: Code-based Structured Prompting for Neurosymbolic Story Understandingcited by 7
  28. 2022rmC small IS2: A Simplified Commonsense Inference Evaluation for Story Prosecited by 4
  29. 2023Adversarial Transformer Language Models for Contextual Commonsense Inferencecited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 5; 2026: 4.

11 papers.