Inferring the Reader: Guiding Automated Story Generation with Commonsense Reasoning
Not on the map. Why?
Abstract (arXiv)
Transformer-based language model approaches to automated story generation currently provide state-of-the-art results. However, they still suffer from plot incoherence when generating narratives over time, and critically lack basic commonsense reasoning. Furthermore, existing methods generally focus only on single-character stories, or fail to track characters at all. To improve the coherence of generated narratives and to expand the scope of character-centric narrative generation, we introduce Commonsense-inference Augmented neural StoryTelling (CAST), a framework for introducing commonsense reasoning into the generation process with the option to model the interaction between multiple characters. We find that our CAST method produces significantly more coherent, on-topic, enjoyable and fluent stories than existing models in both the single-character and two-character settings in three storytelling domains.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). Builds on 28 of its 93 references that are in the map. First posted on arXiv 4 May 2021.
Builds on
28 of 93 references.
References · 28
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2018Hierarchical Neural Story Generationcited by 1,182
- 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 540
- 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 484
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
- 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 413
- 2020Evaluation of Text Generation: A Surveycited by 275
- 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
- 2018Plan-And-Write: Towards Better Automatic Storytellingcited by 232
16 more
- 2019Strategies for Structuring Story Generationcited by 124
- 2020A Knowledge-Enhanced Pretraining Model for Commonsense Story Generationcited by 116
- 2020PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Trackingcited by 104
- 2020Content Planning for Neural Story Generation with Aristotelian Rescoringcited by 92
- 2017Event Representations for Automated Story Generation with Deep Neural Netscited by 62
- 2014Narrative Planning: Balancing Plot and Charactercited by 61
- 2018Story Ending Generation with Incremental Encoding and Commonsense Knowledgecited by 60
- 2018Modeling Naive Psychology of Characters in Simple Commonsense Storiescited by 59
- 2018Controllable Neural Story Plot Generation via Reward Shapingcited by 49
- 2020Modeling Protagonist Emotions for Emotion-Aware Storytellingcited by 42
- 2020Automated Storytelling via Causal, Commonsense Plot Orderingcited by 38
- 2019Story Realization: Expanding Plot Events into Sentencescited by 35
- 2020Bringing Stories Alive: Generating Interactive Fiction Worldscited by 28
- 2020Curious Case of Language Generation Evaluation Metrics: A Cautionary Talecited by 28
- 2017DeepTinglecited by 11
- 2016Computational Narrative Intelligence: A Human-Centered Goal for Artificial Intelligencecited by 6
Built on by
Citing papers per year: 2021: 5; 2022: 7; 2023: 6; 2024: 7; 2025: 3; 2026: 1.
29 papers.
Sort:
By area:
- 2024To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoningcited by 257
- 2024Teaching Large Language Models to Reason with Reinforcement Learningcited by 158
- 2023The Next Chapter: A Study of Large Language Models in Storytellingcited by 58
- 2024Agents' Room: Narrative Generation through Multi-step Collaborationcited by 57
- 2022Dungeons and Dragons as a Dialog Challenge for Artificial Intelligencecited by 35
- 2024DataNarrative: Automated Data-Driven Storytelling with Visualizations and Textscited by 25
- 2022Open-world Story Generation with Structured Knowledge Enhancement: A Comprehensive Surveycited by 21
- 2021Cut the CARP: Fishing for zero-shot story evaluationcited by 14
- 2021Goal-Directed Story Generation: Augmenting Generative Language Models with Reinforcement Learningcited by 14
- 2023GROVE: A Retrieval-augmented Complex Story Generation Framework with A Forest of Evidencecited by 14
- 2021Guiding Neural Story Generation with Reader Modelscited by 12
- 2023Affective and Dynamic Beam Search for Story Generationcited by 12
17 more
- 2023LongStory: Coherent, Complete and Length Controlled Long story Generationcited by 12
- 2021Memory and Knowledge Augmented Language Models for Inferring Salience in Long-Form Storiescited by 11
- 2022ComFact: A Benchmark for Linking Contextual Commonsense Knowledgecited by 11
- 2025STORYTELLER: An Enhanced Plot-Planning Framework for Coherent and Cohesive Story Generationcited by 9
- 2022CoRRPUS: Code-based Structured Prompting for Neurosymbolic Story Understandingcited by 7
- 2023Story Shaping: Teaching Agents Human-like Behavior with Storiescited by 7
- 2023Ambient Adventures: Teaching ChatGPT on Developing Complex Storiescited by 5
- 2022rmC small IS2: A Simplified Commonsense Inference Evaluation for Story Prosecited by 4
- 2022Event Transition Planning for Open-ended Text Generationcited by 4
- 2021Automated Story Generation as Question-Answeringcited by 3
- 2024DiffuCOMET: Contextual Commonsense Knowledge Diffusioncited by 2
- 2024Schema-Guided Culture-Aware Complex Event Simulation with Multi-Agent Role-Playcited by 2
- 2024Rule or Story, Which is a Better Commonsense Expression for Talking with Large Language Models?cited by 1
- 2025Collaborative Storytelling and LLM: A Linguistic Analysis of Automatically-Generated Role-Playing Game Sessionscited by 1
- 2025Regional Tiny Stories: Using Small Models to Compare Language Learning and Tokenizer Performancecited by 1
- 2026LogiStory: A Logic-Aware Framework for Multi-Image Story Visualizationcited by 1
- 2022XFBoost: Improving Text Generation with Controllable Decoderscited by 0
- 2026LogiStory: A Logic-Aware Framework for Multi-Image Story Visualization30 Mar 2026
- 2025STORYTELLER: An Enhanced Plot-Planning Framework for Coherent and Cohesive Story Generation3 Jun 2025
- 2025Regional Tiny Stories: Using Small Models to Compare Language Learning and Tokenizer Performance7 Apr 2025
- 2025Collaborative Storytelling and LLM: A Linguistic Analysis of Automatically-Generated Role-Playing Game Sessions26 Mar 2025
- 2024Schema-Guided Culture-Aware Complex Event Simulation with Multi-Agent Role-Play24 Oct 2024
- 2024Agents' Room: Narrative Generation through Multi-step Collaboration3 Oct 2024
- 2024To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoning18 Sep 2024
- 2024DataNarrative: Automated Data-Driven Storytelling with Visualizations and Texts9 Aug 2024
- 2024Teaching Large Language Models to Reason with Reinforcement Learning7 Mar 2024
- 2024DiffuCOMET: Contextual Commonsense Knowledge Diffusion26 Feb 2024
- 2024Rule or Story, Which is a Better Commonsense Expression for Talking with Large Language Models?22 Feb 2024
- 2023LongStory: Coherent, Complete and Length Controlled Long story Generation26 Nov 2023
17 more
- 2023Affective and Dynamic Beam Search for Story Generation23 Oct 2023
- 2023GROVE: A Retrieval-augmented Complex Story Generation Framework with A Forest of Evidence9 Oct 2023
- 2023Ambient Adventures: Teaching ChatGPT on Developing Complex Stories3 Aug 2023
- 2023Story Shaping: Teaching Agents Human-like Behavior with Stories24 Jan 2023
- 2023The Next Chapter: A Study of Large Language Models in Storytelling24 Jan 2023
- 2022CoRRPUS: Code-based Structured Prompting for Neurosymbolic Story Understanding21 Dec 2022
- 2022Open-world Story Generation with Structured Knowledge Enhancement: A Comprehensive Survey9 Dec 2022
- 2022ComFact: A Benchmark for Linking Contextual Commonsense Knowledge23 Oct 2022
- 2022Dungeons and Dragons as a Dialog Challenge for Artificial Intelligence13 Oct 2022
- 2022Event Transition Planning for Open-ended Text Generation20 Apr 2022
- 2022XFBoost: Improving Text Generation with Controllable Decoders16 Feb 2022
- 2022rmC small IS2: A Simplified Commonsense Inference Evaluation for Story Prose16 Feb 2022
- 2021Guiding Neural Story Generation with Reader Models16 Dec 2021
- 2021Goal-Directed Story Generation: Augmenting Generative Language Models with Reinforcement Learning16 Dec 2021
- 2021Automated Story Generation as Question-Answering7 Dec 2021
- 2021Cut the CARP: Fishing for zero-shot story evaluation6 Oct 2021
- 2021Memory and Knowledge Augmented Language Models for Inferring Salience in Long-Form Stories8 Sep 2021
- 2023The Next Chapter: A Study of Large Language Models in Storytellingcited by 58
- 2022Dungeons and Dragons as a Dialog Challenge for Artificial Intelligencecited by 35
- 2022Open-world Story Generation with Structured Knowledge Enhancement: A Comprehensive Surveycited by 21
- 2021Cut the CARP: Fishing for zero-shot story evaluationcited by 14
- 2021Goal-Directed Story Generation: Augmenting Generative Language Models with Reinforcement Learningcited by 14
- 2021Guiding Neural Story Generation with Reader Modelscited by 12
- 2023Affective and Dynamic Beam Search for Story Generationcited by 12
- 2023LongStory: Coherent, Complete and Length Controlled Long story Generationcited by 12
- 2021Memory and Knowledge Augmented Language Models for Inferring Salience in Long-Form Storiescited by 11
- 2022ComFact: A Benchmark for Linking Contextual Commonsense Knowledgecited by 11
- 2025STORYTELLER: An Enhanced Plot-Planning Framework for Coherent and Cohesive Story Generationcited by 9
- 2022CoRRPUS: Code-based Structured Prompting for Neurosymbolic Story Understandingcited by 7
12 most cited of 23 All 23 (JSON)
- 2026LogiStory: A Logic-Aware Framework for Multi-Image Story Visualization30 Mar 2026
- 2025STORYTELLER: An Enhanced Plot-Planning Framework for Coherent and Cohesive Story Generation3 Jun 2025
- 2025Regional Tiny Stories: Using Small Models to Compare Language Learning and Tokenizer Performance7 Apr 2025
- 2025Collaborative Storytelling and LLM: A Linguistic Analysis of Automatically-Generated Role-Playing Game Sessions26 Mar 2025
- 2024Schema-Guided Culture-Aware Complex Event Simulation with Multi-Agent Role-Play24 Oct 2024
- 2024DiffuCOMET: Contextual Commonsense Knowledge Diffusion26 Feb 2024
- 2023LongStory: Coherent, Complete and Length Controlled Long story Generation26 Nov 2023
- 2023Affective and Dynamic Beam Search for Story Generation23 Oct 2023
- 2023Ambient Adventures: Teaching ChatGPT on Developing Complex Stories3 Aug 2023
- 2023Story Shaping: Teaching Agents Human-like Behavior with Stories24 Jan 2023
- 2023The Next Chapter: A Study of Large Language Models in Storytelling24 Jan 2023
- 2022CoRRPUS: Code-based Structured Prompting for Neurosymbolic Story Understanding21 Dec 2022
12 newest of 23 All 23 (JSON)