mlsanityData to 7 Oct 2026

Visual Writing Prompts: Character-Grounded Story Generation with Curated Image Sequences

arXiv 2301.08571 ↗First posted 20 Jan 2023cs.CL cs.CV cs.LGcited by 31

Not on the map. Why?

Abstract (arXiv)

Current work on image-based story generation suffers from the fact that the existing image sequence collections do not have coherent plots behind them. We improve visual story generation by producing a new image-grounded dataset, Visual Writing Prompts (VWP). VWP contains almost 2K selected sequences of movie shots, each including 5-10 images. The image sequences are aligned with a total of 12K stories which were collected via crowdsourcing given the image sequences and a set of grounded characters from the corresponding image sequence. Our new image sequence collection and filtering process has allowed us to obtain stories that are more coherent and have more narrativity compared to previous work. We also propose a character-based story generation model driven by coherence as a strong baseline. Evaluations show that our generated stories are more coherent, visually grounded, and have more narrativity than stories generated with the current state-of-the-art model.

Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Builds on 26 of its 57 references that are in the map. First posted on arXiv 20 Jan 2023.

Builds on

26 of 57 references.

References · 26

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  4. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  5. 2018Hierarchical Neural Story Generationcited by 1,182
  6. 2019Cascade R-CNN: High Quality Object Detection and Instance Segmentationcited by 428
  7. 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 413
  8. 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
  9. 2018Plan-And-Write: Towards Better Automatic Storytellingcited by 232
  10. 2020MovieNet: A Holistic Dataset for Movie Understandingcited by 206
  11. 2016Visual Storytellingcited by 176
  12. 2019Simple BERT Models for Relation Extraction and Semantic Role Labelingcited by 154
14 more
  1. 2018Higher-order Coreference Resolution with Coarse-to-fine Inferencecited by 150
  2. 2019Strategies for Structuring Story Generationcited by 124
  3. 2020A Knowledge-Enhanced Pretraining Model for Commonsense Story Generationcited by 116
  4. 2020PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Trackingcited by 104
  5. 2020Content Planning for Neural Story Generation with Aristotelian Rescoringcited by 92
  6. 2019Counterfactual Story Reasoning and Generationcited by 87
  7. 2017Semi-supervised sequence tagging with bidirectional language modelscited by 86
  8. 2020MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Modelscited by 74
  9. 2017Event Representations for Automated Story Generation with Deep Neural Netscited by 62
  10. 2020UNION: An Unreferenced Metric for Evaluating Open-ended Story Generationcited by 60
  11. 2018Modeling Naive Psychology of Characters in Simple Commonsense Storiescited by 59
  12. 2020STORIUM: A Dataset and Evaluation Platform for Machine-in-the-Loop Story Generationcited by 56
  13. 2019A Graph-Based Framework to Bridge Movies and Synopsescited by 31
  14. 2019Knowledge-Enriched Visual Storytellingcited by 26

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 4; 2024: 14; 2025: 10; 2026: 3.

31 papers.

Sort:

By area:

  1. 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
  2. 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
  3. 2024Evaluating Creative Short Story Generation in Humans and Large Language Modelscited by 21
  4. 2024What Makes a Good Story and How Can We Measure It? A Comprehensive Survey of Story Evaluationcited by 17
  5. 2024From MOOC to MAIC: Reshaping Online Teaching and Learning through LLM-driven Agentscited by 15
  6. 2023Event Causality Is Key to Computational Story Understandingcited by 11
  7. 2024Tails Tell Tales: Chapter-Wide Manga Transcriptions with Character Namescited by 10
  8. 2023GROOViST: A Metric for Grounding Objects in Visual Storytellingcited by 8
  9. 2024Creativity in AI: Progresses and Challengescited by 7
  10. 2024ScriptViz: A Visualization Tool to Aid Scriptwriting based on a Large Movie Databasecited by 6
  11. 2024Not (yet) the whole story: Evaluating Visual Storytelling Requires More than Measuring Coherence, Grounding, and Repetitioncited by 5
  12. 2025LongWriter-V: Enabling Ultra-Long and High-Fidelity Generation in Vision-Language Modelscited by 5
19 more
  1. 2023HL Dataset: Visually-grounded Description of Scenes, Actions and Rationalescited by 4
  2. 2023Semi-supervised multimodal coreference resolution in image narrationscited by 4
  3. 2025VinaBench: Benchmark for Faithful and Consistent Visual Narrativescited by 4
  4. 2025Burn After Reading: Do Multimodal Large Language Models Truly Capture Order of Events in Image Sequences?cited by 4
  5. 2024Train & Constrain: Phonologically Informed Tongue-Twister Generation from Topics and Paraphrasescited by 3
  6. 2024Story Generation from Visual Inputs: Techniques, Related Tasks, and Challengescited by 3
  7. 2025Narrative Studio: Visual narrative exploration using LLMs and Monte Carlo Tree Searchcited by 3
  8. 2025StoryReasoning Dataset: Using Chain-of-Thought for Scene Understanding and Grounded Story Generationcited by 3
  9. 2024Improving Visual Storytelling with Multimodal Large Language Modelscited by 2
  10. 2024Context-aware Visual Storytelling with Visual Prefix Tuning and Contrastive Learningcited by 1
  11. 2024Generating Visual Stories with Grounded and Coreferent Characterscited by 1
  12. 2025Mitigating Behavioral Hallucination in Multimodal Large Language Models for Sequential Imagescited by 1
  13. 2025LLMs Behind the Scenes: Enabling Narrative Scene Illustrationcited by 1
  14. 2026ReCap: Lightweight Referential Grounding for Coherent Story Visualizationcited by 1
  15. 2025Coreference as an indicator of context scope in multimodal narrativecited by 0
  16. 2025From Image Captioning to Visual Storytellingcited by 0
  17. 2025Unraveling the cognitive patterns of Large Language Models through module communitiescited by 0
  18. 2026StoryMovie: A Dataset for Semantic Alignment of Visual Stories with Movie Scripts and Subtitlescited by 0
  19. 2026LLM and Human Modes of Representationcited by 0