mlsanityData to 7 Oct 2026

Visual Story Generation Based on Emotion and Keywords

arXiv 2301.02777 ↗First posted 7 Jan 2023cs.AI cs.CL cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Automated visual story generation aims to produce stories with corresponding illustrations that exhibit coherence, progression, and adherence to characters' emotional development. This work proposes a story generation pipeline to co-create visual stories with the users. The pipeline allows the user to control events and emotions on the generated content. The pipeline includes two parts: narrative and image generation. For narrative generation, the system generates the next sentence using user-specified keywords and emotion labels. For image generation, diffusion models are used to create a visually appealing image corresponding to each generated sentence. Further, object recognition is applied to the generated images to allow objects in these images to be mentioned in future story development.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 13 of its 30 references that are in the map. First posted on arXiv 7 Jan 2023.

Builds on

13 of 30 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  7. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  8. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  9. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  10. 2018Hierarchical Neural Story Generationcited by 1,182
  11. 2014Narrative Planning: Balancing Plot and Charactercited by 61
  12. 2018Modeling Naive Psychology of Characters in Simple Commonsense Storiescited by 59
1 more
  1. 2018Controllable Neural Story Plot Generation via Reward Shapingcited by 49

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.

  1. 2024Improving Visual Storytelling with Multimodal Large Language Modelscited by 2

Similar, not cited

Close in wording, no citation either way

  1. 2023Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion Models
  2. 2024Imagining from Images with an AI Storytelling Tool
  3. 2023Improved Visual Story Generation with Adaptive Context Modeling
  4. 2025Story2Board: A Training-Free Approach for Expressive Storyboard Generation
  5. 2023CogCartoon: Towards Practical Story Visualization
  6. 2024SEED-Story: Multimodal Long Story Generation with Large Language Model
  7. 2025Generating Storytelling Images with Rich Chains-of-Reasoning
  8. 2023Zero-shot Generation of Coherent Storybook from Plain Text Story using Diffusion Models