mlsanityData to 13 Oct 2026

Word-Level Fine-Grained Story Visualization

arXiv 2208.02341 ↗First posted 3 Aug 2022cs.CV cs.CL cs.LGcited by 22

Not on the map. Why?

Abstract (arXiv)

Story visualization aims to generate a sequence of images to narrate each sentence in a multi-sentence story with a global consistency across dynamic scenes and characters. Current works still struggle with output images' quality and consistency, and rely on additional semantic information or auxiliary captioning networks. To address these challenges, we first introduce a new sentence representation, which incorporates word information from all story sentences to mitigate the inconsistency problem. Then, we propose a new discriminator with fusion features and further extend the spatial attention to improve image quality and story consistency. Extensive experiments on different datasets and human evaluation demonstrate the superior performance of our approach, compared to state-of-the-art methods, neither using segmentation masks nor auxiliary captioning networks.

Key facts. Cited by 22 papers in the map (data through 13 Oct 2026). Builds on 25 of its 32 references that are in the map. First posted on arXiv 3 Aug 2022.

Builds on

25 of 32 references.

References · 25

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,093
  2. 2022Generative Adversarial Networkscited by 5,614
  3. 2021Zero-Shot Text-to-Image Generationcited by 4,284
  4. 2016Generative Adversarial Text to Image Synthesiscited by 735
  5. 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
  6. 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 577
  7. 2019DM-GAN: Dynamic Memory Generative Adversarial Networks for Text-to-Image Synthesiscited by 308
  8. 2021Cross-Modal Contrastive Learning for Text-to-Image Generationcited by 259
  9. 2017StackGAN++: Realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 229
  10. 2019Controllable Text-to-Image Generationcited by 187
  11. 2019MirrorGAN: Learning Text-to-image Generation by Redescriptioncited by 176
  12. 2019ManiGAN: Text-Guided Image Manipulationcited by 156
13 more
  1. 2017Video Generation From Textcited by 154
  2. 2018StoryGAN: A Sequential Conditional GAN for Story Visualizationcited by 137
  3. 2018Text-Adaptive Generative Adversarial Networks: Manipulating Images with Natural Languagecited by 90
  4. 2019Semantic Object Accuracy for Generative Text-to-Image Synthesiscited by 89
  5. 2017Semantic Image Synthesis via Adversarial Learningcited by 87
  6. 2018To Create What You Tell: Generating Videos from Captionscited by 84
  7. 2017DeepStory: Video Story QA by Deep Embedded Memory Networkscited by 68
  8. 2018Imagine This! Scripts to Compositions to Videoscited by 54
  9. 2021Integrating Visuospatial, Linguistic and Commonsense Structure into Story Visualizationcited by 51
  10. 2021Improving Generation and Evaluation of Visual Stories via Semantic Consistencycited by 43
  11. 2020Lightweight Generative Adversarial Networks for Text-Guided Image Manipulationcited by 33
  12. 2020Image-to-Image Translation with Text Guidancecited by 10
  13. 2020Knowledge Graph Extraction from Videoscited by 10

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2022: 3; 2023: 7; 2024: 8; 2025: 2; 2026: 2.

22 papers.

Sort:

By area:

  1. 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyondcited by 111
  2. 2023Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion Modelscited by 76
  3. 2023TaleCrafter: Interactive Story Visualization with Multiple Characterscited by 71
  4. 2022Synthesizing Coherent Story with Auto-Regressive Latent Diffusion Modelscited by 69
  5. 2024Boosting Consistency in Story Visualization with Rich-Contextual Conditional Diffusion Modelscited by 54
  6. 2023AutoStory: Generating Diverse Storytelling Images with Minimal Human Effortcited by 38
  7. 2023Improved Visual Story Generation with Adaptive Context Modelingcited by 22
  8. 2024StoryImager: A Unified and Efficient Framework for Coherent Story Visualization and Completioncited by 19
  9. 2024AesopAgent: Agent-driven Evolutionary System on Story-to-Video Productioncited by 12
  10. 2024Story-Iter: A Training-free Iterative Paradigm for Long Story Visualizationcited by 12
  11. 2022Memory-Driven Text-to-Image Generationcited by 10
  12. 2023Causal-Story: Local Causal Attention Utilizing Parameter-Efficient Tuning For Visual Story Synthesiscited by 9
10 more
  1. 2024Evolving Storytelling: Benchmarks and Methods for New Character Customization with Diffusion Modelscited by 9
  2. 2023CogCartoon: Towards Practical Story Visualizationcited by 8
  3. 2024ContextualStory: Consistent Visual Storytelling with Spatially-Enhanced and Storyline Contextcited by 8
  4. 2023Make-A-Storyboard: A General Framework for Storyboard with Disentangled and Merged Controlcited by 7
  5. 2026AnimeAgent: Is the Multi-Agent via Image-to-Video models a Good Disney Storytelling Artist?cited by 5
  6. 2024KAHANI: Culturally-Nuanced Visual Storytelling Tool for Non-Western Culturescited by 4
  7. 2025ViStoryBench: Comprehensive Benchmark Suite for Story Visualizationcited by 4
  8. 2025FairyGen: Storied Cartoon Video from a Single Child-Drawn Charactercited by 4
  9. 2022Learning to Model Multimodal Semantic Alignment for Story Visualizationcited by 3
  10. 2026EvoTale: Continual Character Customization for Expanding Story Worldscited by 0