mlsanityData to 14 Oct 2026

StoryGAN: A Sequential Conditional GAN for Story Visualization

arXiv 1812.02784 ↗First posted 6 Dec 2018cs.CVcited by 138

Not on the map. Why?

Cited by 23 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We propose a new task, called Story Visualization. Given a multi-sentence paragraph, the story is visualized by generating a sequence of images, one for each sentence. In contrast to video generation, story visualization focuses less on the continuity in generated images (frames), but more on the global consistency across dynamic scenes and characters -- a challenge that has not been addressed by any single-image or video generation methods. We therefore propose a new story-to-image-sequence generation model, StoryGAN, based on the sequential conditional GAN framework. Our model is unique in that it consists of a deep Context Encoder that dynamically tracks the story flow, and two discriminators at the story and image levels, to enhance the image quality and the consistency of the generated sequences. To evaluate the model, we modified existing datasets to create the CLEVR-SV and Pororo-SV datasets. Empirically, StoryGAN outperforms state-of-the-art models in image quality, contextual consistency metrics, and human evaluation.

Key facts. Cited by 138 papers in the map (data through 14 Oct 2026). First posted on arXiv 6 Dec 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 14; 2022: 15; 2023: 27; 2024: 40; 2025: 26; 2026: 16.

138 papers.

Sort:

By area:

  1. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  2. 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 141
  3. 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scalecited by 127
  4. 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyondcited by 111
  5. 2025One-Minute Video Generation with Test-Time Trainingcited by 101
  6. 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attentioncited by 89
  7. 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 89
  8. 2024MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizercited by 80
  9. 2023Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion Modelscited by 77
  10. 2023Fine-tuning Multimodal LLMs to Follow Zero-shot Demonstrative Instructionscited by 77
  11. 2022Make-A-Story: Visual Memory Conditioned Consistent Story Generationcited by 76
  12. 2022StoryDALL-E: Adapting Pretrained Text-to-Image Transformers for Story Continuationcited by 74
38 more
  1. 2023TaleCrafter: Interactive Story Visualization with Multiple Characterscited by 73
  2. 2024SEED-Story: Multimodal Long Story Generation with Large Language Modelcited by 73
  3. 2022Synthesizing Coherent Story with Auto-Regressive Latent Diffusion Modelscited by 70
  4. 2022Synthetic Data -- what, why and how?cited by 67
  5. 2024Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Modelcited by 66
  6. 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videoscited by 64
  7. 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Modelscited by 63
  8. 2024Boosting Consistency in Story Visualization with Rich-Contextual Conditional Diffusion Modelscited by 54
  9. 2021Integrating Visuospatial, Linguistic and Commonsense Structure into Story Visualizationcited by 52
  10. 2024DreamStory: Open-Domain Story Visualization by LLM-Guided Multi-Subject Consistent Diffusioncited by 47
  11. 2021Improving Generation and Evaluation of Visual Stories via Semantic Consistencycited by 43
  12. 2023SceneGenie: Scene Graph Guided Diffusion Models for Image Synthesiscited by 41
  13. 2025StoryMem: Multi-shot Long Video Storytelling with Memorycited by 40
  14. 2023AutoStory: Generating Diverse Storytelling Images with Minimal Human Effortcited by 38
  15. 2024Anim-Director: A Large Multimodal Model Powered Agent for Controllable Animation Video Generationcited by 37
  16. 2022Character-Centric Story Visualization via Visual Planning and Token Alignmentcited by 33
  17. 2024StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaborationcited by 31
  18. 2023StoryBench: A Multifaceted Benchmark for Continuous Story Visualizationcited by 29
  19. 2024UniMLVG: Unified Framework for Multi-view Long Video Generation with Comprehensive Control Capabilities for Autonomous Drivingcited by 27
  20. 2023Zero-shot Generation of Coherent Storybook from Plain Text Story using Diffusion Modelscited by 26
  21. 2023StoryGPT-V: Large Language Models as Consistent Story Visualizerscited by 25
  22. 2024TALC: Time-Aligned Captions for Multi-Scene Text-to-Video Generationcited by 25
  23. 2024DataNarrative: Automated Data-Driven Storytelling with Visualizations and Textscited by 25
  24. 2026VideoMemory: Toward Consistent Video Generation via Memory Integrationcited by 25
  25. 2022Word-Level Fine-Grained Story Visualizationcited by 23
  26. 2023Improved Visual Story Generation with Adaptive Context Modelingcited by 22
  27. 2025MAViS: A Multi-Agent Framework for Long-Sequence Video Storytellingcited by 21
  28. 2022MUGEN: A Playground for Video-Audio-Text Multimodal Understanding and GENerationcited by 20
  29. 2024StoryImager: A Unified and Efficient Framework for Coherent Story Visualization and Completioncited by 20
  30. 2023FlowZero: Zero-Shot Text-to-Video Synthesis with LLM-Driven Dynamic Scene Syntaxcited by 19
  31. 2024TheaterGen: Character Management with LLM for Consistent Multi-turn Image Generationcited by 19
  32. 2024DiffSensei: Bridging Multi-Modal LLMs and Diffusion Models for Customized Manga Generationcited by 18
  33. 2024What Makes a Good Story and How Can We Measure It? A Comprehensive Survey of Story Evaluationcited by 17
  34. 2023OpenLEAF: Open-Domain Interleaved Image-Text Generation and Evaluationcited by 16
  35. 2025Synthetic Video Enhances Physical Fidelity in Video Synthesiscited by 15
  36. 2021A review of Generative Adversarial Networks (GANs) and its applications in a wide variety of disciplines -- From Medical to Remote Sensingcited by 13
  37. 2024AesopAgent: Agent-driven Evolutionary System on Story-to-Video Productioncited by 13
  38. 2024Story-Iter: A Training-free Iterative Paradigm for Long Story Visualizationcited by 13

50 most cited of 138 All 138 (JSON)