mlsanityData to 13 Oct 2026

CogCartoon: Towards Practical Story Visualization

arXiv 2312.10718 ↗First posted 17 Dec 2023cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

The state-of-the-art methods for story visualization demonstrate a significant demand for training data and storage, as well as limited flexibility in story presentation, thereby rendering them impractical for real-world applications. We introduce CogCartoon, a practical story visualization method based on pre-trained diffusion models. To alleviate dependence on data and storage, we propose an innovative strategy of character-plugin generation that can represent a specific character as a compact 316 KB plugin by using a few training samples. To facilitate enhanced flexibility, we employ a strategy of plugin-guided and layout-guided inference, enabling users to seamlessly incorporate new characters and custom layouts into the generated image results at their convenience. We have conducted comprehensive qualitative and quantitative studies, providing compelling evidence for the superiority of CogCartoon over existing methodologies. Moreover, CogCartoon demonstrates its power in tackling challenging tasks, including long story visualization and realistic style story visualization.

Key facts. Cited by 8 papers in the map (data through 13 Oct 2026). Builds on 51 of its 61 references that are in the map. First posted on arXiv 17 Dec 2023.

Builds on

51 of 61 references.

References · 51

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,952
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,777
  3. 2020Denoising Diffusion Implicit Modelscited by 9,718
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,213
  5. 2023Segment Anythingcited by 8,195
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,564
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,339
  8. 2022Classifier-Free Diffusion Guidancecited by 5,785
  9. 2021Zero-Shot Text-to-Image Generationcited by 4,284
  10. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,281
  11. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,751
  12. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,605
38 more
  1. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,294
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,604
  3. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,421
  4. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,240
  5. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,174
  6. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,104
  7. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 841
  8. 2016Generative Adversarial Text to Image Synthesiscited by 735
  9. 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 692
  10. 2020Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentationcited by 596
  11. 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 577
  12. 2023Zero-shot Image-to-Image Translationcited by 503
  13. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  14. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
  15. 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 307
  16. 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
  17. 2023StyleGAN-T: Unlocking the Power of GANs for Fast Large-Scale Text-to-Image Synthesiscited by 212
  18. 2019ManiGAN: Text-Guided Image Manipulationcited by 156
  19. 2023Cones: Concept Neurons in Diffusion Models for Customized Generationcited by 150
  20. 2018StoryGAN: A Sequential Conditional GAN for Story Visualizationcited by 137
  21. 2019Object-driven Text-to-Image Synthesis via Adversarial Trainingcited by 117
  22. 2023Cones 2: Customizable Image Synthesis with Multiple Subjectscited by 101
  23. 2022Make-A-Story: Visual Memory Conditioned Consistent Story Generationcited by 76
  24. 2022StoryDALL-E: Adapting Pretrained Text-to-Image Transformers for Story Continuationcited by 74
  25. 2023TaleCrafter: Interactive Story Visualization with Multiple Characterscited by 71
  26. 2022Synthesizing Coherent Story with Auto-Regressive Latent Diffusion Modelscited by 69
  27. 2018Photographic Text-to-Image Synthesis with a Hierarchically-nested Adversarial Networkcited by 64
  28. 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Modelscited by 62
  29. 2021Integrating Visuospatial, Linguistic and Commonsense Structure into Story Visualizationcited by 51
  30. 2021DAE-GAN: Dynamic Aspect-aware GAN for Text-to-Image Synthesiscited by 45
  31. 2021Improving Generation and Evaluation of Visual Stories via Semantic Consistencycited by 43
  32. 2017CVAE-GAN: Fine-Grained Image Generation through Asymmetric Trainingcited by 42
  33. 2023Zero-shot Generation of Coherent Storybook from Plain Text Story using Diffusion Modelscited by 26
  34. 2022Word-Level Fine-Grained Story Visualizationcited by 22
  35. 2023Foundation Model Drives Weakly Incremental Learning for Semantic Segmentationcited by 12
  36. 2023Causal-Story: Local Causal Attention Utilizing Parameter-Efficient Tuning For Visual Story Synthesiscited by 9
  37. 2023Story Visualization by Online Text Augmentation with Context Memorycited by 7
  38. 2023Make-A-Storyboard: A General Framework for Storyboard with Disentangled and Merged Controlcited by 7

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2024: 2; 2025: 4; 2026: 2.

8 papers.

  1. 2024Mind the Time: Temporally-Controlled Multi-Event Video Generationcited by 40
  2. 2024StoryImager: A Unified and Efficient Framework for Coherent Story Visualization and Completioncited by 19
  3. 2025Generative AI for Cel-Animation: A Surveycited by 17
  4. 2025FairyGen: Storied Cartoon Video from a Single Child-Drawn Charactercited by 4
  5. 2025ViSTA: Visual Storytelling using Multi-modal Adapters for Text-to-Image Diffusion Modelscited by 3
  6. 2025LinkTo-Anime: A 2D Animation Optical Flow Dataset from 3D Model Renderingcited by 1
  7. 2026FreeStory: Training-Free Character Consistency for Free-Form Visual Storytellingcited by 1
  8. 2026Sidecar: Training-Free Semantic Reuse for Character-Consistent Free-form Visual Storytellingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Evolving Storytelling: Benchmarks and Methods for New Character Customization with Diffusion Models
  2. 2025DreamingComics: A Story Visualization Pipeline via Subject and Layout Customized Generation using Video Models
  3. 2024Story3D-Agent: Exploring 3D Storytelling Visualization with Large Language Models
  4. 2024StoryWeaver: A Unified World Model for Knowledge-Enhanced Story Character Customization
  5. 2024DiffSensei: Bridging Multi-Modal LLMs and Diffusion Models for Customized Manga Generation
  6. 2023StoryGPT-V: Large Language Models as Consistent Story Visualizers
  7. 2025Plot'n Polish: Zero-shot Story Visualization and Disentangled Editing with Text-to-Image Diffusion Models
  8. 2026Directing the Narrative: A Finetuning Method for Controlling Coherence and Style in Story Generation