Storynizor: Consistent Story Generation via Inter-Frame Synchronized and Shuffled ID Injection
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Recent advances in text-to-image diffusion models have spurred significant interest in continuous story image generation. In this paper, we introduce Storynizor, a model capable of generating coherent stories with strong inter-frame character consistency, effective foreground-background separation, and diverse pose variation. The core innovation of Storynizor lies in its key modules: ID-Synchronizer and ID-Injector. The ID-Synchronizer employs an auto-mask self-attention module and a mask perceptual loss across inter-frame images to improve the consistency of character generation, vividly representing their postures and backgrounds. The ID-Injector utilize a Shuffling Reference Strategy (SRS) to integrate ID features into specific locations, enhancing ID-based consistent character generation. Additionally, to facilitate the training of Storynizor, we have curated a novel dataset called StoryDB comprising 100, 000 images. This dataset contains single and multiple-character sets in diverse environments, layouts, and gestures with detailed descriptions. Experimental results indicate that Storynizor demonstrates superior coherent story generation with high-fidelity character consistency, flexible postures, and vivid backgrounds compared to other character-specific methods.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 28 of its 30 references that are in the map. First posted on arXiv 29 Sep 2024.
Builds on
28 of 30 references.
Closest ancestors · 10
Same direction, newest first
- 2024OMG: Occlusion-friendly Personalized Multi-concept Generation in Diffusion Models16 Mar
- 2024InstantID: Zero-shot Identity-Preserving Generation in Seconds15 Jan
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
- 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models29 May
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention17 May
- 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers2 Nov
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
Other references · 18
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2017Neural Discrete Representation Learningcited by 4,650
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 614
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
6 more
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
- 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 193
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 142
- 2024Training-Free Consistent Text-to-Image Generationcited by 123
- 2023DreamTuner: Single Image is Enough for Subject-Driven Generationcited by 41
- 2024Character-Adapter: Prompt-Guided Region Control for High-Fidelity Character Customizationcited by 6
Built on by
Citing papers per year: 2025: 4; 2026: 4.
8 papers.
- 2025ComfyGPT: A Self-Optimizing Multi-Agent System for Comprehensive ComfyUI Workflow Generationcited by 14
- 2025Lay2Story: Extending Diffusion Transformers for Layout-Togglable Story Generationcited by 6
- 2025ViSTA: Visual Storytelling using Multi-modal Adapters for Text-to-Image Diffusion Modelscited by 3
- 2025Self-NPO: Data-Free Diffusion Model Enhancement via Truncated Diffusion Fine-Tuningcited by 1
- 2026FreeStory: Training-Free Character Consistency for Free-Form Visual Storytellingcited by 1
- 2026Customized Visual Storytelling with Unified Multimodal LLMscited by 0
- 2026LCG: Long-Context Consistent Image Generation with Sparse Relational Attentioncited by 0
- 2026Memory-Guided B-Roll Generation from User Video Collectionscited by 0
- 2026Memory-Guided B-Roll Generation from User Video Collections1 Oct 2026
- 2026LCG: Long-Context Consistent Image Generation with Sparse Relational Attention24 Jun 2026
- 2026FreeStory: Training-Free Character Consistency for Free-Form Visual Storytelling23 Jun 2026
- 2026Customized Visual Storytelling with Unified Multimodal LLMs29 Mar 2026
- 2025Lay2Story: Extending Diffusion Transformers for Layout-Togglable Story Generation12 Aug 2025
- 2025ViSTA: Visual Storytelling using Multi-modal Adapters for Text-to-Image Diffusion Models13 Jun 2025
- 2025Self-NPO: Data-Free Diffusion Model Enhancement via Truncated Diffusion Fine-Tuning17 May 2025
- 2025ComfyGPT: A Self-Optimizing Multi-Agent System for Comprehensive ComfyUI Workflow Generation22 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2025Storybooth: Training-free Multi-Subject Consistency for Improved Visual Storytelling
- 2026DreamShot: Personalized Storyboard Synthesis with Video Diffusion Prior
- 2025SceneDecorator: Towards Scene-Oriented Story Generation with Scene Planning and Scene Consistency
- 2025Story2Board: A Training-Free Approach for Expressive Storyboard Generation
- 2025One-Prompt-One-Story: Free-Lunch Consistent Text-to-Image Generation Using a Single Prompt
- 2025CharCom: Composable Identity Control for Multi-Character Story Illustration
- 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Models
- 2026Directing the Narrative: A Finetuning Method for Controlling Coherence and Style in Story Generation