Directing the Narrative: A Finetuning Method for Controlling Coherence and Style in Story Generation
Not on the map. Why?
Abstract (arXiv)
Story visualization requires generating sequential imagery that aligns semantically with evolving narratives while maintaining rigorous consistency in character identity and visual style. However, existing methodologies often struggle with subject inconsistency and identity drift, particularly when depicting complex interactions or extended narrative arcs. To address these challenges, we propose a cohesive two-stage framework designed for robust and consistent story generation. First, we introduce Group-Shared Attention (GSA), a mechanism that fosters intrinsic consistency by enabling lossless cross-sample information flow within attention layers. This allows the model to structurally encode identity correspondence across frames without relying on external encoders. Second, we leverage Direct Preference Optimization (DPO) to align generated outputs with human aesthetic and narrative standards. Unlike conventional methods that rely on conflicting auxiliary losses, our approach simultaneously enhances visual fidelity and identity preservation by learning from holistic preference data. Extensive evaluations on the ViStoryBench benchmark demonstrate that our method establishes a new state-of-the-art, significantly outperforming strong baselines with gains of +10.0 in Character Identity (CIDS) and +18.7 in Style Consistency (CSD), all while preserving high-fidelity generation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 17 references that are in the map. First posted on arXiv 18 Mar 2026.
Builds on
13 of 17 references.
References · 13
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Generative Adversarial Networkscited by 5,603
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 153
- 2018StoryGAN: A Sequential Conditional GAN for Story Visualizationcited by 137
1 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025SceneDecorator: Towards Scene-Oriented Story Generation with Scene Planning and Scene Consistency
- 2026AttriStory: Fine-grained Attribute Realization for Visual Storytelling with Diffusion Models
- 2026Sidecar: Training-Free Semantic Reuse for Character-Consistent Free-form Visual Storytelling
- 2026EvoTale: Continual Character Customization for Expanding Story Worlds
- 2025Story2Board: A Training-Free Approach for Expressive Storyboard Generation
- 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Models
- 2024Evolving Storytelling: Benchmarks and Methods for New Character Customization with Diffusion Models
- 2025Storybooth: Training-free Multi-Subject Consistency for Improved Visual Storytelling