mlsanityData to 14 Oct 2026

AttriStory: Fine-grained Attribute Realization for Visual Storytelling with Diffusion Models

arXiv 2605.20777 ↗First posted 20 May 2026cs.CVcited by 1

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Visual storytelling with diffusion models has made impressive strides in maintaining character consistency across narrative scenes. However, a critical gap remains: while these methods ensure a character remains consistent across scenes, they provide no systematic method to ensure if fine-grained attributes such as color and textures of clothing, accessories are faithfully rendered in the generated images. Towards this goal, we introduce AttriStory, a benchmark enabling attribute realization in visual storytelling. We curate 200 multi-scene stories across 10 distinct artistic styles using Large Language Model. Each scene is constructed with detailed attribute specifications to enable rich visual narratives. Further, to address attribute realization, we propose a plug-and-play latent optimization module that operates during early denoising steps, when the model establishes structural and semantic content. We achieve this through AttriLoss objective designed to maximize alignment between the cross-attention maps for desired attribute-object pairs while suppressing spurious associations, guiding models to localize attributes correctly. This approach operates orthogonally to existing consistency mechanisms, integrating seamlessly with current story generation pipelines without requiring architectural modifications. Our experiments demonstrate consistent improvements on incorporating AttriLoss across all baselines. This work positions attribute realization as a distinct, complementary dimension of visual storytelling, alongside character consistency, advancing the field toward fine-grained attribute-controlled story generation. Project-page:https://manogna-s.github.io/attristory/

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 36 of its 42 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

36 of 42 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025One-Prompt-One-Story: Free-Lunch Consistent Text-to-Image Generation Using a Single Prompt23 Jan
  2. 2024ORACLE: Leveraging Mutual Information for Consistent Character Generation with LoRAs in Diffusion Models4 Jun
  3. 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Models24 Apr
  4. 2024Towards Understanding Cross and Self-Attention in Stable Diffusion for Text-Guided Image Editing6 Mar
  5. 2024InstantID: Zero-shot Identity-Preserving Generation in Seconds15 Jan
  6. 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Models16 Nov
  7. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  8. 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Models5 Jul
  9. 2023Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion Models1 Jun
  10. 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
  11. 2022Synthesizing Coherent Story with Auto-Regressive Latent Diffusion Models20 Nov
  12. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
1 more
  1. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May

Other references · 23

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  7. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  8. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  9. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  10. 2025Qwen-Image Technical Reportcited by 1,044
  11. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
  12. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
11 more
  1. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
  2. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
  3. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
  4. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 247
  5. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 231
  6. 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 225
  7. 2024Training-Free Consistent Text-to-Image Generationcited by 125
  8. 2022StoryDALL-E: Adapting Pretrained Text-to-Image Transformers for Story Continuationcited by 74
  9. 2023TaleCrafter: Interactive Story Visualization with Multiple Characterscited by 73
  10. 2024StoryMaker: Towards Holistic Consistent Characters in Text-to-image Generationcited by 29
  11. 2025CharaConsist: Fine-Grained Consistent Character Generationcited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Directing the Narrative: A Finetuning Method for Controlling Coherence and Style in Story Generation
  2. 2025Lay2Story: Extending Diffusion Transformers for Layout-Togglable Story Generation
  3. 2024Evolving Storytelling: Benchmarks and Methods for New Character Customization with Diffusion Models
  4. 2023MagicScroll: Nontypical Aspect-Ratio Image Generation for Visual Storytelling via Multi-Layered Semantic-Aware Denoising
  5. 2025SceneDecorator: Towards Scene-Oriented Story Generation with Scene Planning and Scene Consistency
  6. 2025Plot'n Polish: Zero-shot Story Visualization and Disentangled Editing with Text-to-Image Diffusion Models
  7. 2025Storybooth: Training-free Multi-Subject Consistency for Improved Visual Storytelling
  8. 2025Story2Board: A Training-Free Approach for Expressive Storyboard Generation