mlsanityData to 14 Oct 2026

Audit & Repair: An Agentic Framework for Consistent Story Visualization in Text-to-Image Diffusion Models

arXiv 2506.18900 ↗First posted 23 Jun 2025cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

also in 1 more
Abstract (arXiv)

Story visualization has become a popular task where visual scenes are generated to depict a narrative across multiple panels. A central challenge in this setting is maintaining visual consistency, particularly in how characters and objects persist and evolve throughout the story. Despite recent advances in diffusion models, current approaches often fail to preserve key character attributes, leading to incoherent narratives. In this work, we propose a collaborative multi-agent framework that autonomously identifies, corrects, and refines inconsistencies across multi-panel story visualizations. The agents operate in an iterative loop, enabling fine-grained, panel-level updates without re-generating entire sequences. Our framework is model-agnostic and flexibly integrates with a variety of diffusion models, including rectified flow transformers such as Flux and latent diffusion models such as Stable Diffusion. Quantitative and qualitative experiments show that our method outperforms prior approaches in terms of multi-panel consistency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 35 of its 40 references that are in the map. First posted on arXiv 23 Jun 2025.

Builds on

35 of 40 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025One-Prompt-One-Story: Free-Lunch Consistent Text-to-Image Generation Using a Single Prompt23 Jan
  2. 2024Diffusion Self-Distillation for Zero-Shot Customized Image Generation27 Nov
  3. 2023Self-correcting LLM-controlled Diffusion Models27 Nov
  4. 2023Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion Models1 Jun
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr

Other references · 28

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  7. 2023Segment Anythingcited by 8,234
  8. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  9. 2022Generative Adversarial Networkscited by 5,627
  10. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  11. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  12. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
16 more
  1. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
  2. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 668
  3. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
  4. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 247
  5. 2018StoryGAN: A Sequential Conditional GAN for Story Visualizationcited by 138
  6. 2024Training-Free Consistent Text-to-Image Generationcited by 125
  7. 2022Make-A-Story: Visual Memory Conditioned Consistent Story Generationcited by 76
  8. 2023TaleCrafter: Interactive Story Visualization with Multiple Characterscited by 73
  9. 2024SEED-Story: Multimodal Long Story Generation with Large Language Modelcited by 73
  10. 2022UnifiedQA-v2: Stronger Generalization via Broader Cross-Format Trainingcited by 57
  11. 2023AutoStory: Generating Diverse Storytelling Images with Minimal Human Effortcited by 38
  12. 2024StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaborationcited by 31
  13. 2024StoryImager: A Unified and Efficient Framework for Coherent Story Visualization and Completioncited by 20
  14. 2024AutoStudio: Crafting Consistent Subjects in Multi-turn Interactive Image Generationcited by 20
  15. 2024Self-Correcting Text-to-Video Generation with Misalignment Detection and Localized Refinementcited by 14
  16. 2024MUSES: 3D-Controllable Image Generation via Multi-Modal Agent Collaborationcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026LogiStory: A Logic-Aware Framework for Multi-Image Story Visualization
  2. 2024Boosting Consistency in Story Visualization with Rich-Contextual Conditional Diffusion Models
  3. 2025VisAgent: Narrative-Preserving Story Visualization Framework
  4. 2025Plot'n Polish: Zero-shot Story Visualization and Disentangled Editing with Text-to-Image Diffusion Models
  5. 2026CANVAS: Continuity-Aware Narratives via Visual Agentic Storyboarding
  6. 2024Story3D-Agent: Exploring 3D Storytelling Visualization with Large Language Models
  7. 2024DreamStory: Open-Domain Story Visualization by LLM-Guided Multi-Subject Consistent Diffusion
  8. 2023Improved Visual Story Generation with Adaptive Context Modeling