Audit & Repair: An Agentic Framework for Consistent Story Visualization in Text-to-Image Diffusion Models
On the map: Diffusion models → Image generation, text-to-image and editing
also in 1 more
Abstract (arXiv)
Story visualization has become a popular task where visual scenes are generated to depict a narrative across multiple panels. A central challenge in this setting is maintaining visual consistency, particularly in how characters and objects persist and evolve throughout the story. Despite recent advances in diffusion models, current approaches often fail to preserve key character attributes, leading to incoherent narratives. In this work, we propose a collaborative multi-agent framework that autonomously identifies, corrects, and refines inconsistencies across multi-panel story visualizations. The agents operate in an iterative loop, enabling fine-grained, panel-level updates without re-generating entire sequences. Our framework is model-agnostic and flexibly integrates with a variety of diffusion models, including rectified flow transformers such as Flux and latent diffusion models such as Stable Diffusion. Quantitative and qualitative experiments show that our method outperforms prior approaches in terms of multi-panel consistency.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 35 of its 40 references that are in the map. First posted on arXiv 23 Jun 2025.
Builds on
35 of 40 references.
Closest ancestors · 7
Same direction, newest first
- 2025One-Prompt-One-Story: Free-Lunch Consistent Text-to-Image Generation Using a Single Prompt23 Jan
- 2024Diffusion Self-Distillation for Zero-Shot Customized Image Generation27 Nov
- 2023Self-correcting LLM-controlled Diffusion Models27 Nov
- 2023Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion Models1 Jun
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
Other references · 28
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Segment Anythingcited by 8,234
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Generative Adversarial Networkscited by 5,627
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
16 more
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 668
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 247
- 2018StoryGAN: A Sequential Conditional GAN for Story Visualizationcited by 138
- 2024Training-Free Consistent Text-to-Image Generationcited by 125
- 2022Make-A-Story: Visual Memory Conditioned Consistent Story Generationcited by 76
- 2023TaleCrafter: Interactive Story Visualization with Multiple Characterscited by 73
- 2024SEED-Story: Multimodal Long Story Generation with Large Language Modelcited by 73
- 2022UnifiedQA-v2: Stronger Generalization via Broader Cross-Format Trainingcited by 57
- 2023AutoStory: Generating Diverse Storytelling Images with Minimal Human Effortcited by 38
- 2024StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaborationcited by 31
- 2024StoryImager: A Unified and Efficient Framework for Coherent Story Visualization and Completioncited by 20
- 2024AutoStudio: Crafting Consistent Subjects in Multi-turn Interactive Image Generationcited by 20
- 2024Self-Correcting Text-to-Video Generation with Misalignment Detection and Localized Refinementcited by 14
- 2024MUSES: 3D-Controllable Image Generation via Multi-Modal Agent Collaborationcited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LogiStory: A Logic-Aware Framework for Multi-Image Story Visualization
- 2024Boosting Consistency in Story Visualization with Rich-Contextual Conditional Diffusion Models
- 2025VisAgent: Narrative-Preserving Story Visualization Framework
- 2025Plot'n Polish: Zero-shot Story Visualization and Disentangled Editing with Text-to-Image Diffusion Models
- 2026CANVAS: Continuity-Aware Narratives via Visual Agentic Storyboarding
- 2024Story3D-Agent: Exploring 3D Storytelling Visualization with Large Language Models
- 2024DreamStory: Open-Domain Story Visualization by LLM-Guided Multi-Subject Consistent Diffusion
- 2023Improved Visual Story Generation with Adaptive Context Modeling