S2ED: From Story to Executable Descriptions for Consistency-Aware Story Illustration
Not on the map. Why?
Abstract (arXiv)
Multi-frame story illustration requires long-horizon coherence beyond single-image text-to-image generation, including narrative decomposition and persistent character identity, layout, and affect across frames. We propose Story-to-Executable Descriptions (S2ED), a training-free, model-agnostic, prompt-layer framework that converts a full story into a sequence of explicit, editable executable descriptions for more consistent rendering. S2ED coordinates three agents to segment the narrative, ground canonical character attributes, and enrich spatial and affective cues, enabling interpretable prompt-carried state propagation and local edits to repair drift without retraining the generator. Experiments on Flintstones and Shakoo Maku show that S2ED improves sequence-level consistency and character fidelity over strong prompting, large-model planning, and a reference training-based method, under both automatic metrics and human judgments. We also deploy S2ED in an end-to-end story-to-storybook system for children's illustrated stories, with a supplementary video.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 18 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
18 of 18 references.
References · 18
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2021Grounded Language-Image Pre-trainingcited by 1,156
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 247
- 2022Make-A-Story: Visual Memory Conditioned Consistent Story Generationcited by 76
6 more
- 2022StoryDALL-E: Adapting Pretrained Text-to-Image Transformers for Story Continuationcited by 74
- 2025One-Prompt-One-Story: Free-Lunch Consistent Text-to-Image Generation Using a Single Promptcited by 48
- 2024DreamStory: Open-Domain Story Visualization by LLM-Guided Multi-Subject Consistent Diffusioncited by 47
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Modelscited by 24
- 2024StoryDiffusion: How to Support UX Storyboarding With Generative-AIcited by 2
- 2025Infinite-Story: A Training-Free Consistent Text-to-Image Generationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.