Consistent text-to-image generation via scene de-contextualization
Not on the map. Why?
Abstract (arXiv)
Consistent text-to-image (T2I) generation seeks to produce identity-preserving images of the same subject across diverse scenes, yet it often fails due to a phenomenon called identity (ID) shift. Previous methods have tackled this issue, but typically rely on the unrealistic assumption of knowing all target scenes in advance. This paper reveals that a key source of ID shift is the native correlation between subject and scene context, called scene contextualization, which arises naturally as T2I models fit the training distribution of vast natural images. We formally prove the near-universality of this scene-ID correlation and derive theoretical bounds on its strength. On this basis, we propose a novel, efficient, training-free prompt embedding editing approach, called Scene De-Contextualization (SDeC), that imposes an inversion process of T2I's built-in scene contextualization. Specifically, it identifies and suppresses the latent scene-ID correlation within the ID prompt's embedding by quantifying the SVD directional stability to adaptively re-weight the corresponding eigenvalues. Critically, SDeC allows for per-scene use (one scene per prompt) without requiring prior access to all target scenes. This makes it a highly flexible and general solution well-suited to real-world applications where such prior knowledge is often unavailable or varies over time. Experiments demonstrate that SDeC significantly enhances identity preservation while maintaining scene diversity.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 34 of its 41 references that are in the map. First posted on arXiv 16 Oct 2025.
Builds on
34 of 41 references.
References · 34
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
22 more
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
- 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 345
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 247
- 2020DF-GAN: A Simple and Effective Baseline for Text-to-Image Synthesiscited by 162
- 2024Training-Free Consistent Text-to-Image Generationcited by 125
- 2022Make-A-Story: Visual Memory Conditioned Consistent Story Generationcited by 76
- 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Modelscited by 63
- 2024ViewDiff: 3D-Consistent Image Generation with Text-to-Image Modelscited by 57
- 2023Source-Free Domain Adaptation with Frozen Multimodal Foundation Modelcited by 55
- 2024JeDi: Joint-Image Diffusion Models for Finetuning-Free Personalized Text-to-Image Generationcited by 52
- 2025One-Prompt-One-Story: Free-Lunch Consistent Text-to-Image Generation Using a Single Promptcited by 48
- 2024Diffusion Self-Distillation for Zero-Shot Customized Image Generationcited by 47
- 2024AnimateAnything: Consistent and Controllable Animation for Video Generationcited by 35
- 2024A Survey on Personalized Content Synthesis with Diffusion Modelscited by 29
- 2024StoryImager: A Unified and Efficient Framework for Coherent Story Visualization and Completioncited by 20
- 2024U-VAP: User-specified Visual Appearance Personalization via Decoupled Self Augmentationcited by 7
- 2024ORACLE: Leveraging Mutual Information for Consistent Character Generation with LoRAs in Diffusion Modelscited by 7
- 2025Personalized Text-to-Image Generation with Auto-Regressive Modelscited by 6
- 2025CoCoIns: Consistent Subject Generation via Contrastive Instantiated Conceptscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.