CoDi: Subject-Consistent and Pose-Diverse Text-to-Image Generation
Not on the map. Why?
Abstract (arXiv)
Subject-consistent generation (SCG)-aiming to maintain a consistent subject identity across diverse scenes-remains a challenge for text-to-image (T2I) models. Existing training-free SCG methods often achieve consistency at the cost of layout and pose diversity, hindering expressive visual storytelling. To address the limitation, we propose subject-Consistent and pose-Diverse T2I framework, dubbed as CoDi, that enables consistent subject generation with diverse pose and layout. Motivated by the progressive nature of diffusion, where coarse structures emerge early and fine details are refined later, CoDi adopts a two-stage strategy: Identity Transport (IT) and Identity Refinement (IR). IT operates in the early denoising steps, using optimal transport to transfer identity features to each target image in a pose-aware manner. This promotes subject consistency while preserving pose diversity. IR is applied in the later denoising steps, selecting the most salient identity features to further refine subject details. Extensive qualitative and quantitative results on subject consistency, pose diversity, and prompt fidelity demonstrate that CoDi achieves both better visual perception and stronger performance across all metrics. The code is provided in https://github.com/NJU-PCALab/CoDi.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 40 of its 57 references that are in the map. First posted on arXiv 11 Jul 2025.
Builds on
40 of 57 references.
References · 40
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
28 more
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 322
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
- 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 224
- 2023Style Aligned Image Generation via Shared Attentioncited by 214
- 2022ReCo: Region-Controlled Text-to-Image Generationcited by 177
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 153
- 2018StoryGAN: A Sequential Conditional GAN for Story Visualizationcited by 137
- 2024Training-Free Consistent Text-to-Image Generationcited by 123
- 2022Make-A-Story: Visual Memory Conditioned Consistent Story Generationcited by 76
- 2023Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion Modelscited by 76
- 2022StoryDALL-E: Adapting Pretrained Text-to-Image Transformers for Story Continuationcited by 74
- 2024SEED-Story: Multimodal Long Story Generation with Large Language Modelcited by 70
- 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Modelscited by 62
- 2025One-Prompt-One-Story: Free-Lunch Consistent Text-to-Image Generation Using a Single Promptcited by 47
- 2024Exploring Diffusion Time-steps for Unsupervised Representation Learningcited by 36
- 2025Exploring the Limits of Vision-Language-Action Manipulations in Cross-task Generalizationcited by 31
- 2024StyleStudio: Text-Driven Style Transfer with Selective Control of Style Elementscited by 26
- 2025The Power of Context: How Multimodality Improves Image Super-Resolutioncited by 15
- 2025Dynamic Multimodal Prototype Learning in Vision-Language Modelscited by 13
- 2025Panoptic Captioning: An Equivalence Bridge for Image and Textcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026L2P: Unlocking Latent Potential for Pixel Generationcited by 7
- 2026L2P: Unlocking Latent Potential for Pixel Generation12 May 2026