mlsanityData to 7 Oct 2026

ASemConsist: Adaptive Semantic Feature Control for Training-Free Identity-Consistent Generation

arXiv 2512.23245 ↗First posted 29 Dec 2025cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Recent text-to-image diffusion models have significantly improved visual quality and text alignment. However, generating a sequence of images while preserving consistent character identity across diverse scenes remains challenging. Existing methods often face a trade-off between maintaining identity consistency and per-image prompt alignment. In this paper, we introduce AsemConsist, a framework that resolves this trade-off through selective text embedding modification, enabling consistent identity preservation without degrading per-image prompt alignment. We further analyze the semantic structure of padding embeddings and find that, in multi-encoder backbones, only padding embeddings that retain prompt-related semantics can effectively serve as semantic containers. Based on this observation, we selectively inject per-image semantics into such padding embeddings while suppressing prompt-irrelevant components. Additionally, we propose an adaptive feature-sharing strategy that automatically evaluates identity specificity and selectively applies constraints only to ambiguous identity prompts. Finally, we propose a unified evaluation metric called SeeSaw, which measures the balance between identity consistency and per-image alignment while evaluating whether identity and per-image prompts are equally reflected in generated images. Our method demonstrates superior performance over existing competitors when built upon SD3.5 and FLUX backbones, highlighting its effectiveness across different architectures and text encoders. Project page: https://minjung-s.github.io/asemconsist

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 41 of its 54 references that are in the map. First posted on arXiv 29 Dec 2025.

Builds on

41 of 54 references.

Closest ancestors · 14

Same direction, newest first

  1. 2025Exploring Multimodal Diffusion Transformers for Enhanced Prompt-based Image Editing11 Aug
  2. 2025ReFlex: Text-Guided Editing of Real Images in Rectified Flow via Mid-Step Feature Extraction and Attention Adaptation2 Jul
  3. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
  4. 2025One-Prompt-One-Story: Free-Lunch Consistent Text-to-Image Generation Using a Single Prompt23 Jan
  5. 2025Padding Tone: A Mechanistic Analysis of Padding Tokens in T2I Models12 Jan
  6. 2024Text Embedding is Not All You Need: Attention Control for Text-to-Image Semantic Alignment with Text Self-Attention Maps21 Nov
  7. 2024Stable Flow: Vital Layers for Training-Free Image Editing21 Nov
  8. 2024Improving Long-Text Alignment for Text-to-Image Diffusion Models15 Oct
  9. 2024OmniGen: Unified Image Generation17 Sep
  10. 2024Get What You Want, Not What You Don't: Image Content Suppression for Text-to-Image Diffusion Models8 Feb
  11. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  12. 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignment15 Jun
2 more
  1. 2023Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion Models1 Jun
  2. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models31 Jan

Other references · 27

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  5. 2025Qwen2.5-VL Technical Reportcited by 5,418
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  8. 2025Qwen3-VL Technical Reportcited by 2,534
  9. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  10. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
  11. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
  12. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
15 more
  1. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
  2. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
  3. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 322
  4. 2019Representation Degeneration Problem in Training Natural Language Generation Modelscited by 250
  5. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
  6. 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 143
  7. 2024Training-Free Consistent Text-to-Image Generationcited by 123
  8. 2025UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokenscited by 55
  9. 2023StoryGPT-V: Large Language Models as Consistent Story Visualizerscited by 25
  10. 2025CharaConsist: Fine-Grained Consistent Character Generationcited by 18
  11. 2025Story2Board: A Training-Free Approach for Expressive Storyboard Generationcited by 16
  12. 2025UniSync: A Unified Framework for Audio-Visual Synchronizationcited by 6
  13. 2025FairyGen: Storied Cartoon Video from a Single Child-Drawn Charactercited by 4
  14. 2025Consistent Story Generation: Unlocking the Potential of Zigzag Samplingcited by 2
  15. 2025MVCustom: Multi-View Customized Diffusion via Geometric Latent Rendering and Completioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Infinite-ID: Identity-preserved Personalization via ID-semantics Decoupling Paradigm
  2. 2024AlignIT: Enhancing Prompt Alignment in Customization of Text-to-Image Models
  3. 2025Identity-Preserving Text-to-Video Generation via Training-Free Prompt, Image, and Guidance Enhancement
  4. 2024ID-Aligner: Enhancing Identity-Preserving Text-to-Image Generation with Reward Feedback Learning
  5. 2025CharCom: Composable Identity Control for Multi-Character Story Illustration
  6. 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Models
  7. 2024Beyond Inserting: Learning Identity Embedding for Semantic-Fidelity Personalized Diffusion Generation
  8. 2023When StyleGAN Meets Stable Diffusion: a mathscrW_+ Adapter for Personalized Image Generation