mlsanityData to 14 Oct 2026

Decomposing Subject-Driven Image Generation via Intermediate Structural Prediction

arXiv 2605.20807 ↗First posted 20 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Subject-driven text-to-image generation still struggles to preserve high-frequency identity details such as logos, patterns, and text. Existing methods typically operate directly in RGB space, which often leads to detail degradation under substantial edits. We propose a two-stage framework that decouples structure from appearance by first predicting a Canny map and then rendering the final image conditioned on both the source appearance and the predicted structure. To improve text handling, we further introduce a fully automatic pipeline that constructs a 100k-pair text-aware dataset with cross-view textual consistency. Experiments, including GPT-4.1-based evaluation and a knowledge distillation study, show clear gains over selected baselines and suggest that intermediate structural prediction is an effective route for high-fidelity subject-driven generation. Our dataset and code will be made publicly available.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 31 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

26 of 31 references.

References · 26

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2022Scalable Diffusion Models with Transformerscited by 6,054
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  6. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  7. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  8. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  9. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  10. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  11. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  12. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
14 more
  1. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
  2. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
  3. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
  4. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
  5. 2023TextDiffuser: Diffusion Models as Text Painterscited by 229
  6. 2025Seedream 3.0 Technical Reportcited by 154
  7. 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 143
  8. 2023Prodigy: An Expeditiously Adaptive Parameter-Free Learnercited by 133
  9. 2021CarveMix: A Simple Data Augmentation Method for Brain Lesion Segmentationcited by 30
  10. 2024DreamDA: Generative Data Augmentation with Diffusion Modelscited by 24
  11. 2026Leveraging Verifier-Based Reinforcement Learning in Image Editingcited by 9
  12. 2024Real-time One-Step Diffusion-based Expressive Portrait Videos Generationcited by 6
  13. 2024Real-time Identity Defenses against Malicious Personalization of Diffusion Modelscited by 5
  14. 2024LaMamba-Diff: Linear-Time High-Fidelity Diffusion Models Based on Local Attention and Mambacited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Setting the Stage: Text-Driven Scene-Consistent Image Generation
  2. 2026Disentangling to Re-couple: Resolving the Similarity-Controllability Paradox in Subject-Driven Text-to-Image Generation
  3. 2026InsightTok: Improving Text and Face Fidelity in Discrete Tokenization for Autoregressive Image Generation
  4. 2026Intermediate Text Representation Guided Text-to-Image Generation for Enhancing One-and-Only Alignment
  5. 2024ArtiFade: Learning to Generate High-quality Subject from Blemished Images
  6. 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuning
  7. 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generation
  8. 2024TypeScore: A Text Fidelity Metric for Text-to-Image Generative Models