PureCC: Pure Learning for Text-to-Image Concept Customization
Not on the map. Why?
Abstract (arXiv)
Existing concept customization methods have achieved remarkable outcomes in high-fidelity and multi-concept customization. However, they often neglect the influence on the original model's behavior and capabilities when learning new personalized concepts. To address this issue, we propose PureCC. PureCC introduces a novel decoupled learning objective for concept customization, which combines the implicit guidance of the target concept with the original conditional prediction. This separated form enables PureCC to substantially focus on the original model during training. Moreover, based on this objective, PureCC designs a dual-branch training pipeline that includes a frozen extractor providing purified target concept representations as implicit guidance and a trainable flow model producing the original conditional prediction, jointly achieving pure learning for personalized concepts. Furthermore, PureCC introduces a novel adaptive guidance scale λ^star to dynamically adjust the guidance strength of the target concept, balancing customization fidelity and model preservation. Extensive experiments show that PureCC achieves state-of-the-art performance in preserving the original behavior and capabilities while enabling high-fidelity concept customization. The code is available at https://github.com/lzc-sg/PureCC.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 51 of its 58 references that are in the map. First posted on arXiv 8 Mar 2026.
Builds on
51 of 58 references.
References · 51
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2023Segment Anythingcited by 8,158
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
38 more
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
- 2018Overcoming catastrophic forgetting with hard attention to the taskcited by 672
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
- 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
- 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
- 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 153
- 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 143
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 142
- 2024CFG++: Manifold-constrained Classifier Free Guidance for Diffusion Modelscited by 138
- 2024Implicit Style-Content Separation using B-LoRAcited by 135
- 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 130
- 2024Eliminating Oversaturation and Artifacts of High Guidance Scales in Diffusion Modelscited by 107
- 2024Measuring Style Similarity in Diffusion Modelscited by 106
- 2025DreamO: A Unified Framework for Image Customizationcited by 82
- 2024Multi-LoRA Composition for Image Generationcited by 80
- 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generationcited by 73
- 2024No Training, No Problem: Rethinking Classifier-Free Guidance for Diffusion Modelscited by 52
- 2023TokenCompose: Text-to-Image Diffusion with Token-level Supervisioncited by 40
- 2024LoRA Dropout as a Sparsity Regularizer for Overfitting Controlcited by 35
- 2024How to Continually Adapt Text-to-Image Diffusion Models for Flexible Customization?cited by 32
- 2024Enhancing Semantic Fidelity in Text-to-Image Synthesis: Attention Regulation in Diffusion Modelscited by 27
- 2024AID: Attention Interpolation of Text-to-Image Diffusioncited by 24
- 2024LoRACLR: Contrastive Adaptation for Customization of Diffusion Modelscited by 20
- 2024ClassDiffusion: More Aligned Personalization Tuning with Explicit Class Guidancecited by 18
- 2025HumanAesExpert: Advancing a Multi-Modality Foundation Model for Human Image Aesthetic Assessmentcited by 17
- 2025LoRAShop: Training-Free Multi-Concept Image Generation and Editing with Rectified Flow Transformerscited by 12
- 2024Diversity-Rewarded CFG Distillationcited by 9
- 2024DreamFit: Garment-Centric Human Generation via a Lightweight Anything-Dressing Encodercited by 9
- 2025OmniInsert: Mask-Free Video Insertion of Any Reference via Diffusion Transformer Modelscited by 9
- 2024Freehand Sketch Generation from Mechanical Componentscited by 8
50 most cited of 51 All 51 (JSON)
Built on by
Not cited yet.