mlsanityData to 14 Oct 2026

MC2: Multi-concept Guidance for Customized Multi-concept Generation

arXiv 2404.05268 ↗First posted 8 Apr 2024cs.CVcited by 26

Not on the map. Why?

Abstract (arXiv)

Customized text-to-image generation, which synthesizes images based on user-specified concepts, has made significant progress in handling individual concepts. However, when extended to multiple concepts, existing methods often struggle with properly integrating different models and avoiding the unintended blending of characteristics from distinct concepts. In this paper, we propose MC2, a novel approach for multi-concept customization that enhances flexibility and fidelity through inference-time optimization. MC2 enables the integration of multiple single-concept models with heterogeneous architectures. By adaptively refining attention weights between visual and textual tokens, our method ensures that image regions accurately correspond to their associated concepts while minimizing interference between concepts. Extensive experiments demonstrate that MC2 outperforms training-based methods in terms of prompt-reference alignment. Furthermore, MC2 can be seamlessly applied to text-to-image generation, providing robust compositional capabilities. To facilitate the evaluation of multi-concept customization, we also introduce a new benchmark, MC++. The code will be publicly available at https://github.com/JIANGJiaXiu/MC-2.

Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 53 of its 64 references that are in the map. First posted on arXiv 8 Apr 2024.

Builds on

53 of 64 references.

References · 53

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2023Segment Anythingcited by 8,234
  7. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  10. 2022Classifier-Free Diffusion Guidancecited by 5,847
  11. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  12. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
38 more
  1. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  2. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  3. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  4. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  5. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
  6. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  7. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
  8. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
  9. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
  10. 2023Universal Guidance for Diffusion Modelscited by 437
  11. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
  12. 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 388
  13. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
  14. 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 327
  15. 2023Training-Free Layout Control with Cross-Attention Guidancecited by 313
  16. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
  17. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
  18. 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
  19. 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attentioncited by 236
  20. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 231
  21. 2023Key-Locked Rank One Editing for Text-to-Image Personalizationcited by 194
  22. 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
  23. 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignmentcited by 171
  24. 2023Dense Text-to-Image Generation with Attention Modulationcited by 163
  25. 2022Improving Sample Quality of Diffusion Models Using Self-Attention Guidancecited by 154
  26. 2023Cones: Concept Neurons in Diffusion Models for Customized Generationcited by 150
  27. 2023Cones 2: Customizable Image Synthesis with Multiple Subjectscited by 101
  28. 2023Expressive Text-to-Image Generation with Rich Textcited by 89
  29. 2023Divide & Bind Your Attention for Improved Generative Semantic Nursingcited by 81
  30. 2024Multi-LoRA Composition for Image Generationcited by 80
  31. 2023A-STAR: Test-time Attention Segregation and Retention for Text-to-image Synthesiscited by 78
  32. 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjectscited by 77
  33. 2023Orthogonal Adaptation for Modular Customization of Diffusion Modelscited by 70
  34. 2024DreamMatcher: Appearance Matching Self-Attention for Semantically-Consistent Text-to-Image Personalizationcited by 60
  35. 2023CONFORM: Contrast is All You Need For High-Fidelity Text-to-Image Diffusion Modelscited by 54
  36. 2023TokenCompose: Text-to-Image Diffusion with Token-level Supervisioncited by 40
  37. 2023Ref-Diff: Zero-shot Referring Image Segmentation with Generative Modelscited by 33
  38. 2023An Image is Worth Multiple Words: Multi-attribute Inversion for Constrained Text-to-Image Synthesiscited by 31

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 7; 2025: 12; 2026: 7.

26 papers.

Sort:

By area:

  1. 2025K-LoRA: Unlocking Training-Free Fusion of Any Subject and Style LoRAscited by 48
  2. 2024Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generationcited by 43
  3. 2024A Survey on Personalized Content Synthesis with Diffusion Modelscited by 29
  4. 2025Personalize Anything for Free with Diffusion Transformercited by 23
  5. 2025Personalized Image Generation with Deep Generative Models: A Decade Surveycited by 20
  6. 2024PatchDPO: Patch-level DPO for Finetuning-free Personalized Image Generationcited by 18
  7. 2025Mod-Adapter: Tuning-Free and Versatile Multi-concept Personalization via Modulation Adaptercited by 13
  8. 2024Text Embedding is Not All You Need: Attention Control for Text-to-Image Semantic Alignment with Text Self-Attention Mapscited by 12
  9. 2024AttnDreamBooth: Towards Text-Aligned Personalized Text-to-Image Generationcited by 10
  10. 2025LatexBlend: Scaling Multi-concept Customized Generation with Latent Textual Blendingcited by 10
  11. 2025MultLFG: Training-free Multi-LoRA composition using Frequency-domain Guidancecited by 6
  12. 2024VitaGlyph: Vitalizing Artistic Typography with Flexible Dual-branch Diffusion Modelscited by 4
14 more
  1. 2026ActErase: A Training-Free Paradigm for Precise Concept Erasure via Activation Redirectioncited by 4
  2. 2024Multi LoRA Meets Vision: Merging multiple adapters to create a multi task modelcited by 3
  3. 2026Stroke of Surprise: Progressive Semantic Illusions in Vector Sketchingcited by 3
  4. 2025Dynamic Image Prompt Adapter for Scalable Zero-shot Personalized Text-to-Image Generationcited by 1
  5. 2025Dominant vs. Dominated: Concept-Level Generative Collapse in Diffusion Modelscited by 1
  6. 2025AnyMS: Bottom-up Attention Decoupling for Layout-guided and Training-free Multi-subject Customizationcited by 1
  7. 2026Generative Phomosaic with Structure-Aligned and Personalized Diffusioncited by 1
  8. 2025FreeFuse: Multi-Subject LoRA Fusion via Adaptive Token-Level Routing at Test Timecited by 0
  9. 2025NP-LoRA: Null Space Projection for Subject-Style LoRA Fusioncited by 0
  10. 2025Training for Identity, Inference for Controllability: A Unified Approach to Tuning-Free Face Personalizationcited by 0
  11. 2026Dynamic Training-Free Fusion of Subject and Style LoRAscited by 0
  12. 2026EvoTale: Continual Character Customization for Expanding Story Worldscited by 0
  13. 2026RAVA: Retrieval-Augmented Viewpoint Alignment for Subject-Driven Image Generationcited by 0
  14. 2026DeCo: Zero-Shot Industrial Anomaly Generation through Decoupling and Recouplingcited by 0