mlsanityData to 7 Oct 2026

MultiCompose: Multi-Concept Personalized Composition with Per-Subject Attribute Binding

arXiv 2608.03708 ↗First posted 4 Aug 2026cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Text-to-image diffusion models enable personalization of specific visual concepts from a small number of reference images. However, generating a single image that contains multiple personalized subjects, each bound to user-specified attributes such as clothing, accessories, and held objects, remains largely unaddressed. Without explicit spatial constraints, concurrently activated concept checkpoints produce overlapping cross-attention responses, causing per-subject identity degradation and attribute misalignment. Moreover, no established benchmark jointly evaluates these two failure modes in the personalized multi-subject setting. We present MultiCompose, a composition framework that decouples per-concept personalization from multi-subject inference. A semantic preservation regularization maintains attribute binding capacity during fine-tuning, while a two-phase inference procedure automatically establishes subject layout and composes per-concept predictions through spatially exclusive masks. We further introduce MSP-Bench, a benchmark that jointly evaluates identity fidelity (ID), attribute binding accuracy (BIND), and attribute misalignment (MIS) through a dual-pathway protocol. Experiments show that MultiCompose outperforms existing methods on both conventional metrics and MSP-Bench, confirming the benchmark's ability to reveal failure modes that conventional metrics overlook. Code is available at https://github.com/I2-Multimedia-Lab/MultiCompose

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 29 of its 40 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

29 of 40 references.

Closest ancestors · 13

Same direction, newest first

  1. 2024CoMat: Aligning Text-to-Image Diffusion Model with Image-to-Text Concept Matching4 Apr
  2. 2024MuLan: Multimodal-LLM Agent for Progressive and Interactive Multi-Object Diffusion20 Feb
  3. 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs22 Jan
  4. 2023Divide & Bind Your Attention for Improved Generative Semantic Nursing20 Jul
  5. 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusion20 Jul
  6. 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignment15 Jun
  7. 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models29 May
  8. 2023Compositional Text-to-Image Synthesis with Attention Map Control of Diffusion Models23 May
  9. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuning20 Mar
  10. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation16 Feb
  11. 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attention10 Oct
  12. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
1 more
  1. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May

Other references · 16

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  5. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  6. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  7. 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 196
  8. 2023Key-Locked Rank One Editing for Text-to-Image Personalizationcited by 194
  9. 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 142
  10. 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
  11. 2023GPT-4V(ision) as a Generalist Evaluator for Vision-Language Taskscited by 118
  12. 2023Cones 2: Customizable Image Synthesis with Multiple Subjectscited by 101
4 more
  1. 2023Expressive Text-to-Image Generation with Rich Textcited by 89
  2. 2024Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generationcited by 43
  3. 2024TweedieMix: Improving Multi-Concept Fusion for Diffusion-based Image/Video Generationcited by 14
  4. 2025LatexBlend: Scaling Multi-concept Customized Generation with Latent Textual Blendingcited by 10

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025ACCORD: Alleviating Concept Coupling through Dependence Regularization for Text-to-Image Diffusion Personalization
  2. 2026MS-CustomNet: Controllable Multi-Subject Customization with Hierarchical Relational Semantics
  3. 2026CogCanvas: A Benchmark for Evaluating Multi-Subject Reference-Based Image Generation
  4. 2025ComposeMe: Attribute-Specific Image Prompts for Controllable Human Image Generation
  5. 2025Semantic Anchoring for Robust Personalization in Text-to-Image Diffusion Models
  6. 2024Concept Weaver: Enabling Multi-Concept Fusion in Text-to-Image Models
  7. 2026CRAFT: Constrained Reward via Attention Fine-Tuning for Subject Personalization without Composed Targets
  8. 2024Pick-and-Draw: Training-free Semantic Guidance for Text-to-Image Personalization