MultiCompose: Multi-Concept Personalized Composition with Per-Subject Attribute Binding
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Text-to-image diffusion models enable personalization of specific visual concepts from a small number of reference images. However, generating a single image that contains multiple personalized subjects, each bound to user-specified attributes such as clothing, accessories, and held objects, remains largely unaddressed. Without explicit spatial constraints, concurrently activated concept checkpoints produce overlapping cross-attention responses, causing per-subject identity degradation and attribute misalignment. Moreover, no established benchmark jointly evaluates these two failure modes in the personalized multi-subject setting. We present MultiCompose, a composition framework that decouples per-concept personalization from multi-subject inference. A semantic preservation regularization maintains attribute binding capacity during fine-tuning, while a two-phase inference procedure automatically establishes subject layout and composes per-concept predictions through spatially exclusive masks. We further introduce MSP-Bench, a benchmark that jointly evaluates identity fidelity (ID), attribute binding accuracy (BIND), and attribute misalignment (MIS) through a dual-pathway protocol. Experiments show that MultiCompose outperforms existing methods on both conventional metrics and MSP-Bench, confirming the benchmark's ability to reveal failure modes that conventional metrics overlook. Code is available at https://github.com/I2-Multimedia-Lab/MultiCompose
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 29 of its 40 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
29 of 40 references.
Closest ancestors · 13
Same direction, newest first
- 2024CoMat: Aligning Text-to-Image Diffusion Model with Image-to-Text Concept Matching4 Apr
- 2024MuLan: Multimodal-LLM Agent for Progressive and Interactive Multi-Object Diffusion20 Feb
- 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs22 Jan
- 2023Divide & Bind Your Attention for Improved Generative Semantic Nursing20 Jul
- 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusion20 Jul
- 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignment15 Jun
- 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models29 May
- 2023Compositional Text-to-Image Synthesis with Attention Map Control of Diffusion Models23 May
- 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuning20 Mar
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation16 Feb
- 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attention10 Oct
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
Other references · 16
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 196
- 2023Key-Locked Rank One Editing for Text-to-Image Personalizationcited by 194
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 142
- 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
- 2023GPT-4V(ision) as a Generalist Evaluator for Vision-Language Taskscited by 118
- 2023Cones 2: Customizable Image Synthesis with Multiple Subjectscited by 101
4 more
- 2023Expressive Text-to-Image Generation with Rich Textcited by 89
- 2024Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generationcited by 43
- 2024TweedieMix: Improving Multi-Concept Fusion for Diffusion-based Image/Video Generationcited by 14
- 2025LatexBlend: Scaling Multi-concept Customized Generation with Latent Textual Blendingcited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025ACCORD: Alleviating Concept Coupling through Dependence Regularization for Text-to-Image Diffusion Personalization
- 2026MS-CustomNet: Controllable Multi-Subject Customization with Hierarchical Relational Semantics
- 2026CogCanvas: A Benchmark for Evaluating Multi-Subject Reference-Based Image Generation
- 2025ComposeMe: Attribute-Specific Image Prompts for Controllable Human Image Generation
- 2025Semantic Anchoring for Robust Personalization in Text-to-Image Diffusion Models
- 2024Concept Weaver: Enabling Multi-Concept Fusion in Text-to-Image Models
- 2026CRAFT: Constrained Reward via Attention Fine-Tuning for Subject Personalization without Composed Targets
- 2024Pick-and-Draw: Training-free Semantic Guidance for Text-to-Image Personalization