LAMIC: Layout-Aware Multi-Image Composition via Scalability of Multimodal Diffusion Transformer
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
In controllable image synthesis, generating coherent and consistent images from multiple references with spatial layout awareness remains an open challenge. We present LAMIC, a Layout-Aware Multi-Image Composition framework that, for the first time, extends single-reference diffusion models to multi-reference scenarios in a training-free manner. Built upon the MMDiT model, LAMIC introduces two plug-and-play attention mechanisms: 1) Group Isolation Attention (GIA) to enhance entity disentanglement; and 2) Region-Modulated Attention (RMA) to enable layout-aware generation. To comprehensively evaluate model capabilities, we further introduce three metrics: 1) Inclusion Ratio (IN-R) and Fill Ratio (FI-R) for assessing layout control; and 2) Background Similarity (BG-S) for measuring background consistency. Extensive experiments show that LAMIC achieves state-of-the-art performance across most major metrics: it consistently outperforms existing multi-reference baselines in ID-S, BG-S, IN-R and AVG scores across all settings, and achieves the best DPG in complex composition tasks. These results demonstrate LAMIC's superior abilities in identity keeping, background preservation, layout control, and prompt-following, all achieved without any training or fine-tuning, showcasing strong zero-shot generalization ability. By inheriting the strengths of advanced single-reference models and enabling seamless extension to multi-image scenarios, LAMIC establishes a new training-free paradigm for controllable multi-image composition. As foundation models continue to evolve, LAMIC's performance is expected to scale accordingly. Our implementation is available at: https://github.com/Suchenl/LAMIC.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 24 of its 29 references that are in the map. First posted on arXiv 1 Aug 2025.
Builds on
24 of 29 references.
Closest ancestors · 8
Same direction, newest first
- 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulation26 Jun
- 2025OminiControl2: Efficient Conditioning for Diffusion Transformers11 Mar
- 2025EliGen: Entity-Level Controlled Image Generation with Regional Attention2 Jan
- 2024OmniGen: Unified Image Generation17 Sep
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment8 Mar
- 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs22 Jan
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
Other references · 16
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 144
- 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
4 more
- 2025DreamO: A Unified Framework for Image Customizationcited by 83
- 2025Captain Cinema: Towards Short Movie Generationcited by 48
- 2024Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generationcited by 43
- 2024Region-Aware Text-to-Image Generation via Hard Binding and Soft Refinementcited by 37
Built on by
Citing papers per year: 2025: 2; 2026: 5.
7 papers.
- 2025ContextGen: Contextual Layout Anchoring for Identity-Consistent Multi-Instance Generationcited by 18
- 2025MICo-150K: A Comprehensive Dataset Advancing Multi-Image Compositioncited by 10
- 2026MetaPoint: Unlocking Precise Spatial Control in Agentic Visual Generationcited by 4
- 2026Spatial Chain-of-Thought: Bridging Understanding and Generation Models for Spatial Reasoning Generationcited by 2
- 2026Layout-Guided Controllable Pathology Image Generation with In-Context Diffusion Transformerscited by 0
- 2026Squeezing Capacity from Multimodal Large Language Models for Subject-driven Generationcited by 0
- 2026ControlRef: Efficient Layout-Guided Multi-Instance Generation via Anchored 4D-RoPEcited by 0
- 2026ControlRef: Efficient Layout-Guided Multi-Instance Generation via Anchored 4D-RoPE7 Aug 2026
- 2026MetaPoint: Unlocking Precise Spatial Control in Agentic Visual Generation3 Jun 2026
- 2026Squeezing Capacity from Multimodal Large Language Models for Subject-driven Generation25 May 2026
- 2026Layout-Guided Controllable Pathology Image Generation with In-Context Diffusion Transformers11 Mar 2026
- 2026Spatial Chain-of-Thought: Bridging Understanding and Generation Models for Spatial Reasoning Generation12 Feb 2026
- 2025MICo-150K: A Comprehensive Dataset Advancing Multi-Image Composition8 Dec 2025
- 2025ContextGen: Contextual Layout Anchoring for Identity-Consistent Multi-Instance Generation13 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025STAY Diffusion: Styled Layout Diffusion Model for Diverse Layout-to-Image Generation
- 2025UniLayDiff: A Unified Diffusion Transformer for Content-Aware Layout Generation
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation
- 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generation
- 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis
- 2024LayoutDiT: Exploring Content-Graphic Balance in Layout Generation with Diffusion Transformer
- 2024Training-free Composite Scene Generation for Layout-to-Image Synthesis
- 2024Training-Free Layout-to-Image Generation with Marginal Attention Constraints