mlsanityData to 14 Oct 2026

LAMIC: Layout-Aware Multi-Image Composition via Scalability of Multimodal Diffusion Transformer

arXiv 2508.00477 ↗First posted 1 Aug 2025cs.CVcited by 7

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

In controllable image synthesis, generating coherent and consistent images from multiple references with spatial layout awareness remains an open challenge. We present LAMIC, a Layout-Aware Multi-Image Composition framework that, for the first time, extends single-reference diffusion models to multi-reference scenarios in a training-free manner. Built upon the MMDiT model, LAMIC introduces two plug-and-play attention mechanisms: 1) Group Isolation Attention (GIA) to enhance entity disentanglement; and 2) Region-Modulated Attention (RMA) to enable layout-aware generation. To comprehensively evaluate model capabilities, we further introduce three metrics: 1) Inclusion Ratio (IN-R) and Fill Ratio (FI-R) for assessing layout control; and 2) Background Similarity (BG-S) for measuring background consistency. Extensive experiments show that LAMIC achieves state-of-the-art performance across most major metrics: it consistently outperforms existing multi-reference baselines in ID-S, BG-S, IN-R and AVG scores across all settings, and achieves the best DPG in complex composition tasks. These results demonstrate LAMIC's superior abilities in identity keeping, background preservation, layout control, and prompt-following, all achieved without any training or fine-tuning, showcasing strong zero-shot generalization ability. By inheriting the strengths of advanced single-reference models and enabling seamless extension to multi-image scenarios, LAMIC establishes a new training-free paradigm for controllable multi-image composition. As foundation models continue to evolve, LAMIC's performance is expected to scale accordingly. Our implementation is available at: https://github.com/Suchenl/LAMIC.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 24 of its 29 references that are in the map. First posted on arXiv 1 Aug 2025.

Builds on

24 of 29 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulation26 Jun
  2. 2025OminiControl2: Efficient Conditioning for Diffusion Transformers11 Mar
  3. 2025EliGen: Entity-Level Controlled Image Generation with Regional Attention2 Jan
  4. 2024OmniGen: Unified Image Generation17 Sep
  5. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment8 Mar
  6. 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs22 Jan
  7. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
  8. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug

Other references · 16

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  7. 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
  8. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
  9. 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
  10. 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 144
  11. 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
  12. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
4 more
  1. 2025DreamO: A Unified Framework for Image Customizationcited by 83
  2. 2025Captain Cinema: Towards Short Movie Generationcited by 48
  3. 2024Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generationcited by 43
  4. 2024Region-Aware Text-to-Image Generation via Hard Binding and Soft Refinementcited by 37

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 5.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025STAY Diffusion: Styled Layout Diffusion Model for Diverse Layout-to-Image Generation
  2. 2025UniLayDiff: A Unified Diffusion Transformer for Content-Aware Layout Generation
  3. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation
  4. 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generation
  5. 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis
  6. 2024LayoutDiT: Exploring Content-Graphic Balance in Layout Generation with Diffusion Transformer
  7. 2024Training-free Composite Scene Generation for Layout-to-Image Synthesis
  8. 2024Training-Free Layout-to-Image Generation with Marginal Attention Constraints