Create Anything Anywhere: Layout-Controllable Personalized Diffusion Model for Multiple Subjects
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Diffusion models have significantly advanced text-to-image generation, laying the foundation for the development of personalized generative frameworks. However, existing methods lack precise layout controllability and overlook the potential of dynamic features of reference subjects in improving fidelity. In this work, we propose Layout-Controllable Personalized Diffusion (LCP-Diffusion) model, a novel framework that integrates subject identity preservation with flexible layout guidance in a tuning-free approach. Our model employs a Dynamic-Static Complementary Visual Refining module to comprehensively capture the intricate details of reference subjects, and introduces a Dual Layout Control mechanism to enforce robust spatial control across both training and inference stages. Extensive experiments validate that LCP-Diffusion excels in both identity preservation and layout controllability. To the best of our knowledge, this is a pioneering work enabling users to "create anything anywhere".
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 28 of its 28 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
28 of 28 references.
Closest ancestors · 10
Same direction, newest first
- 2024MoMA: Multimodal LLM Adapter for Fast Personalized Image Generation8 Apr
- 2024λ-ECLIPSE: Multi-Concept Personalized Text-to-Image Diffusion Models by Leveraging CLIP Latent Space7 Feb
- 2024InstanceDiffusion: Instance-level Control for Image Generation5 Feb
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
- 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusion20 Jul
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation30 Mar
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generation17 Jan
- 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
Other references · 18
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 864
- 2018The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scalecited by 544
- 2023Generative Multimodal Models are In-Context Learnerscited by 446
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
- 2023Training-Free Layout Control with Cross-Attention Guidancecited by 313
6 more
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 144
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 143
- 2023Kosmos-G: Generating Images in Context with Multimodal Large Language Modelscited by 105
- 2024LW-DETR: A Transformer Replacement to YOLO for Real-Time Detectioncited by 36
- 2024TRIP: Temporal Residual Learning with Image Noise Prior for Image-to-Video Diffusion Modelscited by 31
- 2025MotionPro: A Precise Motion Controller for Image-to-Video Generationcited by 30
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025SMRABooth: Subject and Motion Representation Alignment for Customized Video Generationcited by 10
- 2026AnyPhoto: Multi-Person Identity Preserving Image Generation with ID Adaptive Modulation on Location Canvascited by 0
- 2026Disco-LoRA: Disentangled Composition of Content, Style, and Motion for Multi-concept Video Customizationcited by 0
- 2026Disco-LoRA: Disentangled Composition of Content, Style, and Motion for Multi-concept Video Customization25 Jun 2026
- 2026AnyPhoto: Multi-Person Identity Preserving Image Generation with ID Adaptive Modulation on Location Canvas16 Mar 2026
- 2025SMRABooth: Subject and Motion Representation Alignment for Customized Video Generation13 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025ContextGen: Contextual Layout Anchoring for Identity-Consistent Multi-Instance Generation
- 2025A Two-Stage System for Layout-Controlled Image Generation using Large Language Models and Diffusion Models
- 2025Personalize Anything for Free with Diffusion Transformer
- 2023Generate Anything Anywhere in Any Scene
- 2023Continuous Layout Editing of Single Images with Diffusion Models
- 2024Pick-and-Draw: Training-free Semantic Guidance for Text-to-Image Personalization
- 2023When StyleGAN Meets Stable Diffusion: a mathscrW_+ Adapter for Personalized Image Generation
- 2024Layout Control and Semantic Guidance with Attention Loss Backward for T2I Diffusion Model