Griffin: Generative Reference and Layout Guided Image Composition
Not on the map. Why?
Abstract (arXiv)
Text-to-image models have achieved a level of realism that enables the generation of highly convincing images. However, text-based control can be a limiting factor when more explicit guidance is needed. Defining both the content and its precise placement within an image is crucial for achieving finer control. In this work, we address the challenge of multi-image layout control, where the desired content is specified through images rather than text, and the model is guided on where to place each element. Our approach is training-free, requires a single image per reference, and provides explicit and simple control for object and part-level composition. We demonstrate its effectiveness across various image composition tasks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 45 of its 58 references that are in the map. First posted on arXiv 28 Sep 2025.
Builds on
45 of 58 references.
References · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
33 more
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 462
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2023Emergent Correspondence from Image Diffusioncited by 437
- 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 297
- 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
- 2023Style Aligned Image Generation via Shared Attentioncited by 214
- 2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondencecited by 211
- 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 193
- 2023Cross-Image Attention for Zero-Shot Appearance Transfercited by 135
- 2023A Neural Space-Time Representation for Text-to-Image Personalizationcited by 123
- 2023Cones 2: Customizable Image Synthesis with Multiple Subjectscited by 101
- 2023Orthogonal Adaptation for Modular Customization of Diffusion Modelscited by 70
- 2024OMG: Occlusion-friendly Personalized Multi-concept Generation in Diffusion Modelscited by 64
- 2024LoRA-Composer: Leveraging Low-Rank Adaptation for Multi-Concept Customization in Training-Free Diffusion Modelscited by 55
- 2025TokenVerse: Versatile Multi-concept Personalization in Token Modulation Spacecited by 51
- 2024Identity Decoupling for Multi-Subject Personalization of Text-to-Image Modelscited by 33
- 2025Nested Attention: Semantic-aware Attention Values for Concept Personalizationcited by 21
- 2024Build-A-Scene: Interactive 3D Layout Control for Diffusion-Based Image Generationcited by 18
- 2023Z^*: Zero-shot Style Transfer via Attention Rearrangementcited by 17
- 2025Object-level Visual Prompts for Compositional Image Generationcited by 14
- 2024Direct Consistency Optimization for Robust Customization of Text-to-Image Diffusion Modelscited by 12
- 2025Multitwine: Multi-Object Compositing with Text and Layout Controlcited by 9
- 2024Generative Photomontagecited by 3
- 2024Skip-and-Play: Depth-Driven Pose-Preserved Image Generation for Any Objectscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.