mlsanityData to 7 Oct 2026

GroundingBooth: Grounding Text-to-Image Customization

arXiv 2409.08520 ↗First posted 13 Sep 2024cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

Recent approaches in text-to-image customization have primarily focused on preserving the identity of the input subject, but often fail to control the spatial location and size of objects. We introduce GroundingBooth, which achieves zero-shot, instance-level spatial grounding on both foreground subjects and background objects in the text-to-image customization task. Our proposed grounding module and subject-grounded cross-attention layer enable the creation of personalized images with accurate layout alignment, identity preservation, and strong text-image coherence. In addition, our model seamlessly supports personalization with multiple subjects. Our model shows strong results in both layout-guided image synthesis and text-to-image customization tasks. The project page is available at https://groundingbooth.github.io.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 42 of its 49 references that are in the map. First posted on arXiv 13 Sep 2024.

Builds on

42 of 49 references.

References · 42

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2023Segment Anythingcited by 8,158
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  7. 2022Classifier-Free Diffusion Guidancecited by 5,717
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  9. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  10. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  11. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  12. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
30 more
  1. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  2. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
  3. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  4. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
  5. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
  6. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
  7. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  8. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
  9. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
  10. 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
  11. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
  12. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
  13. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
  14. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
  15. 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 219
  16. 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Modelscited by 203
  17. 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wildcited by 197
  18. 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
  19. 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 142
  20. 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 142
  21. 2023Kosmos-G: Generating Images in Context with Multimodal Large Language Modelscited by 105
  22. 2023LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generationcited by 92
  23. 2019Image Synthesis From Reconfigurable Layout and Stylecited by 85
  24. 2023Domain-Agnostic Tuning-Encoder for Fast Personalization of Text-To-Image Modelscited by 85
  25. 2023PhotoVerse: Tuning-Free Image Customization with Text-to-Image Diffusion Modelscited by 70
  26. 2024IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representationcited by 64
  27. 2024λ-ECLIPSE: Multi-Concept Personalized Text-to-Image Diffusion Models by Leveraging CLIP Latent Spacecited by 51
  28. 2022ObjectStitch: Generative Object Compositingcited by 36
  29. 2023CustomNet: Zero-shot Object Customization with Variable-Viewpoints in Text-to-Image Diffusion Modelscited by 25
  30. 2022Interactive Image Synthesis with Panoptic Layout Generationcited by 17

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 9; 2026: 2.

13 papers.

Sort:

By area:

  1. 2024Tuning Timestep-Distilled Diffusion Model Using Pairwise Sample Optimizationcited by 25
  2. 2025Personalized Image Generation with Deep Generative Models: A Decade Surveycited by 20
  3. 2025MMIG-Bench: Towards Comprehensive and Explainable Evaluation of Multi-Modal Image Generation Modelscited by 16
  4. 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memorycited by 13
  5. 2025Multitwine: Multi-Object Compositing with Text and Layout Controlcited by 9
  6. 2024Refine-by-Align: Reference-Guided Artifacts Refinement through Semantic Alignmentcited by 5
  7. 2025PositionIC: Unified Position and Identity Consistency for Image Customizationcited by 4
  8. 2025CanvasComposer: Personalized Group Photo Generation via a Multi-Reference Canvascited by 3
  9. 2026DSH-Bench: A Difficulty- and Scenario-Aware Benchmark with Hierarchical Subject Taxonomy for Subject-Driven Text-to-Image Generationcited by 3
  10. 2025BlobCtrl: Taming Controllable Blob for Element-level Image Editingcited by 2
  11. 2025Coeff-Tuning: A Graph Filter Subspace View for Tuning Attention-Based Large Modelscited by 2
  12. 2025Identity-Preserving Text-to-Image Generation via Dual-Level Feature Decoupling and Expert-Guided Fusioncited by 2
1 more
  1. 2025SparsyFed: Sparse Adaptive Federated Trainingcited by 1