mlsanityData to 7 Oct 2026

DEIG: Detail-Enhanced Instance Generation with Fine-Grained Semantic Control

arXiv 2602.18282 ↗First posted 20 Feb 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-Instance Generation has advanced significantly in spatial placement and attribute binding. However, existing approaches still face challenges in fine-grained semantic understanding, particularly when dealing with complex textual descriptions. To overcome these limitations, we propose DEIG, a novel framework for fine-grained and controllable multi-instance generation. DEIG integrates an Instance Detail Extractor (IDE) that transforms text encoder embeddings into compact, instance-aware representations, and a Detail Fusion Module (DFM) that applies instance-based masked attention to prevent attribute leakage across instances. These components enable DEIG to generate visually coherent multi-instance scenes that precisely match rich, localized textual descriptions. To support fine-grained supervision, we construct a high-quality dataset with detailed, compositional instance captions generated by VLMs. We also introduce DEIG-Bench, a new benchmark with region-level annotations and multi-attribute prompts for both humans and objects. Experiments demonstrate that DEIG consistently outperforms existing approaches across multiple benchmarks in spatial consistency, semantic accuracy, and compositional generalization. Moreover, DEIG functions as a plug-and-play module, making it easily integrable into standard diffusion-based pipelines.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 38 references that are in the map. First posted on arXiv 20 Feb 2026.

Builds on

31 of 38 references.

References · 31

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  5. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  6. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  7. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  8. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  9. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
  10. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
  11. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
  12. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
19 more
  1. 2023Training-Free Layout Control with Cross-Attention Guidancecited by 312
  2. 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 280
  3. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
  4. 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
  5. 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
  6. 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignmentcited by 169
  7. 2023Grounded Text-to-Image Synthesis with Attention Refocusingcited by 163
  8. 2023Dense Text-to-Image Generation with Attention Modulationcited by 162
  9. 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 142
  10. 2023FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Conditioncited by 89
  11. 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generationcited by 58
  12. 2023Paragraph-to-Image Generation with Information-Enriched Diffusion Modelcited by 39
  13. 2024HiCo: Hierarchical Controllable Diffusion Model for Layout-to-image Generationcited by 39
  14. 2025EliGen: Entity-Level Controlled Image Generation with Regional Attentioncited by 32
  15. 2023SSMG: Spatial-Semantic Map Guided Diffusion Model for Free-form Layout-to-Image Generationcited by 29
  16. 20253DIS-FLUX: simple and efficient multi-instance generation with DiT renderingcited by 19
  17. 2024EMMA: Your Text-to-Image Diffusion Model Can Secretly Accept Multi-Modal Promptscited by 14
  18. 2024SpotActor: Training-Free Layout-Controlled Consistent Image Generationcited by 12
  19. 2024ROICtrl: Boosting Instance Control for Visual Generationcited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024IFAdapter: Instance Feature Control for Grounded Text-to-Image Generation
  2. 2026InstanceControl: Controllable Complex Image Generation without Instance Labeling
  3. 2025ISAC: Training-Free Instance-to-Semantic Attention Control for Multi-Instance Generation
  4. 2026InstAP: Instance-Aware Vision-Language Pre-Train for Spatial-Temporal Understanding
  5. 2025InstanceV: Instance-Level Video Generation
  6. 2025Patch Matters: Training-free Fine-grained Image Caption Enhancement via Local Perception
  7. 2026RoRA: Role-Oriented Regional Allocation for Visual Token Pruning in MLLMs
  8. 2026Delta-K: Boosting Multi-Instance Generation via Cross-Attention Augmentation