Instruction Guided Multi Object Image Editing with Quantity and Layout Consistency
Not on the map. Why?
Abstract (arXiv)
Instruction driven image editing with standard CLIP text encoders often fails in complex scenes with many objects. We present QL-Adapter, a framework for multiple object editing that tackles two challenges: enforcing object counts and spatial layouts, and accommodating diverse categories. QL-Adapter consists of two core modules: the Image-Layout Fusion Module (ILFM) and the Cross-Modal Augmentation Module (CMAM). ILFM fuses layout priors with ViT patch tokens from the CLIP image encoder to strengthen spatial structure understanding. CMAM injects image features into the text branch to enrich textual embeddings and improve instruction following. We further build QL-Dataset, a benchmark that spans broad category, layout, and count variations, and define the task of quantity and layout consistent image editing (QL-Edit). Extensive experiments show that QL-Adapter achieves state of the art performance on QL-Edit and significantly outperforms existing models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 25 references that are in the map. First posted on arXiv 29 Sep 2025.
Builds on
23 of 25 references.
References · 23
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Segment Anythingcited by 8,234
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 425
- 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
11 more
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 177
- 2024InstantStyle: Free Lunch towards Style-Preserving in Text-to-Image Generationcited by 170
- 2018Image Generation from Layoutcited by 105
- 2024IMAGDressing-v1: Customizable Virtual Dressingcited by 100
- 2019Point in, Box out: Beyond Counting Persons in Crowdscited by 62
- 2023LEDITS: Real Image Editing with DDPM Inversion and Semantic Guidancecited by 49
- 2025Long-Term TalkingFace Generation via Motion-Prior Conditional Diffusion Modelcited by 49
- 2025IMAGGarment: Fine-Grained Garment Generation for Controllable Fashion Designcited by 36
- 2025IMAGHarmony: Controllable Image Editing with Consistent Object Quantity and Layoutcited by 28
- 2023Diagnostic Benchmark and Iterative Inpainting for Layout-Guided Image Generationcited by 13
Built on by
Not cited yet.