mlsanityData to 14 Oct 2026

MIRAGE: Benchmarking and Aligning Multi-Instance Image Editing

arXiv 2604.05180 ↗First posted 6 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Instruction-guided image editing has seen remarkable progress with models like FLUX.2 and Qwen-Image-Edit, yet they still struggle with complex scenarios with multiple similar instances each requiring individual edits. We observe that state-of-the-art models suffer from severe over-editing and spatial misalignment when faced with multiple identical instances and composite instructions. To this end, we introduce a comprehensive benchmark specifically designed to evaluate fine-grained consistency in multi-instance and multi-instruction settings. To address the failures of existing methods observed in our benchmark, we propose Multi-Instance Regional Alignment via Guided Editing (MIRAGE), a training-free framework that enables precise, localized editing. By leveraging a vision-language model to parse complex instructions into regional subsets, MIRAGE employs a multi-branch parallel denoising strategy. This approach injects latent representations of target regions into the global representation space while maintaining background integrity through a reference trajectory. Extensive evaluations on MIRA-Bench and RefEdit-Bench demonstrate that our framework significantly outperforms existing methods in achieving precise instance-level modifications while preserving background consistency. Our benchmark and code are available at https://github.com/ZiqianLiu666/MIRAGE.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 47 references that are in the map. First posted on arXiv 6 Apr 2026.

Builds on

42 of 47 references.

References · 42

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  7. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  8. 2025Qwen3-VL Technical Reportcited by 2,793
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  11. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  12. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
30 more
  1. 2025Qwen-Image Technical Reportcited by 1,044
  2. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  3. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  4. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
  5. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  6. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
  7. 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 217
  8. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
  9. 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
  10. 2023HIVE: Harnessing Human Feedback for Instructional Visual Editingcited by 173
  11. 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
  12. 2023Localizing Object-level Shape Variations with Text-to-Image Diffusion Modelscited by 142
  13. 2024Grounding DINO 1.5: Advance the "Edge" of Open-Set Object Detectioncited by 122
  14. 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 101
  15. 2023InstructEdit: Improving Automatic Masks for Diffusion-based Image Editing With User Instructionscited by 64
  16. 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modelingcited by 64
  17. 2023Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulationcited by 62
  18. 2023ZONE: Zero-Shot Instruction-Guided Local Editingcited by 62
  19. 2023Watch Your Steps: Local Image and Scene Editing by Text Instructionscited by 50
  20. 2024FlexiEdit: Frequency-Aware Latent Refinement for Enhanced Non-Rigid Editingcited by 31
  21. 2023Object-aware Inversion and Reassembly for Image Editingcited by 30
  22. 2023LIME: Localized Image Editing via Attention Regularization in Diffusion Modelscited by 27
  23. 2024Lazy Diffusion Transformer for Interactive Image Editingcited by 19
  24. 2025RefEdit: A Benchmark and Method for Improving Instruction-based Image Editing Model on Referring Expressionscited by 10
  25. 2025Unlocking the Potential of MLLMs in Referring Expression Segmentation via a Light-weight Mask Decodercited by 8
  26. 2025Early Timestep Zero-Shot Candidate Selection for Instruction-Guided Image Editingcited by 5
  27. 2025From Inpainting to Layer Decomposition: Repurposing Generative Inpainting Models for Image Layer Decompositioncited by 4
  28. 2025Your Latent Mask is Wrong: Pixel-Equivalent Latent Compositing for Diffusion Modelscited by 4
  29. 2026RegionReasoner: Region-Grounded Multi-Round Visual Reasoningcited by 4
  30. 2024E4C: Enhance Editability for Text-Based Image Editing by Harnessing Efficient CLIP Guidancecited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SI-Edit: Toward Sketch-Instruction Guided Local Image Editing with Pixel-Level Precision
  2. 2026Semantically Aligned Gradient-Driven Context-Preserving Image Editing
  3. 2025ComplexBench-Edit: Benchmarking Complex Instruction-Driven Image Editing via Compositional Dependencies
  4. 2026WhereEdit: Mask-aware Local Latent Editing for One-Step Image Editing
  5. 2025IMAGHarmony: Controllable Image Editing with Consistent Object Quantity and Layout
  6. 2026MCIE: Multimodal LLM-Driven Complex Instruction Image Editing with Spatial Guidance
  7. 2026VeloEdit: Training-Free Consistent and Continuous Instruction-Based Image Editing via Velocity Field Decomposition
  8. 2026Edit-GRPO: A Locality-Preserving Policy Optimization Framework for Image Editing