mlsanityData to 14 Oct 2026

MDE-Edit: Masked Dual-Editing for Multi-Object Image Editing via Diffusion Models

arXiv 2505.05101 ↗First posted 8 May 2025cs.CVcited by 4

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Multi-object editing aims to modify multiple objects or regions in complex scenes while preserving structural coherence. This task faces significant challenges in scenarios involving overlapping or interacting objects: (1) Inaccurate localization of target objects due to attention misalignment, leading to incomplete or misplaced edits; (2) Attribute-object mismatch, where color or texture changes fail to align with intended regions due to cross-attention leakage, creating semantic conflicts (textite.g., color bleeding into non-target areas). Existing methods struggle with these challenges: approaches relying on global cross-attention mechanisms suffer from attention dilution and spatial interference between objects, while mask-based methods fail to bind attributes to geometrically accurate regions due to feature entanglement in multi-object scenarios. To address these limitations, we propose a training-free, inference-stage optimization approach that enables precise localized image manipulation in complex multi-object scenes, named MDE-Edit. MDE-Edit optimizes the noise latent feature in diffusion models via two key losses: Object Alignment Loss (OAL) aligns multi-layer cross-attention with segmentation masks for precise object positioning, and Color Consistency Loss (CCL) amplifies target attribute attention within masks while suppressing leakage to adjacent regions. This dual-loss design ensures localized and coherent multi-object edits. Extensive experiments demonstrate that MDE-Edit outperforms state-of-the-art methods in editing accuracy and visual quality, offering a robust solution for complex multi-object image manipulation tasks.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 21 of its 34 references that are in the map. First posted on arXiv 8 May 2025.

Builds on

21 of 34 references.

Closest ancestors · 9

Same direction, newest first

  1. 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editing26 Jun
  2. 2023LayerDiffusion: Layered Controlled Image Editing with Diffusion Models30 May
  3. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
  4. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  5. 2022DiffEdit: Diffusion-based semantic image editing with mask guidance20 Oct
  6. 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  9. 2021Blended Diffusion for Text-driven Editing of Natural Images29 Nov

Other references · 12

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2023Segment Anythingcited by 8,234
  5. 2022Generative Adversarial Networkscited by 5,627
  6. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  7. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  8. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
  9. 2023Contrastive Denoising Score for Text-guided Latent Diffusion Image Editingcited by 49
  10. 2024Structure Matters: Tackling the Semantic Discrepancy in Diffusion Models for Image Inpaintingcited by 40
  11. 2023Object-aware Inversion and Reassembly for Image Editingcited by 30
  12. 2022Delving Globally into Texture and Structure for Image Inpaintingcited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024LoMOE: Localized Multi-Object Editing via Multi-Diffusion
  2. 2023MAG-Edit: Localized Image Editing in Complex Scenarios via Mask-Based Attention-Adjusted Guidance
  3. 2023PAIR-Diffusion: A Comprehensive Multimodal Object-Level Image Editor
  4. 2025EditMGT: Unleashing Potentials of Masked Generative Transformers in Image Editing
  5. 2025DEAL-300K: Diffusion-based Editing Area Localization with a 300K-Scale Dataset and Frequency-Prompted Baseline
  6. 2025CrimEdit: Controllable Editing for Counterfactual Object Removal, Insertion, and Movement
  7. 2024Temporally Consistent Object Editing in Videos using Extended Attention
  8. 2026WhereEdit: Mask-aware Local Latent Editing for One-Step Image Editing