MDE-Edit: Masked Dual-Editing for Multi-Object Image Editing via Diffusion Models
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Multi-object editing aims to modify multiple objects or regions in complex scenes while preserving structural coherence. This task faces significant challenges in scenarios involving overlapping or interacting objects: (1) Inaccurate localization of target objects due to attention misalignment, leading to incomplete or misplaced edits; (2) Attribute-object mismatch, where color or texture changes fail to align with intended regions due to cross-attention leakage, creating semantic conflicts (textite.g., color bleeding into non-target areas). Existing methods struggle with these challenges: approaches relying on global cross-attention mechanisms suffer from attention dilution and spatial interference between objects, while mask-based methods fail to bind attributes to geometrically accurate regions due to feature entanglement in multi-object scenarios. To address these limitations, we propose a training-free, inference-stage optimization approach that enables precise localized image manipulation in complex multi-object scenes, named MDE-Edit. MDE-Edit optimizes the noise latent feature in diffusion models via two key losses: Object Alignment Loss (OAL) aligns multi-layer cross-attention with segmentation masks for precise object positioning, and Color Consistency Loss (CCL) amplifies target attribute attention within masks while suppressing leakage to adjacent regions. This dual-loss design ensures localized and coherent multi-object edits. Extensive experiments demonstrate that MDE-Edit outperforms state-of-the-art methods in editing accuracy and visual quality, offering a robust solution for complex multi-object image manipulation tasks.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 21 of its 34 references that are in the map. First posted on arXiv 8 May 2025.
Builds on
21 of 34 references.
Closest ancestors · 9
Same direction, newest first
- 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editing26 Jun
- 2023LayerDiffusion: Layered Controlled Image Editing with Diffusion Models30 May
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidance20 Oct
- 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
- 2021Blended Diffusion for Text-driven Editing of Natural Images29 Nov
Other references · 12
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2023Segment Anythingcited by 8,234
- 2022Generative Adversarial Networkscited by 5,627
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
- 2023Contrastive Denoising Score for Text-guided Latent Diffusion Image Editingcited by 49
- 2024Structure Matters: Tackling the Semantic Discrepancy in Diffusion Models for Image Inpaintingcited by 40
- 2023Object-aware Inversion and Reassembly for Image Editingcited by 30
- 2022Delving Globally into Texture and Structure for Image Inpaintingcited by 13
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025LayerEdit: Disentangled Multi-Object Editing via Conflict-Aware Multi-Layer Learningcited by 7
- 2026Shifting the Breaking Point of Flow Matching for Multi-Instance Editingcited by 1
- 2026BindEdit: Taming Attention Leakage for Precise Multi-Object Image Editingcited by 0
- 2026Editing Everything Everywhere All at Oncecited by 0
- 2026Editing Everything Everywhere All at Once30 Jun 2026
- 2026BindEdit: Taming Attention Leakage for Precise Multi-Object Image Editing17 Jun 2026
- 2026Shifting the Breaking Point of Flow Matching for Multi-Instance Editing9 Feb 2026
- 2025LayerEdit: Disentangled Multi-Object Editing via Conflict-Aware Multi-Layer Learning11 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2024LoMOE: Localized Multi-Object Editing via Multi-Diffusion
- 2023MAG-Edit: Localized Image Editing in Complex Scenarios via Mask-Based Attention-Adjusted Guidance
- 2023PAIR-Diffusion: A Comprehensive Multimodal Object-Level Image Editor
- 2025EditMGT: Unleashing Potentials of Masked Generative Transformers in Image Editing
- 2025DEAL-300K: Diffusion-based Editing Area Localization with a 300K-Scale Dataset and Frequency-Prompted Baseline
- 2025CrimEdit: Controllable Editing for Counterfactual Object Removal, Insertion, and Movement
- 2024Temporally Consistent Object Editing in Videos using Extended Attention
- 2026WhereEdit: Mask-aware Local Latent Editing for One-Step Image Editing